-- Logs begin at Sat 2021-09-18 08:01:31 UTC, end at Sat 2021-09-18 09:01:50 UTC. -- Sep 18 08:30:02.391088 dv-cinder-804470-6-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Sep 18 08:30:05.105268 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.common.config [-] Logging enabled! Sep 18 08:30:05.106338 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev6 Sep 18 08:30:05.106579 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=94031) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Sep 18 08:30:05.109786 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.common.config [-] Logging enabled! Sep 18 08:30:05.110040 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev6 Sep 18 08:30:05.110350 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=94031) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Sep 18 08:30:05.111288 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 18 08:30:05.111522 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 18 08:30:05.111881 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 18 08:30:05.112126 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 18 08:30:05.112350 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 18 08:30:05.112673 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.112963 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.113280 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.113510 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.113801 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.114089 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.114371 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.114658 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.114953 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.115237 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.115512 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.115792 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.116020 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.116300 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] config_source = [] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.116584 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.116873 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.117093 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] debug = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.117393 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.117821 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.118218 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.118496 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.118782 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.119069 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.119323 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.119593 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.119870 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.120190 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] host = dv-cinder-804470-6-iscsi {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.120462 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.120744 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.121026 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.121354 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.121626 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.121896 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.122176 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.122444 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] log_dir = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.122710 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] log_file = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.122980 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.123263 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.123546 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.123829 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.124050 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.124269 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.124555 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.124836 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.125106 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.125396 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.125664 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.125931 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.126200 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.126464 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.126747 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.127024 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.127304 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.127572 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.127839 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.128103 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.128373 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.128652 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.128921 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.129185 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.129477 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.129760 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.130024 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.130294 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.130591 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.130871 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.131147 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.131427 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.131696 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.131973 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.132241 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.132511 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] use_journal = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.132799 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] use_json = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.133049 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.133347 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.133627 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.133894 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.134160 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.134430 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.134696 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.134976 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:05.135266 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.135558 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.135853 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.136130 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.136422 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.136703 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.137527 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.137806 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.138092 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.138378 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.138663 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.138937 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.139219 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.139491 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.139781 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.140081 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.140369 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.140657 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.140930 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.141200 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.141491 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.141764 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.142045 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.142317 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.142602 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.142888 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.143160 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.143441 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.143730 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.144014 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.144283 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.144557 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.144845 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.145118 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.145409 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.145681 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.145967 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.146239 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.146505 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.146784 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.147054 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.147327 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.147592 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.147862 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.148147 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.148417 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.148682 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.148948 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.149250 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.149506 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.149785 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.150055 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.150320 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.150587 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.150858 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.151122 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.151387 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.151656 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.151920 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.152188 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.152452 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.153362 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.153637 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.153905 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.154172 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.154440 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.154705 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.154976 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.155242 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.155508 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.155772 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.156037 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.156303 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.156580 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.156869 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.157141 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.157441 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.157716 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.157987 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.158256 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.158526 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.158797 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.159069 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.159336 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.159621 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.159898 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.160175 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.160452 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.160721 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.161017 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.161315 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.161592 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.161862 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.162134 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.162410 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.162686 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.162976 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.163265 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.163554 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.163842 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.164125 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.164398 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.164700 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.164976 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:05.165189 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 18 08:30:05.165444 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=94031) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Sep 18 08:30:05.517347 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=94031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 18 08:30:05.517623 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=94031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 18 08:30:05.517907 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=94031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 18 08:30:05.518236 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.manager [-] Loading core plugin: ml2 Sep 18 08:30:05.905949 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:05.906249 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:05.906520 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:05.907811 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:05.908084 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:05.908349 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:05.944143 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:05.944428 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:05.944695 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:05.959336 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:05.959616 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:05.959881 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:05.988257 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:05.988527 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:05.988786 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.026065 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.026344 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.026612 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.255766 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.256371 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.256371 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.256543 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.257186 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.375443 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.375762 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.376043 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.376315 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.376582 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.376892 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.377152 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.377430 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.377682 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.377964 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.378229 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.378493 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.378745 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.378994 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.379245 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.379505 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.379756 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.380021 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.380289 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.380547 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.380819 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.381072 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.381382 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.381761 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.382010 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.382255 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.382643 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=94031) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 18 08:30:06.382882 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=94031) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 18 08:30:06.383115 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=94031) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 18 08:30:06.383347 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=94031) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 18 08:30:06.383580 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=94031) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 18 08:30:06.383811 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=94031) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 18 08:30:06.384169 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Sep 18 08:30:06.387224 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Sep 18 08:30:06.391202 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Sep 18 08:30:06.394799 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(200, 249)])]) Sep 18 08:30:06.396408 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Sep 18 08:30:06.396854 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Sep 18 08:30:06.397187 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Sep 18 08:30:06.397587 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Sep 18 08:30:06.400324 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Sep 18 08:30:06.400572 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Sep 18 08:30:06.400915 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Sep 18 08:30:06.406645 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Sep 18 08:30:06.428656 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Sep 18 08:30:06.429112 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.429433 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=94031) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}} Sep 18 08:30:06.429792 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.431159 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=94031) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Sep 18 08:30:06.431599 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Sep 18 08:30:06.431845 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Sep 18 08:30:06.435016 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.435298 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:06.498387 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Sep 18 08:30:06.498623 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Sep 18 08:30:06.498853 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Sep 18 08:30:06.499211 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Sep 18 08:30:06.520669 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_db.sqlalchemy.engines [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 18 08:30:07.047666 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.managers [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Initializing driver for type 'gre' Sep 18 08:30:07.048264 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] gre ID ranges: [(1, 1000)] Sep 18 08:30:07.099764 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.managers [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Initializing driver for type 'local' Sep 18 08:30:07.100109 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.managers [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Initializing driver for type 'vlan' Sep 18 08:30:07.113007 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] VlanTypeDriver initialization complete Sep 18 08:30:07.113377 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.managers [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Initializing driver for type 'vxlan' Sep 18 08:30:07.113924 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] vxlan ID ranges: [(1, 1000)] Sep 18 08:30:07.166528 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.managers [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Initializing extension driver 'port_security' Sep 18 08:30:07.166904 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.extensions.port_security [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] PortSecurityExtensionDriver initialization complete Sep 18 08:30:07.167235 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.managers [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Initializing mechanism driver 'openvswitch' Sep 18 08:30:07.167561 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.managers [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Initializing mechanism driver 'hyperv' Sep 18 08:30:07.174659 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.plugins.ml2.plugin [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=94031) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:30:07.175333 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > port after_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.175700 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > port after_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.176051 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > port after_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.176571 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=94031) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Sep 18 08:30:07.176997 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > subnet after_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.177382 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > subnet after_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.177728 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > subnet after_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.178117 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=94031) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Sep 18 08:30:07.178521 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > network after_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.178875 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > network after_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.179219 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > network after_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.179604 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=94031) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Sep 18 08:30:07.180006 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > security_group after_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.180355 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > security_group after_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.180698 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > security_group after_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.181243 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=94031) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Sep 18 08:30:07.181651 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.182000 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.182345 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.182736 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=94031) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Sep 18 08:30:07.183136 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > address_group after_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.183480 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > address_group after_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.183816 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > address_group after_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.184201 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=94031) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Sep 18 08:30:07.184577 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] ML2 OVO RPC backend initialized. {{(pid=94031) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Sep 18 08:30:07.185309 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > router_interface after_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.185669 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.186083 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > network before_response 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.186432 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > networks before_response 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.186778 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > port before_response 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.187124 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > ports before_response 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.187467 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > subnet before_response 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.187806 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > subnets before_response 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.188152 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > network after_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.188490 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > network after_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.188826 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > network after_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.189164 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > port after_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.189527 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > port after_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.189864 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > port after_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.190197 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > subnet after_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.190532 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > subnet after_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.190866 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > subnet after_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.191434 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.plugin [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Modular L2 Plugin initialization complete Sep 18 08:30:07.191762 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading services supported by the core plugin {{(pid=94031) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Sep 18 08:30:07.192084 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.plugins.ml2.managers [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Got port-security extension from driver 'port_security' Sep 18 08:30:07.192544 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.extensions.vlantransparent [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Disabled vlantransparent extension. Sep 18 08:30:07.193026 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=94031) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Sep 18 08:30:07.193377 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading Plugin: router Sep 18 08:30:07.229069 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > router_interface before_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.229483 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > router after_create 55549900 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.229858 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > router before_create 55549900 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.230228 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > router_interface before_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.230602 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.231498 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > router after_delete 55549900 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.231861 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > floatingip after_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.232212 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > floatingip after_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.232570 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > router after_create 55549900 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.232920 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > router after_update 55549900 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.233310 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > router after_update 55549900 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.233645 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.234003 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > router after_update 55549900 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.234415 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > router precommit_update 55549900 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.234785 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: port after_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.235129 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: port after_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.235468 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: subnet after_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.235817 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.236167 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > port precommit_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.236515 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > router precommit_create 55549900 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.236857 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: port before_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.237197 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > router precommit_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.237582 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > router after_update 55549900 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.237927 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > router precommit_delete 55549900 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.238278 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > router precommit_create 55549900 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.238638 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > router_interface after_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.238981 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > router precommit_update 55549900 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.239344 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > agent after_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.239694 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > agent after_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.240037 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > network after_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.240884 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Tracking information for resource: router configured {{(pid=94031) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 18 08:30:07.241238 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Tracking information for resource: floatingip configured {{(pid=94031) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Sep 18 08:30:07.246080 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.db.l3_agentschedulers_db [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Sep 18 08:30:07.246681 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: port after_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.247047 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: port after_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.247404 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: port after_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.247757 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: port after_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.248549 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > router before_create 55550100 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.248919 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > router precommit_delete 55550100 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.249312 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > router precommit_create 55550100 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.249672 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > router precommit_update 55550100 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.254338 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.services.provider_configuration [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Service providers = [] {{(pid=94031) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Sep 18 08:30:07.254705 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.db.servicetype_db [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=94031) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Sep 18 08:30:07.257690 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.services.service_base [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=94031) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Sep 18 08:30:07.258201 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.services.service_base [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=94031) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Sep 18 08:30:07.258324 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.services.service_base [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=94031) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Sep 18 08:30:07.259217 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.services.service_base [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=94031) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Sep 18 08:30:07.259589 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.services.service_base [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Default provider is not specified for service type L3_ROUTER_NAT Sep 18 08:30:07.259959 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=94031) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 18 08:30:07.260277 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Sep 18 08:30:07.270747 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=94031) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 18 08:30:07.271085 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading Plugin: auto_allocate Sep 18 08:30:07.276776 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: network precommit_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.277150 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: network precommit_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.278201 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=94031) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 18 08:30:07.278523 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading Plugin: tag Sep 18 08:30:07.284930 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=94031) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 18 08:30:07.285289 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading Plugin: timestamp Sep 18 08:30:07.289239 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=94031) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 18 08:30:07.289579 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading Plugin: network_ip_availability Sep 18 08:30:07.295524 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.295897 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.296256 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.296958 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=94031) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 18 08:30:07.297311 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading Plugin: flavors Sep 18 08:30:07.301958 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=94031) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 18 08:30:07.302291 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading Plugin: revisions Sep 18 08:30:07.306510 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=94031) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Sep 18 08:30:07.306893 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_concurrency.lockutils [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 1.789s {{(pid=94031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 18 08:30:07.307629 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=94031) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Sep 18 08:30:07.307964 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Initializing extension manager. Sep 18 08:30:07.308474 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: __init__.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.308839 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: __pycache__ {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.309176 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.309535 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: address_group.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.310281 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.310834 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: address-group Sep 18 08:30:07.311155 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: address_scope.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.312045 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.312559 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: address-scope Sep 18 08:30:07.312882 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: admin_state_down_before_update.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.313843 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.314360 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: router-admin-state-down-before-update Sep 18 08:30:07.314682 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: agent.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.315381 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.315888 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: agent Sep 18 08:30:07.316209 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: agent_resources_synced.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.317115 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.317655 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: agent-resources-synced Sep 18 08:30:07.317982 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: allowedaddresspairs.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.319755 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.320279 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: allowed-address-pairs Sep 18 08:30:07.320607 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: auto_allocated_topology.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.321699 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.322216 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: auto-allocated-topology Sep 18 08:30:07.322543 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: availability_zone.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.323231 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.323736 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: availability_zone Sep 18 08:30:07.324060 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: availability_zone_filter.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.324996 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.325534 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: availability_zone_filter Sep 18 08:30:07.325859 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: data_plane_status.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.326759 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.327265 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension data-plane-status not supported by any of loaded plugins Sep 18 08:30:07.327587 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: default_subnetpools.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.328492 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.328999 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: default-subnetpools Sep 18 08:30:07.329357 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: dhcpagentscheduler.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.330157 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.330663 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: dhcp_agent_scheduler Sep 18 08:30:07.330984 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: dns.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.331896 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.332401 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension dns-integration not supported by any of loaded plugins Sep 18 08:30:07.332720 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: dns_domain_ports.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.333659 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.334170 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension dns-domain-ports not supported by any of loaded plugins Sep 18 08:30:07.334492 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.335409 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.335915 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Sep 18 08:30:07.336234 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: dvr.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.336893 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.337428 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: dvr Sep 18 08:30:07.337748 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: ecmp_routes.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.338653 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.339155 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension ecmp_routes not supported by any of loaded plugins Sep 18 08:30:07.339476 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: empty_string_filtering.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.341330 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.341840 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: empty-string-filtering Sep 18 08:30:07.342159 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.343071 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.343579 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Sep 18 08:30:07.343903 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.344812 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.345355 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Sep 18 08:30:07.345682 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: external_net.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.346905 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.347731 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: external-net Sep 18 08:30:07.348255 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: extra_dhcp_opt.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.349717 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.350620 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: extra_dhcp_opt Sep 18 08:30:07.351184 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: extraroute.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.352562 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.353340 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: extraroute Sep 18 08:30:07.353677 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: extraroute_atomic.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.354731 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.355247 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: extraroute-atomic Sep 18 08:30:07.355576 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: filter_validation.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.356792 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.357335 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: filter-validation Sep 18 08:30:07.357664 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: fip_pf_description.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.358569 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.359083 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Sep 18 08:30:07.359409 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: fip_port_details.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.360323 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.360832 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: fip-port-details Sep 18 08:30:07.361156 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: flavors.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.362410 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.362929 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: flavors Sep 18 08:30:07.363256 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.364908 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.365462 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Sep 18 08:30:07.365805 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: floatingip_pools.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.366504 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.367016 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: floatingip-pools Sep 18 08:30:07.367343 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: ip_allocation.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.368270 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.368781 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension ip_allocation not supported by any of loaded plugins Sep 18 08:30:07.369106 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.370058 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.370568 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: ip-substring-filtering Sep 18 08:30:07.370894 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: l2_adjacency.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.371836 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.372343 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension l2_adjacency not supported by any of loaded plugins Sep 18 08:30:07.372667 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: l3.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.373787 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.374312 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: router Sep 18 08:30:07.374636 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: l3_conntrack_helper.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.376877 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.377431 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension l3-conntrack-helper not supported by any of loaded plugins Sep 18 08:30:07.377765 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.378699 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.379216 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: ext-gw-mode Sep 18 08:30:07.379541 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.380465 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.380975 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: l3-ha Sep 18 08:30:07.381329 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: l3_flavors.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.382245 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.382757 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: l3-flavors Sep 18 08:30:07.383079 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.383985 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.384495 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: l3-port-ip-change-not-allowed Sep 18 08:30:07.384815 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: l3agentscheduler.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.385870 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.386383 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: l3_agent_scheduler Sep 18 08:30:07.386707 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: logging.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.388670 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.389197 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension logging not supported by any of loaded plugins Sep 18 08:30:07.389555 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: metering.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.390295 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.390871 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: metering Sep 18 08:30:07.391197 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.392285 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.392805 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: metering_source_and_destination_fields Sep 18 08:30:07.393132 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: multiprovidernet.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.394091 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.394607 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: multi-provider Sep 18 08:30:07.394934 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: netmtu.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.395849 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.396365 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: net-mtu Sep 18 08:30:07.396696 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: netmtu_writable.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.397640 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.398152 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: net-mtu-writable Sep 18 08:30:07.398474 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: network_availability_zone.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.399143 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.399653 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: network_availability_zone Sep 18 08:30:07.399973 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: network_ip_availability.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.401081 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.401641 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: network-ip-availability Sep 18 08:30:07.401968 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: network_segment_range.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.403333 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.403842 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension network-segment-range not supported by any of loaded plugins Sep 18 08:30:07.404167 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: pagination.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.405148 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.405506 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: pagination Sep 18 08:30:07.405829 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: port_device_profile.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.406753 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.407277 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: port-device-profile Sep 18 08:30:07.407599 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.408525 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.409037 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: port-mac-address-regenerate Sep 18 08:30:07.409389 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.410298 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.410809 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: port-numa-affinity-policy Sep 18 08:30:07.411129 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: port_resource_request.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.412163 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.412668 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension port-resource-request not supported by any of loaded plugins Sep 18 08:30:07.412988 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: portbindings.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.413940 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.414457 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: binding Sep 18 08:30:07.414780 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: portbindings_extended.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.416054 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.416578 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: binding-extended Sep 18 08:30:07.416913 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: portsecurity.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.417861 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.418402 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: port-security Sep 18 08:30:07.418726 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: project_id.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.419701 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.420035 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: project-id Sep 18 08:30:07.420361 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: providernet.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.421305 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.421831 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: provider Sep 18 08:30:07.422152 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: qos.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.425692 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.426218 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension qos not supported by any of loaded plugins Sep 18 08:30:07.426556 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.427797 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.428321 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Sep 18 08:30:07.428652 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.429603 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.430120 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Sep 18 08:30:07.430448 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: qos_default.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.431356 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.431873 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension qos-default not supported by any of loaded plugins Sep 18 08:30:07.432196 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: qos_fip.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.432841 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.433377 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension qos-fip not supported by any of loaded plugins Sep 18 08:30:07.433700 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: qos_gateway_ip.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.434645 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.435155 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension qos-gateway-ip not supported by any of loaded plugins Sep 18 08:30:07.435480 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: qos_port_network_policy.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.436396 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.436902 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension qos-port-network-policy not supported by any of loaded plugins Sep 18 08:30:07.437250 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: qos_pps_rule.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.438433 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.438949 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension qos-pps not supported by any of loaded plugins Sep 18 08:30:07.439275 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: qos_rule_type_details.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.440184 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.440695 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension qos-rule-type-details not supported by any of loaded plugins Sep 18 08:30:07.441018 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: qos_rules_alias.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.442106 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.442626 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension qos-rules-alias not supported by any of loaded plugins Sep 18 08:30:07.442949 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: quotasv2.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.443845 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per tenant" updated="2012-07-29T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.444171 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: quotas Sep 18 08:30:07.444490 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: quotasv2_detail.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.447738 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.448080 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: quota_details Sep 18 08:30:07.448414 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: rbac.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.450005 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.450534 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: rbac-policies Sep 18 08:30:07.450863 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: rbac_address_group.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.451794 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.452311 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: rbac-address-group Sep 18 08:30:07.452636 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: rbac_address_scope.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.453753 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.454317 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: rbac-address-scope Sep 18 08:30:07.454639 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: rbac_security_groups.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.455596 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.456105 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: rbac-security-groups Sep 18 08:30:07.456431 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: rbac_subnetpool.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.457421 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.457988 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: rbac-subnetpool Sep 18 08:30:07.458351 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: revisionifmatch.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.459363 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.459881 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: revision-if-match Sep 18 08:30:07.460236 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: revisions.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.461456 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.461980 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: standard-attr-revisions Sep 18 08:30:07.462303 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: router_availability_zone.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.463027 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.463582 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: router_availability_zone Sep 18 08:30:07.463908 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: routerservicetype.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.465097 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.466313 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension router-service-type not supported by any of loaded plugins Sep 18 08:30:07.466646 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.467601 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.468239 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: security-groups-normalized-cidr Sep 18 08:30:07.468559 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: security_groups_port_filtering.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.469527 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.470047 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: port-security-groups-filtering Sep 18 08:30:07.470371 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.471309 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.471820 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: security-groups-remote-address-group Sep 18 08:30:07.472146 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: securitygroup.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.483184 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.483719 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: security-group Sep 18 08:30:07.484052 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: segment.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.484840 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.485392 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension segment not supported by any of loaded plugins Sep 18 08:30:07.485721 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.486663 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.487178 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Sep 18 08:30:07.487502 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: servicetype.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.488682 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.489203 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: service-type Sep 18 08:30:07.489552 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: sorting.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.490529 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.490861 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: sorting Sep 18 08:30:07.491184 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: standard_attr_segment.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.492099 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.492616 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension standard-attr-segment not supported by any of loaded plugins Sep 18 08:30:07.492939 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: standardattrdescription.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.493619 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.494130 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: standard-attr-description Sep 18 08:30:07.494452 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: stateful_security_group.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.495372 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.495888 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: stateful-security-group Sep 18 08:30:07.496211 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: stdattrs_common.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.496813 dv-cinder-804470-6-iscsi neutron-server[94031]: WARNING neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Sep 18 08:30:07.497133 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.498083 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.498606 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Sep 18 08:30:07.498932 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: subnet_onboard.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.500003 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.500526 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: subnet_onboard Sep 18 08:30:07.500851 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.501810 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.502325 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Sep 18 08:30:07.502650 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: subnet_service_types.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.503572 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.504090 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: subnet-service-types Sep 18 08:30:07.504417 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: subnetallocation.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.505522 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.506042 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: subnet_allocation Sep 18 08:30:07.506368 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.507041 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.507554 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: subnetpool-prefix-ops Sep 18 08:30:07.507921 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.508813 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.509368 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Sep 18 08:30:07.509693 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: tagging.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.510763 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.511293 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: standard-attr-tag Sep 18 08:30:07.511619 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: timestamp.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.513364 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.513890 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loaded extension: standard-attr-timestamp Sep 18 08:30:07.514221 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: trunk.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.515253 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.515775 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension trunk not supported by any of loaded plugins Sep 18 08:30:07.516102 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: trunk_details.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.517019 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.517576 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension trunk-details not supported by any of loaded plugins Sep 18 08:30:07.517902 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: uplink_status_propagation.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.518835 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.519347 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension uplink-status-propagation not supported by any of loaded plugins Sep 18 08:30:07.519670 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Loading extension file: vlantransparent.py {{(pid=94031) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Sep 18 08:30:07.520338 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=94031) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Sep 18 08:30:07.520846 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extension vlan-transparent not supported by any of loaded plugins Sep 18 08:30:07.523341 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Creating instance of TrackedResource for resource:network Sep 18 08:30:07.523862 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Creating instance of TrackedResource for resource:subnet Sep 18 08:30:07.524263 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Creating instance of TrackedResource for resource:subnetpool Sep 18 08:30:07.524662 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Creating instance of TrackedResource for resource:port Sep 18 08:30:07.525919 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.v2.resource_helper [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=94031) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 18 08:30:07.526367 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.v2.resource_helper [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Service FLAVORS assigned prefix: {{(pid=94031) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 18 08:30:07.526997 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.v2.resource_helper [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=94031) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 18 08:30:07.527438 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.v2.resource_helper [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=94031) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 18 08:30:07.528306 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Creating instance of TrackedResource for resource:router Sep 18 08:30:07.528736 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Creating instance of TrackedResource for resource:floatingip Sep 18 08:30:07.529229 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.v2.resource_helper [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Service METERING assigned prefix: /metering {{(pid=94031) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 18 08:30:07.530685 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.531061 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.531419 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=94031) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:30:07.532435 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Creating instance of CountableResource for resource:rbac_policy Sep 18 08:30:07.532902 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Creating instance of TrackedResource for resource:security_group Sep 18 08:30:07.533356 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Creating instance of TrackedResource for resource:security_group_rule Sep 18 08:30:07.533941 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.v2.resource_helper [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Service CORE assigned prefix: {{(pid=94031) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 18 08:30:07.534272 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Creating instance of TrackedResource for resource:subnetpool Sep 18 08:30:07.534615 dv-cinder-804470-6-iscsi neutron-server[94031]: WARNING neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] subnetpool is already registered Sep 18 08:30:07.535058 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.v2.resource_helper [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Service CORE assigned prefix: {{(pid=94031) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 18 08:30:07.535390 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Creating instance of TrackedResource for resource:subnetpool Sep 18 08:30:07.535721 dv-cinder-804470-6-iscsi neutron-server[94031]: WARNING neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] subnetpool is already registered Sep 18 08:30:07.538047 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.v2.resource_helper [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=94031) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 18 08:30:07.538482 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.v2.resource_helper [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Service FLAVORS assigned prefix: {{(pid=94031) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 18 08:30:07.539079 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.v2.resource_helper [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=94031) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 18 08:30:07.539503 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.v2.resource_helper [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=94031) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 18 08:30:07.539837 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Creating instance of TrackedResource for resource:router Sep 18 08:30:07.540175 dv-cinder-804470-6-iscsi neutron-server[94031]: WARNING neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] router is already registered Sep 18 08:30:07.540585 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Creating instance of TrackedResource for resource:floatingip Sep 18 08:30:07.540920 dv-cinder-804470-6-iscsi neutron-server[94031]: WARNING neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] floatingip is already registered Sep 18 08:30:07.541401 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.v2.resource_helper [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Service METERING assigned prefix: /metering {{(pid=94031) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 18 08:30:07.542083 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Creating instance of CountableResource for resource:rbac_policy Sep 18 08:30:07.542408 dv-cinder-804470-6-iscsi neutron-server[94031]: WARNING neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] rbac_policy is already registered Sep 18 08:30:07.542823 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Creating instance of TrackedResource for resource:security_group Sep 18 08:30:07.543179 dv-cinder-804470-6-iscsi neutron-server[94031]: WARNING neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] security_group is already registered Sep 18 08:30:07.543581 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Creating instance of TrackedResource for resource:security_group_rule Sep 18 08:30:07.543912 dv-cinder-804470-6-iscsi neutron-server[94031]: WARNING neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] security_group_rule is already registered Sep 18 08:30:07.544536 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.v2.resource_helper [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Service CORE assigned prefix: {{(pid=94031) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 18 08:30:07.544867 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Creating instance of TrackedResource for resource:subnetpool Sep 18 08:30:07.545203 dv-cinder-804470-6-iscsi neutron-server[94031]: WARNING neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] subnetpool is already registered Sep 18 08:30:07.545645 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.v2.resource_helper [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Service CORE assigned prefix: {{(pid=94031) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Sep 18 08:30:07.545976 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Creating instance of TrackedResource for resource:subnetpool Sep 18 08:30:07.546308 dv-cinder-804470-6-iscsi neutron-server[94031]: WARNING neutron.quota.resource_registry [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] subnetpool is already registered Sep 18 08:30:07.546771 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: extensions {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.548231 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: address-groups {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.549750 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: address-scopes {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.551091 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: agents {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.552252 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: auto-allocated-topology {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.553528 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: availability_zones {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.554759 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: dhcp-networks {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.556317 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: dhcp-agents {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.557788 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: routers {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.560052 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: flavors {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.561244 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: service_profiles {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.562469 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: next_providers {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.563921 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: service_profiles {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.565489 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: floatingip-pools {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.566723 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: routers {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.568854 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: floatingips {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.570177 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: l3-routers {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.571576 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: l3-agents {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.572992 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: metering-labels {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.574877 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: metering-label-rules {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.576168 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: network-ip-availabilities {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.577489 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: bindings {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.579974 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: quotas {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.581482 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: quotas {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.582903 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: rbac-policies {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.584121 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: security-groups {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.585446 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: security-group-rules {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.586715 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: service-providers {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.587934 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: subnetpools {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.589401 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: subnetpools {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.591772 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: tags {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.593465 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: tags {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.595332 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: tags {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.597123 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: tags {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.598948 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: tags {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.600790 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: tags {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.602534 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: tags {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.604435 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: tags {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.606265 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: tags {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.608010 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron.api.extensions [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Extended resource: tags {{(pid=94031) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Sep 18 08:30:07.614024 dv-cinder-804470-6-iscsi neutron-server[94031]: WARNING keystonemiddleware.auth_token [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 18 08:30:07.618735 dv-cinder-804470-6-iscsi neutron-server[94031]: WARNING keystonemiddleware.auth_token [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 18 08:30:07.627112 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_concurrency.lockutils [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Acquired lock "singleton_lock" {{(pid=94031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Sep 18 08:30:07.627583 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_concurrency.lockutils [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Releasing lock "singleton_lock" {{(pid=94031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Sep 18 08:30:07.628234 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO oslo_service.service [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Starting 2 workers Sep 18 08:30:07.632977 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Started child 94346 {{(pid=94031) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Sep 18 08:30:07.637867 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Started child 94347 {{(pid=94031) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Sep 18 08:30:07.638954 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:07.639582 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO neutron.service [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Neutron service started, listening on 0.0.0.0:9696 Sep 18 08:30:07.640105 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Notify callbacks [] for process, before_spawn {{(pid=94031) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:07.640481 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [-] (94346) wsgi starting up on http://0.0.0.0:9696 Sep 18 08:30:07.642550 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO oslo_service.service [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Starting 1 workers Sep 18 08:30:07.642876 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:07.644307 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [-] (94347) wsgi starting up on http://0.0.0.0:9696 Sep 18 08:30:07.647713 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Started child 94348 {{(pid=94031) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Sep 18 08:30:07.648239 dv-cinder-804470-6-iscsi neutron-server[94031]: INFO oslo_service.service [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Starting 1 workers Sep 18 08:30:07.651258 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.service [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] calling RpcWorker wait() {{(pid=94348) _wait /opt/stack/neutron/neutron/service.py:128}} Sep 18 08:30:07.651762 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.service [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] returning from RpcWorker wait() {{(pid=94348) _wait /opt/stack/neutron/neutron/service.py:135}} Sep 18 08:30:07.653175 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Started child 94349 {{(pid=94031) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Sep 18 08:30:07.653563 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:07.654004 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:30:07.654109 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG neutron_lib.callbacks.manager [None req-a2d08885-1d55-467b-938e-1b619780a634 None None] Notify callbacks [] for process, after_spawn {{(pid=94031) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:07.656461 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=94031) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Sep 18 08:30:07.656461 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 18 08:30:07.656633 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 18 08:30:07.656823 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 18 08:30:07.657138 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 18 08:30:07.657479 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 18 08:30:07.658115 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.658442 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [-] Notify callbacks [] for process, after_init {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:07.659047 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.659460 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.659706 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:30:07.659866 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.660316 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.661057 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.661499 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.661922 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.662347 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.662713 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.663028 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.663342 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.663732 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.664104 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.664544 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.664970 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.665369 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.665762 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.666095 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.666471 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] config_source = [] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.666878 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.667263 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.667682 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] debug = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.668091 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.668762 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.669141 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.669545 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.669902 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.670310 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.670702 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.671078 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.671471 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.671826 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.672210 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.672606 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.672987 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.673373 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.673726 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.674141 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.674492 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.675116 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] host = dv-cinder-804470-6-iscsi {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.675491 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.675860 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.676254 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.676634 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.677023 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.677421 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.677827 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.678213 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.678599 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.678973 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.679359 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.679766 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.680167 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] log_dir = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.680562 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] log_file = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.680862 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] log_options = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.681264 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.681679 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.682085 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.682426 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.682716 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.683025 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.683403 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.683714 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.684133 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.684496 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.684863 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.685235 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.685606 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.685972 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.686364 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.686725 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.687124 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.687458 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.687834 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.688207 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.688567 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.688996 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.689233 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.689666 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.689780 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.689929 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.690317 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.690699 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.690976 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.691248 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.691492 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.691753 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.691988 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.692227 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.692501 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.692876 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.693281 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.693663 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.694085 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.694456 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.694859 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.695947 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.696176 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.696429 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.696677 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.696897 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] use_journal = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.697134 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] use_json = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.697373 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.697607 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.697880 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.698094 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.698327 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.698540 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.698769 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.699016 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.699958 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.700230 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.700565 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.700797 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.701031 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.701344 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.701577 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.701798 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.702047 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.702308 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.702661 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.702867 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.703150 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.703370 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.703636 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.703953 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.704377 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.704639 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.704873 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.705100 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.705362 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.706281 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.709436 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.709717 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.710001 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.710258 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.710517 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.710867 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.711158 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.711440 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.35/identity {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.711699 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.711928 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.712185 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.712423 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.712679 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.712923 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.713145 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.713454 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.713709 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.713936 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.714168 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.714412 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.714623 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.715134 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.715943 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.716220 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.716475 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.716707 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.716927 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.717148 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.717487 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.717728 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.717981 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.718222 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.718491 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.718742 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.718985 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.719225 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.719443 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.719702 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.719969 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.720190 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.720407 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.720623 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.720850 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.721084 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.721360 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.721610 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.721826 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.722048 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.722293 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.722514 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.722760 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.722998 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.723232 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.723453 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.723668 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.723901 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.724136 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.724503 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.724905 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.725129 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.725394 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.725621 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.725837 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.726053 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.726267 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.726483 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.726772 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.727076 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.727422 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.727754 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.728218 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.728480 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.728698 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.728959 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.729279 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.729458 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.729902 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.730278 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.730739 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.731157 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.731414 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.731668 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.731918 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.732158 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.732394 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.732659 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.732877 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.733123 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.733385 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.733788 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.734214 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.734654 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.735092 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.735517 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.735954 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.736382 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.736830 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.737266 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.737715 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.738215 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.738663 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.739104 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.739515 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.739924 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.740363 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.741002 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.741485 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.741924 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.742576 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.742994 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.743426 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.743679 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.744036 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.744420 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.744662 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.745013 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.745660 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.745660 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.745820 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.745964 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.746871 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.747250 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.747663 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.748055 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.748304 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.748557 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.748792 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.35/identity {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.749020 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.749300 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.749560 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.749776 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.750012 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.750508 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.750765 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.750982 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.751197 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.751441 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.751675 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.751898 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.752132 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.752356 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.752574 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.752824 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.753040 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.753452 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.753698 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.753942 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.754158 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.754391 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.754606 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.754869 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.755088 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.755363 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.755608 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.755822 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.756053 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.756279 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.756516 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.756749 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.756998 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.757256 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.757457 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.757691 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.757987 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.758171 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.758535 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.758936 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.759352 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.759630 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.759870 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.760349 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.760614 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.761032 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.761131 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.761329 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.761728 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.762652 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.762878 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.763117 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.763339 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.763730 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.763830 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.764034 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.764357 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.764517 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.764878 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.765346 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.765569 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.765783 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.767611 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.767812 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.768063 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.768328 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.770494 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.770494 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.770494 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.770494 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.770494 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.770494 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.770494 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.770494 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.771010 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.771010 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.771150 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.771362 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.771792 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.772014 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.772247 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.772519 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.772736 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.772983 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.773203 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.773471 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.773700 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.773932 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.774145 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.774368 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.774586 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.774795 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.775045 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.775257 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.775466 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.775687 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.775905 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.776116 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.776419 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.776671 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.776892 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.777198 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.777705 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.778125 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.778370 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.778689 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.778906 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.779154 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.779386 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.779624 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.780180 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.780497 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.780826 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.782597 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.782878 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.783155 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.783474 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.783770 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:200:249'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.784060 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.784316 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.784613 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.784952 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.785506 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.785718 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.785958 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.786217 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.786448 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.786673 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.786912 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.787156 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.787378 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.788003 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.788249 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.788506 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.788759 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.788990 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.789277 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.789463 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.789695 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.789940 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.790162 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.790314 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 18 08:30:07.790866 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=94031) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Sep 18 08:30:07.791032 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 18 08:30:07.791197 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 18 08:30:07.791396 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 18 08:30:07.791565 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 18 08:30:07.791724 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 18 08:30:07.791935 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.792097 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.792255 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.792415 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.792567 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.792755 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.792915 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.793074 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.793526 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.793690 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.794002 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.794312 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.794471 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.794777 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.794940 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.795096 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.795393 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.795680 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.795994 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.796299 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] config_source = [] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.796455 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.796757 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.796959 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] debug = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.797068 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.797337 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.797500 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.797798 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.798120 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.798276 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.798569 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.798905 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.799065 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.799363 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.800527 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.800710 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.800880 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.801048 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.801228 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.801396 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.801557 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.801718 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] host = dv-cinder-804470-6-iscsi {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.801878 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.802038 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.802198 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.802358 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.802516 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.802832 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.802989 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.803306 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.803466 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.803770 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.803933 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.804024 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:30:07.804115 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.804234 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] log_dir = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.804536 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] log_file = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.804693 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] log_options = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.804995 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.805151 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.805481 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.805672 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.805839 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.806003 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.806148 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.806305 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.806456 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.806615 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.806765 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.806926 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.807083 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.807220 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.807421 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.807571 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.807709 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.807844 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.808000 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.808210 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.808353 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.808490 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.808626 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.809393 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.809393 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.809678 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.809678 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.809937 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.809937 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.810286 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.810286 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.810546 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.810546 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.810815 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.810815 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.811074 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.811210 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.811345 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.811480 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.811617 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.811759 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.811909 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.812056 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.812201 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.812338 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.812479 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] use_journal = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.812617 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] use_json = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.812772 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.812980 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.812980 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.813299 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.813444 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.813591 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.813729 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.813865 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 18 08:30:07.814013 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.814150 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.814286 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.814421 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.814565 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.814702 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.814838 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.814981 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.815118 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.815286 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.815455 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.815618 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.815791 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.815954 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.816092 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.816252 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.816395 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.816559 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.816703 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.816867 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.817030 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.817174 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.817382 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.817657 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.817853 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.818110 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.818345 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.818490 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.818626 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.818763 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.35/identity {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.818898 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.819255 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.819470 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.819611 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.819746 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.819882 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.820018 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.820262 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.820407 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.820543 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.820699 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.820837 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.820972 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.821109 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.821279 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.821436 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.821575 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.821710 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.821846 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.821990 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.822129 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.822272 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.822412 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.822559 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.822695 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.822869 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.823091 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.823236 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.823391 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.823529 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.823665 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.823801 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.823937 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.824073 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.824209 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.824345 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.825044 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.825233 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.825379 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.825516 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.825675 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.825831 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.825976 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.826135 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.826280 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.826444 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.826602 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.826740 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.826901 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.827065 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.827220 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.827368 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.827506 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.827727 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.827883 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.828042 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.828186 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.828411 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.828566 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.828704 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.828840 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.828976 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.829113 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.829326 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.829482 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.829620 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.829756 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.829902 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.830039 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.830176 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.830398 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.830542 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.830690 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.830828 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.830964 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.831099 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.831235 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.831381 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.831518 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.831654 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.831799 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.831945 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.832082 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.832218 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.832382 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.832531 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.832700 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.832844 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.833012 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.833261 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.833433 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.833570 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.833700 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.833807 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.833967 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.834126 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.834287 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.834448 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.834608 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.834768 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.834927 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.835089 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.835256 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.835427 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.835587 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.835748 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.835906 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.836091 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.836341 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.836462 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.836573 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.836696 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.836839 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.836998 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.837159 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.837347 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.837507 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.837667 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.837828 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.35/identity {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.837987 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.838148 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.838308 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.838519 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.838648 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.838771 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.838903 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.839061 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.839221 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.839380 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.839540 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.839700 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.840134 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.840298 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.840502 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.840639 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.840763 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.840885 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.841050 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.841228 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.841388 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.841547 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.841709 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.841869 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.842032 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.842195 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.842354 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.842516 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.842678 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.842839 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.843000 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.843161 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.843334 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.843473 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.843618 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.843778 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.843939 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.844101 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.844261 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.844422 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.844584 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.844746 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.844906 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.845082 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.845260 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.845422 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.845582 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.845742 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.845901 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.846062 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.846224 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.846444 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.846573 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.846696 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.846819 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.846978 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.847138 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.847298 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.847459 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.847620 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.847825 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.847950 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.848072 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.848237 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.848398 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.848611 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.848746 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.848870 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.849018 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.849178 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.849356 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.849516 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.849676 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.849837 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.850007 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.850167 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.850328 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.850554 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.850699 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.850823 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.850946 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.851097 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.851257 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.851416 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.851575 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.851740 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.851909 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.852070 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.852229 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.852506 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.852784 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.852784 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.853275 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.853424 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.853586 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.853748 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.853908 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.854067 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.854648 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.854648 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.854895 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.855017 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.855139 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.855260 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.855914 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.855914 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.855914 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.855914 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.856340 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.856340 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.856340 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.856609 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.856609 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.856768 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.856920 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.857086 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.857275 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.857443 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:200:249'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.857606 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.857751 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.857922 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.858094 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.858238 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.858385 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.858549 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.858764 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.858912 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.859002 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.859152 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.859311 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.859471 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.859634 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.859795 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.859954 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.860115 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.860274 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.860435 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.860612 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.860753 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.860901 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.861061 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 18 08:30:07.861254 dv-cinder-804470-6-iscsi neutron-server[94031]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=94031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 18 08:30:08.073189 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 52490) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:30:08.084292 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [-] 10.222.0.35 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0064430 Sep 18 08:30:19.625683 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-44dd98da-bc7b-43b8-ac26-453043a0bf5c None None] get_active_networks_info from dv-cinder-804470-6-iscsi {{(pid=94348) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Sep 18 08:30:19.761718 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44dd98da-bc7b-43b8-ac26-453043a0bf5c None None] No non-hosted networks {{(pid=94348) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Sep 18 08:30:19.779401 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.agentschedulers_db [None req-44dd98da-bc7b-43b8-ac26-453043a0bf5c None None] DHCP Agent not found on host dv-cinder-804470-6-iscsi {{(pid=94348) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Sep 18 08:30:19.929720 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-39e6eb54-a9a3-4e9f-9257-36e3be3ac6ec None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-784939'] for agent, after_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:22.379214 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-4f3c4ff0-90a4-455c-8c27-5b5036a17c9c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-784939'] for agent, after_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:22.431658 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-8e05b963-b158-43a7-b326-0faf159d2381 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:23.146394 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-784939'] for agent, after_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:23.147048 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:23.147392 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:23.147753 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:23.148107 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:23.148445 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:23.148845 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:23.149186 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:23.149600 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:23.149958 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:23.150287 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:23.150619 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:23.150947 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:23.151328 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-804470-6-iscsi', {'QosPolicy': '1.9', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:30:23.170891 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-804470-6-iscsi', 'version_map': {'QosPolicy': '1.9', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:30:23.317473 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-784939'] for agent, after_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:24.830730 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-784939'] for agent, after_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:25.854917 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 52584) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:30:25.861528 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.db.l3_hamode_db [None req-c7933670-921a-412d-b266-472e8ea57d96 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Sep 18 08:30:25.942785 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7933670-921a-412d-b266-472e8ea57d96 None None] Routers set() bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:30:25.943084 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7933670-921a-412d-b266-472e8ea57d96 None None] Router IDs set() for agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Sep 18 08:30:26.348372 dv-cinder-804470-6-iscsi neutron-server[94346]: WARNING oslo_policy.policy [None req-c9431ff0-8256-43fb-aade-2967d9171452 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 18 08:30:26.348953 dv-cinder-804470-6-iscsi neutron-server[94346]: WARNING oslo_policy.policy [None req-c9431ff0-8256-43fb-aade-2967d9171452 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 18 08:30:26.570049 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [None req-c9431ff0-8256-43fb-aade-2967d9171452 admin admin] http://10.222.0.35:9696/v2.0/extensions returned with HTTP 200 {{(pid=94346) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 18 08:30:26.571134 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-c9431ff0-8256-43fb-aade-2967d9171452 admin admin] 10.222.0.35 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.7153099 Sep 18 08:30:28.928411 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 52598) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:30:29.251788 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-11f9fb4e-7580-4818-8b7a-37c86660645d admin admin] Request body: {'subnetpool': {'prefixes': ['172.20.0.0/16'], 'shared': True, 'default_prefixlen': 26, 'name': 'shared-default-subnetpool-v4', 'is_default': True}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:30:29.345304 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.policy [None req-11f9fb4e-7580-4818-8b7a-37c86660645d admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=94346) register_rules /opt/stack/neutron/neutron/policy.py:73}} Sep 18 08:30:29.390493 dv-cinder-804470-6-iscsi neutron-server[94346]: WARNING oslo_policy.policy [None req-11f9fb4e-7580-4818-8b7a-37c86660645d admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 18 08:30:29.390809 dv-cinder-804470-6-iscsi neutron-server[94346]: WARNING oslo_policy.policy [None req-11f9fb4e-7580-4818-8b7a-37c86660645d admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 18 08:30:29.399256 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.quota [None req-11f9fb4e-7580-4818-8b7a-37c86660645d admin admin] Loaded quota_driver: . Sep 18 08:30:29.494614 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-11f9fb4e-7580-4818-8b7a-37c86660645d admin admin] Notify callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8732890515490', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8732890516209', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8732890536195', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8732890534631', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8732887991265', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8732890548041', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-1861457', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1945935', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-962563', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1038633'] for rbac-policy, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:29.565363 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-11f9fb4e-7580-4818-8b7a-37c86660645d admin admin] Notify callbacks [] for subnetpool, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:29.566585 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-11f9fb4e-7580-4818-8b7a-37c86660645d admin admin] 10.222.0.35 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.6371887 Sep 18 08:30:32.195757 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 52610) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:30:32.504370 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Request body: {'network': {'tenant_id': 'c12147c482a94ad7bf62cc2a0beff819', 'project_id': 'c12147c482a94ad7bf62cc2a0beff819', 'name': 'private', 'admin_state_up': True}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:30:32.534885 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Made reservation on behalf of c12147c482a94ad7bf62cc2a0beff819 for: {'network': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:30:32.537817 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for network, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:32.555283 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:32.682200 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:32.686466 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:32.706394 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 208} {{(pid=94346) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 18 08:30:32.729676 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8732885752724', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:32.730311 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Unsubscribe: segment precommit_create {{(pid=94346) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Sep 18 08:30:32.730819 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.db.segments_db [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Added segment ee65b9b2-f488-4bdf-858e-382dd828d10a of type vlan for network a126e1d8-d380-419d-94cd-f62ba5b930ea Sep 18 08:30:32.768666 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fc0df06a-2a2f-44f5-8fde-d5b44c931d65,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:30:32.812655 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:32.813023 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:32.813413 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:32.813752 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:32.814084 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:32.814440 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:32.814772 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:32.815100 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:32.815441 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:32.815769 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:32.816091 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:32.816410 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Tracked resource versions report: Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: pushed versions: Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: { 'AddressGroup': {'1.2'}, Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: 'ConntrackHelper': {'1.0'}, Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: 'Log': {'1.0'}, Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: 'Network': {'1.1'}, Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: 'Port': {'1.7'}, Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: 'PortForwarding': {'1.2'}, Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: 'QosPolicy': {'1.9'}, Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: 'SecurityGroup': {'1.4'}, Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: 'SecurityGroupRule': {'1.2'}, Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: 'SubPort': {'1.0'}, Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: 'Subnet': {'1.1'}, Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: 'Trunk': {'1.1'}} Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: consumer versions: Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: { DHCP agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: L3 agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: Metadata agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: Metering agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: Open vSwitch agent@dv-cinder-804470-6-iscsi: { 'AddressGroup': '1.2', Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: 'ConntrackHelper': '1.0', Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: 'Log': '1.0', Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: 'Network': '1.1', Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: 'Port': '1.7', Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: 'PortForwarding': '1.2', Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: 'QosPolicy': '1.9', Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: 'SecurityGroup': '1.4', Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: 'SecurityGroupRule': '1.2', Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: 'SubPort': '1.0', Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: 'Subnet': '1.1', Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: 'Trunk': '1.1'}} Sep 18 08:30:32.817522 dv-cinder-804470-6-iscsi neutron-server[94346]: {{(pid=94346) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 18 08:30:32.851847 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732885226527'] for network, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:32.901192 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for network, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:32.903435 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:30:32.904160 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:32.961169 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] 10.222.0.35 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.7642810 Sep 18 08:30:33.006899 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cb2f9ab-06c6-4e2d-b6e7-240603691357 admin admin] Pushing event updated for resources: {'Network': ['ID=a126e1d8-d380-419d-94cd-f62ba5b930ea,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:30:33.021457 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Network a126e1d8-d380-419d-94cd-f62ba5b930ea details requested by agent ovs-agent-dv-cinder-804470-6-iscsi with host dv-cinder-804470-6-iscsi {{(pid=94348) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 18 08:30:35.640555 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 52624) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:30:36.026204 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b975c4f2-f728-4970-8038-7844494b53ef admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:30:36.027587 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-b975c4f2-f728-4970-8038-7844494b53ef admin admin] 10.222.0.35 "GET /v2.0/networks/a126e1d8-d380-419d-94cd-f62ba5b930ea HTTP/1.1" status: 200 len: 825 time: 0.3860860 Sep 18 08:30:36.052338 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-92db70f2-eafb-4662-bd50-ccefecca4bd5 admin admin] 10.222.0.35 "GET /v2.0/subnetpools/8ad620d4-6330-4853-96af-eafc3ecd4f22 HTTP/1.1" status: 200 len: 734 time: 0.0186019 Sep 18 08:30:36.061858 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-6b02e708-1b1c-4d1b-92ec-386884a0c0c8 admin admin] Request body: {'subnet': {'name': 'private-subnet', 'gateway_ip': '172.20.0.1', 'tenant_id': 'c12147c482a94ad7bf62cc2a0beff819', 'ip_version': 4, 'subnetpool_id': '8ad620d4-6330-4853-96af-eafc3ecd4f22', 'network_id': 'a126e1d8-d380-419d-94cd-f62ba5b930ea'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:30:36.082778 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6b02e708-1b1c-4d1b-92ec-386884a0c0c8 admin admin] Made reservation on behalf of c12147c482a94ad7bf62cc2a0beff819 for: {'subnet': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:30:36.085490 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6b02e708-1b1c-4d1b-92ec-386884a0c0c8 admin admin] Notify callbacks [] for subnet, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:36.367618 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6b02e708-1b1c-4d1b-92ec-386884a0c0c8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for subnet, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:36.434657 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b02e708-1b1c-4d1b-92ec-386884a0c0c8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ddeb1412-631c-4a07-9b46-46e266f817fc,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:30:36.439101 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6b02e708-1b1c-4d1b-92ec-386884a0c0c8 admin admin] Checking segment: {'id': 'ee65b9b2-f488-4bdf-858e-382dd828d10a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 208, 'network_id': 'a126e1d8-d380-419d-94cd-f62ba5b930ea'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94346) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:30:36.439459 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b02e708-1b1c-4d1b-92ec-386884a0c0c8 admin admin] Network hostable DHCP agents. Network: a126e1d8-d380-419d-94cd-f62ba5b930ea, hostable agents: ['6aaa6222-6d04-44a7-b807-bfc2cbd3e99f'], hosted agents: [] {{(pid=94346) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 18 08:30:36.459590 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6b02e708-1b1c-4d1b-92ec-386884a0c0c8 admin admin] Network a126e1d8-d380-419d-94cd-f62ba5b930ea is scheduled to be hosted by DHCP agent 6aaa6222-6d04-44a7-b807-bfc2cbd3e99f with binding_index 1 {{(pid=94346) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 18 08:30:36.470064 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-6b02e708-1b1c-4d1b-92ec-386884a0c0c8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804470-6-iscsi, a126e1d8-d380-419d-94cd-f62ba5b930ea) {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:30:36.474567 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6b02e708-1b1c-4d1b-92ec-386884a0c0c8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:30:36.475166 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6b02e708-1b1c-4d1b-92ec-386884a0c0c8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for subnet, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:36.480649 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d3b4c58-e490-4a06-8ec8-76bd9ce4ab88 None None] Network a126e1d8-d380-419d-94cd-f62ba5b930ea requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:30:36.488689 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-6b02e708-1b1c-4d1b-92ec-386884a0c0c8 admin admin] 10.222.0.35 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.4306881 Sep 18 08:30:36.794553 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp22fa9bf9-2738-5c16-87a3-3f58ee5e2dc2-a126e1d8-d380-419d-94cd-f62ba5b930ea', 'network_id': 'a126e1d8-d380-419d-94cd-f62ba5b930ea', 'tenant_id': 'c12147c482a94ad7bf62cc2a0beff819', 'fixed_ips': [{'subnet_id': 'ddeb1412-631c-4a07-9b46-46e266f817fc'}]}} from dv-cinder-804470-6-iscsi. {{(pid=94348) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 18 08:30:36.795865 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:37.067585 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.db_base_plugin_common [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Allocated IP 172.20.0.2 (a126e1d8-d380-419d-94cd-f62ba5b930ea/ddeb1412-631c-4a07-9b46-46e266f817fc/e2b6d8cd-c990-49c1-9f17-08249efe4ccc) {{(pid=94348) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:30:37.266915 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Notify callbacks [] for port, precommit_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:37.274534 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528'] for port, after_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:37.385817 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Network a126e1d8-d380-419d-94cd-f62ba5b930ea is already hosted by enough agents. {{(pid=94348) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:30:37.386764 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Pushing event updated for resources: {'Port': ['ID=e2b6d8cd-c990-49c1-9f17-08249efe4ccc,revision_number=1']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:30:37.391417 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.scheduler.base_scheduler [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Resources bound (agent type, host, resource id): {{(pid=94348) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:30:37.398892 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:37.398892 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:37.398892 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:37.398892 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:37.399232 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:37.399304 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:37.399690 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:37.399946 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:37.400296 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:37.400693 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:37.401043 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:37.401344 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Tracked resource versions report: Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: pushed versions: Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: { 'AddressGroup': {'1.2'}, Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: 'ConntrackHelper': {'1.0'}, Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: 'Log': {'1.0'}, Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: 'Network': {'1.1'}, Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: 'Port': {'1.7'}, Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: 'PortForwarding': {'1.2'}, Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: 'QosPolicy': {'1.9'}, Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: 'SecurityGroup': {'1.4'}, Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: 'SecurityGroupRule': {'1.2'}, Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: 'SubPort': {'1.0'}, Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: 'Subnet': {'1.1'}, Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: 'Trunk': {'1.1'}} Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: consumer versions: Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: { DHCP agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: L3 agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: Metadata agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: Metering agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: Open vSwitch agent@dv-cinder-804470-6-iscsi: { 'AddressGroup': '1.2', Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: 'ConntrackHelper': '1.0', Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: 'Log': '1.0', Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: 'Network': '1.1', Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: 'Port': '1.7', Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: 'PortForwarding': '1.2', Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: 'QosPolicy': '1.9', Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: 'SecurityGroup': '1.4', Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: 'SecurityGroupRule': '1.2', Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: 'SubPort': '1.0', Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: 'Subnet': '1.1', Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: 'Trunk': '1.1'}} Sep 18 08:30:37.402450 dv-cinder-804470-6-iscsi neutron-server[94348]: {{(pid=94348) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 18 08:30:37.404536 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Received port after_create {{(pid=94348) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:30:37.487049 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Attempting to bind port e2b6d8cd-c990-49c1-9f17-08249efe4ccc on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:30:37.487682 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Attempting to bind port e2b6d8cd-c990-49c1-9f17-08249efe4ccc by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': 'ee65b9b2-f488-4bdf-858e-382dd828d10a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 208, 'network_id': 'a126e1d8-d380-419d-94cd-f62ba5b930ea'}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:30:37.487865 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Attempting to bind port e2b6d8cd-c990-49c1-9f17-08249efe4ccc on network a126e1d8-d380-419d-94cd-f62ba5b930ea {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:30:37.492754 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 30, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:30:37.493167 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Checking segment: {'id': 'ee65b9b2-f488-4bdf-858e-382dd828d10a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 208, 'network_id': 'a126e1d8-d380-419d-94cd-f62ba5b930ea'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94348) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:30:37.493674 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:37.494066 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Bound using segment: {'id': 'ee65b9b2-f488-4bdf-858e-382dd828d10a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 208, 'network_id': 'a126e1d8-d380-419d-94cd-f62ba5b930ea'} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:30:37.494575 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Bound port: e2b6d8cd-c990-49c1-9f17-08249efe4ccc, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ee65b9b2-f488-4bdf-858e-382dd828d10a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 208, 'network_id': 'a126e1d8-d380-419d-94cd-f62ba5b930ea'}}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:30:37.495003 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:37.559132 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] For port e2b6d8cd-c990-49c1-9f17-08249efe4ccc, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94348) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:30:37.564229 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] For port e2b6d8cd-c990-49c1-9f17-08249efe4ccc, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=e2b6d8cd-c990-49c1-9f17-08249efe4ccc,segment=NetworkSegment(ee65b9b2-f488-4bdf-858e-382dd828d10a),segment_id=ee65b9b2-f488-4bdf-858e-382dd828d10a)] {{(pid=94348) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:30:37.569394 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:37.635754 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92fa5c4d-694c-457a-af31-6ad7e8190051 None None] Pushing event updated for resources: {'Port': ['ID=e2b6d8cd-c990-49c1-9f17-08249efe4ccc,revision_number=2']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:30:38.910805 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 52632) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:30:39.221531 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [None req-9112c5bc-63c5-433d-8ff9-0260a97fb938 admin admin] http://10.222.0.35:9696/v2.0/extensions returned with HTTP 200 {{(pid=94346) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 18 08:30:39.222545 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-9112c5bc-63c5-433d-8ff9-0260a97fb938 admin admin] 10.222.0.35 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3107858 Sep 18 08:30:41.654933 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 52640) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:30:41.969726 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [None req-5d6c0ece-1e9f-44f5-a0bc-84fc779a48fb admin admin] http://10.222.0.35:9696/v2.0/extensions returned with HTTP 200 {{(pid=94346) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 18 08:30:41.970738 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-5d6c0ece-1e9f-44f5-a0bc-84fc779a48fb admin admin] 10.222.0.35 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3148525 Sep 18 08:30:44.617586 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 52650) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:30:44.926490 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-671959dd-9e08-4e19-b7be-566ae4d75220 admin admin] Request body: {'router': {'tenant_id': 'c12147c482a94ad7bf62cc2a0beff819', 'admin_state_up': True, 'name': 'router1'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:30:44.954566 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-671959dd-9e08-4e19-b7be-566ae4d75220 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-784001', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2995'] for router, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:44.956188 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-671959dd-9e08-4e19-b7be-566ae4d75220 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-782353', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-784513', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-710924', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2984'] for router, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:45.093446 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-671959dd-9e08-4e19-b7be-566ae4d75220 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:45.098317 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-671959dd-9e08-4e19-b7be-566ae4d75220 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-782366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-784982'] for router, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:45.110937 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-671959dd-9e08-4e19-b7be-566ae4d75220 admin admin] Notify callbacks [] for router, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:45.112141 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-671959dd-9e08-4e19-b7be-566ae4d75220 admin admin] 10.222.0.35 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.4935808 Sep 18 08:30:46.019112 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d40d98ab-7e49-4a58-bac9-35799d851be9 None None] Network a126e1d8-d380-419d-94cd-f62ba5b930ea requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:30:46.101007 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-212681bb-2aad-46d3-b88d-eddb3285b0ae None None] Provisioning complete for port e2b6d8cd-c990-49c1-9f17-08249efe4ccc triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:30:46.101432 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-212681bb-2aad-46d3-b88d-eddb3285b0ae None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:46.297017 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-212681bb-2aad-46d3-b88d-eddb3285b0ae None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:46.346779 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-212681bb-2aad-46d3-b88d-eddb3285b0ae None None] For port e2b6d8cd-c990-49c1-9f17-08249efe4ccc, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=e2b6d8cd-c990-49c1-9f17-08249efe4ccc,segment=NetworkSegment(ee65b9b2-f488-4bdf-858e-382dd828d10a),segment_id=ee65b9b2-f488-4bdf-858e-382dd828d10a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:30:46.351094 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-212681bb-2aad-46d3-b88d-eddb3285b0ae None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:46.405874 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-212681bb-2aad-46d3-b88d-eddb3285b0ae None None] Pushing event updated for resources: {'Port': ['ID=e2b6d8cd-c990-49c1-9f17-08249efe4ccc,revision_number=3']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:30:46.571733 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fd1b0a75-7045-4441-bb16-1ccc89a40088 None None] Provisioning complete for port e2b6d8cd-c990-49c1-9f17-08249efe4ccc triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:30:46.572120 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fd1b0a75-7045-4441-bb16-1ccc89a40088 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:46.636765 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device e2b6d8cd-c990-49c1-9f17-08249efe4ccc up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:30:46.696266 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port e2b6d8cd-c990-49c1-9f17-08249efe4ccc triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:30:46.696646 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:47.506855 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 52662) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:30:47.810607 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [None req-4c4d00e0-de99-40fc-b979-50af8b3b29e4 admin admin] http://10.222.0.35:9696/v2.0/extensions returned with HTTP 200 {{(pid=94346) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 18 08:30:47.811621 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-4c4d00e0-de99-40fc-b979-50af8b3b29e4 admin admin] 10.222.0.35 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.3038270 Sep 18 08:30:49.571334 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-970a6f23-93f3-45ad-b448-dcde0df6a0f3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:50.204341 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 52670) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:30:50.511557 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-a9bd279f-bc76-444d-982f-73673426d718 admin admin] Request body: {'network': {'name': 'public', 'provider:network_type': 'flat', 'admin_state_up': True, 'router:external': True, 'provider:physical_network': 'physnet1', 'is_default': True}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:30:50.531394 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a9bd279f-bc76-444d-982f-73673426d718 admin admin] Made reservation on behalf of a272f5e9604b4d9988c3e4ceb4a05e5a for: {'network': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:30:50.533696 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-a9bd279f-bc76-444d-982f-73673426d718 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for network, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:50.543330 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-a9bd279f-bc76-444d-982f-73673426d718 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:50.629139 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-a9bd279f-bc76-444d-982f-73673426d718 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:50.632845 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-a9bd279f-bc76-444d-982f-73673426d718 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:50.650458 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-a9bd279f-bc76-444d-982f-73673426d718 admin admin] Reserving flat network on physical network physnet1 {{(pid=94346) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Sep 18 08:30:50.666090 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9bd279f-bc76-444d-982f-73673426d718 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a07bcdae-b345-460e-a422-6e2b6afe9d24,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:30:50.672372 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-a9bd279f-bc76-444d-982f-73673426d718 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:50.672720 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.db.segments_db [None req-a9bd279f-bc76-444d-982f-73673426d718 admin admin] Added segment 0878b5b4-f4d3-4abd-a0e1-57da5a8e486c of type flat for network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 Sep 18 08:30:50.725913 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-a9bd279f-bc76-444d-982f-73673426d718 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732885226527'] for network, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:50.756227 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-a9bd279f-bc76-444d-982f-73673426d718 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for network, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:50.757165 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a9bd279f-bc76-444d-982f-73673426d718 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:30:50.757779 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-a9bd279f-bc76-444d-982f-73673426d718 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:50.786386 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-a9bd279f-bc76-444d-982f-73673426d718 admin admin] 10.222.0.35 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.5810342 Sep 18 08:30:50.820245 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9bd279f-bc76-444d-982f-73673426d718 admin admin] Pushing event updated for resources: {'Network': ['ID=2e3b3f85-63e4-4380-917a-8c90c80b3e38,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:30:50.830936 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 details requested by agent ovs-agent-dv-cinder-804470-6-iscsi with host dv-cinder-804470-6-iscsi {{(pid=94348) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 18 08:30:52.372520 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-17ccbcaf-ff2d-40f3-9612-1161faba02ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:53.146247 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:53.150052 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 52684) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:30:53.269421 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:53.420269 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-027b8504-bb30-4c71-845c-bb3290e8ab6d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:30:53.421592 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-027b8504-bb30-4c71-845c-bb3290e8ab6d admin admin] 10.222.0.35 "GET /v2.0/subnets/ddeb1412-631c-4a07-9b46-46e266f817fc HTTP/1.1" status: 200 len: 849 time: 0.2705975 Sep 18 08:30:53.537633 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-df05b92a-22a0-47f4-a5ca-302fcff4830c admin admin] 10.222.0.35 "GET /v2.0/routers/eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed HTTP/1.1" status: 200 len: 704 time: 0.1098289 Sep 18 08:30:53.793505 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ccb7593a-c315-4b95-8908-9fb559cbbb4c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:54.079386 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_common [None req-ccb7593a-c315-4b95-8908-9fb559cbbb4c admin admin] Allocated IP 172.20.0.1 (a126e1d8-d380-419d-94cd-f62ba5b930ea/ddeb1412-631c-4a07-9b46-46e266f817fc/5aacda4c-7472-4892-bde3-bc55b450336b) {{(pid=94346) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:30:54.271157 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ccb7593a-c315-4b95-8908-9fb559cbbb4c admin admin] Notify callbacks [] for port, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:54.334498 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ccb7593a-c315-4b95-8908-9fb559cbbb4c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528'] for port, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:54.401962 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ccb7593a-c315-4b95-8908-9fb559cbbb4c admin admin] Network a126e1d8-d380-419d-94cd-f62ba5b930ea is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:30:54.406494 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-ccb7593a-c315-4b95-8908-9fb559cbbb4c admin admin] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:30:54.409651 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ccb7593a-c315-4b95-8908-9fb559cbbb4c admin admin] Received port after_create {{(pid=94346) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:30:54.410169 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ccb7593a-c315-4b95-8908-9fb559cbbb4c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-785025'] for router_interface, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:54.487440 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccb7593a-c315-4b95-8908-9fb559cbbb4c admin admin] Pushing event updated for resources: {'Port': ['ID=5aacda4c-7472-4892-bde3-bc55b450336b,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:30:54.616100 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ccb7593a-c315-4b95-8908-9fb559cbbb4c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:54.639651 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-d8b2dd0d-d7f0-4574-81fa-bc9986c7ddf8 None None] Provisioning complete for port 5aacda4c-7472-4892-bde3-bc55b450336b triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:30:54.640182 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-d8b2dd0d-d7f0-4574-81fa-bc9986c7ddf8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:54.672656 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-d8b2dd0d-d7f0-4574-81fa-bc9986c7ddf8 None None] Port 5aacda4c-7472-4892-bde3-bc55b450336b cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:30:54.773610 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:54.820127 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ccb7593a-c315-4b95-8908-9fb559cbbb4c admin admin] Notify callbacks [] for port, precommit_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:54.825675 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ccb7593a-c315-4b95-8908-9fb559cbbb4c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:54.826738 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ccb7593a-c315-4b95-8908-9fb559cbbb4c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-580051', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-783377'] for router_interface, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:54.893720 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccb7593a-c315-4b95-8908-9fb559cbbb4c admin admin] Pushing event updated for resources: {'Port': ['ID=5aacda4c-7472-4892-bde3-bc55b450336b,revision_number=2']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:30:54.954187 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ccb7593a-c315-4b95-8908-9fb559cbbb4c admin admin] Network a126e1d8-d380-419d-94cd-f62ba5b930ea is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:30:54.955469 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-ccb7593a-c315-4b95-8908-9fb559cbbb4c admin admin] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:30:55.113277 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ccb7593a-c315-4b95-8908-9fb559cbbb4c admin admin] Router eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed is scheduled to L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a with binding_index 1 {{(pid=94346) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 18 08:30:55.193338 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-7cdd4ec4-f3f9-468a-93d2-f6dee27115b7 None None] Provisioning complete for port 5aacda4c-7472-4892-bde3-bc55b450336b triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:30:55.193735 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-7cdd4ec4-f3f9-468a-93d2-f6dee27115b7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:55.204092 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ccb7593a-c315-4b95-8908-9fb559cbbb4c admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94346) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:30:55.221630 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-ccb7593a-c315-4b95-8908-9fb559cbbb4c admin admin] 10.222.0.35 "PUT /v2.0/routers/eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.6675441 Sep 18 08:30:55.221738 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] Sync routers for ids ['eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed'] in dv-cinder-804470-6-iscsi {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:30:55.232636 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] Routers {'eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:30:55.232636 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:30:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:30:55.233063 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-7cdd4ec4-f3f9-468a-93d2-f6dee27115b7 None None] Port 5aacda4c-7472-4892-bde3-bc55b450336b cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:30:55.419077 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] Set router eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed gateway port host: None {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:30:55.847567 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed', 'name': 'router1', 'tenant_id': 'c12147c482a94ad7bf62cc2a0beff819', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:30:44Z', 'updated_at': '2021-09-18T08:30:54Z', 'revision_number': 2, 'project_id': 'c12147c482a94ad7bf62cc2a0beff819', 'gw_port_host': None, '_interfaces': [{'id': '5aacda4c-7472-4892-bde3-bc55b450336b', 'name': '', 'network_id': 'a126e1d8-d380-419d-94cd-f62ba5b930ea', 'tenant_id': 'c12147c482a94ad7bf62cc2a0beff819', 'mac_address': 'fa:16:3e:87:5c:fe', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'ddeb1412-631c-4a07-9b46-46e266f817fc', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:30:53Z', 'updated_at': '2021-09-18T08:30:54Z', 'revision_number': 2, 'project_id': 'c12147c482a94ad7bf62cc2a0beff819', 'subnets': [{'id': 'ddeb1412-631c-4a07-9b46-46e266f817fc', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '8ad620d4-6330-4853-96af-eafc3ecd4f22'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:30:55.898809 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] Checking router: eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed for host: dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:30:55.899187 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] Updating router eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed port 5aacda4c-7472-4892-bde3-bc55b450336b binding host dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 18 08:30:55.946072 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:56.454668 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] Notify callbacks [] for port, precommit_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:56.463604 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:56.626813 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a16ceabc-e1a1-4fb4-8f94-9d6c22807940 None None] Pushing event updated for resources: {'Port': ['ID=5aacda4c-7472-4892-bde3-bc55b450336b,revision_number=3']} {{(pid=94349) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:30:56.639121 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a16ceabc-e1a1-4fb4-8f94-9d6c22807940 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:56.639479 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a16ceabc-e1a1-4fb4-8f94-9d6c22807940 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:56.639823 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a16ceabc-e1a1-4fb4-8f94-9d6c22807940 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:56.640166 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a16ceabc-e1a1-4fb4-8f94-9d6c22807940 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:56.640501 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a16ceabc-e1a1-4fb4-8f94-9d6c22807940 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:56.640834 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a16ceabc-e1a1-4fb4-8f94-9d6c22807940 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:56.641163 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a16ceabc-e1a1-4fb4-8f94-9d6c22807940 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:56.641516 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a16ceabc-e1a1-4fb4-8f94-9d6c22807940 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:56.642715 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a16ceabc-e1a1-4fb4-8f94-9d6c22807940 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:56.643063 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a16ceabc-e1a1-4fb4-8f94-9d6c22807940 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:56.643743 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a16ceabc-e1a1-4fb4-8f94-9d6c22807940 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:56.644077 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a16ceabc-e1a1-4fb4-8f94-9d6c22807940 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a16ceabc-e1a1-4fb4-8f94-9d6c22807940 None None] Tracked resource versions report: Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: pushed versions: Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: { 'AddressGroup': {'1.2'}, Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: 'ConntrackHelper': {'1.0'}, Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: 'Log': {'1.0'}, Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: 'Network': {'1.1'}, Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: 'Port': {'1.7'}, Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: 'PortForwarding': {'1.2'}, Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: 'QosPolicy': {'1.9'}, Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: 'SecurityGroup': {'1.4'}, Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: 'SecurityGroupRule': {'1.2'}, Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: 'SubPort': {'1.0'}, Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: 'Subnet': {'1.1'}, Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: 'Trunk': {'1.1'}} Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: consumer versions: Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: { DHCP agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: L3 agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: Metadata agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: Metering agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: Open vSwitch agent@dv-cinder-804470-6-iscsi: { 'AddressGroup': '1.2', Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: 'ConntrackHelper': '1.0', Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: 'Log': '1.0', Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: 'Network': '1.1', Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: 'Port': '1.7', Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: 'PortForwarding': '1.2', Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: 'QosPolicy': '1.9', Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: 'SecurityGroup': '1.4', Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: 'SecurityGroupRule': '1.2', Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: 'SubPort': '1.0', Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: 'Subnet': '1.1', Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: 'Trunk': '1.1'}} Sep 18 08:30:56.645149 dv-cinder-804470-6-iscsi neutron-server[94349]: {{(pid=94349) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 18 08:30:56.650617 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] Attempting to bind port 5aacda4c-7472-4892-bde3-bc55b450336b on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:30:56.651015 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] Attempting to bind port 5aacda4c-7472-4892-bde3-bc55b450336b by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': 'ee65b9b2-f488-4bdf-858e-382dd828d10a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 208, 'network_id': 'a126e1d8-d380-419d-94cd-f62ba5b930ea'}] {{(pid=94349) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:30:56.651519 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] Attempting to bind port 5aacda4c-7472-4892-bde3-bc55b450336b on network a126e1d8-d380-419d-94cd-f62ba5b930ea {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:30:56.654526 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-6efd3bba-30e0-43ad-b1f7-40ec73887ce7 None None] Provisioning complete for port 5aacda4c-7472-4892-bde3-bc55b450336b triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:30:56.655522 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-6efd3bba-30e0-43ad-b1f7-40ec73887ce7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:56.656730 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 30, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:30:56.657147 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] Checking segment: {'id': 'ee65b9b2-f488-4bdf-858e-382dd828d10a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 208, 'network_id': 'a126e1d8-d380-419d-94cd-f62ba5b930ea'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94349) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:30:56.657650 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:56.658041 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] Bound using segment: {'id': 'ee65b9b2-f488-4bdf-858e-382dd828d10a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 208, 'network_id': 'a126e1d8-d380-419d-94cd-f62ba5b930ea'} {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:30:56.658541 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] Bound port: 5aacda4c-7472-4892-bde3-bc55b450336b, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ee65b9b2-f488-4bdf-858e-382dd828d10a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 208, 'network_id': 'a126e1d8-d380-419d-94cd-f62ba5b930ea'}}] {{(pid=94349) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:30:56.658941 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:56.691099 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-6efd3bba-30e0-43ad-b1f7-40ec73887ce7 None None] Port 5aacda4c-7472-4892-bde3-bc55b450336b cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:30:56.725763 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.db [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] For port 5aacda4c-7472-4892-bde3-bc55b450336b, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94349) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:30:56.744080 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.db [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] For port 5aacda4c-7472-4892-bde3-bc55b450336b, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=5aacda4c-7472-4892-bde3-bc55b450336b,segment=NetworkSegment(ee65b9b2-f488-4bdf-858e-382dd828d10a),segment_id=ee65b9b2-f488-4bdf-858e-382dd828d10a)] {{(pid=94349) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:30:56.749074 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:56.813069 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a16ceabc-e1a1-4fb4-8f94-9d6c22807940 None None] Pushing event updated for resources: {'Port': ['ID=5aacda4c-7472-4892-bde3-bc55b450336b,revision_number=4']} {{(pid=94349) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:30:56.815969 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] Routers {'eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:30:56.816577 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:30:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:30:56.909814 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] Set router eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed gateway port host: None {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:30:57.015485 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-001a784e-8032-4d62-b7dd-3601c6c239dc None None] Provisioning complete for port 5aacda4c-7472-4892-bde3-bc55b450336b triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:30:57.015984 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-001a784e-8032-4d62-b7dd-3601c6c239dc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:57.088263 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-001a784e-8032-4d62-b7dd-3601c6c239dc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:57.123147 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed', 'name': 'router1', 'tenant_id': 'c12147c482a94ad7bf62cc2a0beff819', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:30:44Z', 'updated_at': '2021-09-18T08:30:54Z', 'revision_number': 2, 'project_id': 'c12147c482a94ad7bf62cc2a0beff819', 'gw_port_host': None, '_interfaces': [{'id': '5aacda4c-7472-4892-bde3-bc55b450336b', 'name': '', 'network_id': 'a126e1d8-d380-419d-94cd-f62ba5b930ea', 'tenant_id': 'c12147c482a94ad7bf62cc2a0beff819', 'mac_address': 'fa:16:3e:87:5c:fe', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'ddeb1412-631c-4a07-9b46-46e266f817fc', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:30:53Z', 'updated_at': '2021-09-18T08:30:56Z', 'revision_number': 4, 'project_id': 'c12147c482a94ad7bf62cc2a0beff819', 'subnets': [{'id': 'ddeb1412-631c-4a07-9b46-46e266f817fc', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '8ad620d4-6330-4853-96af-eafc3ecd4f22'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:30:57.131993 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-001a784e-8032-4d62-b7dd-3601c6c239dc None None] For port 5aacda4c-7472-4892-bde3-bc55b450336b, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=5aacda4c-7472-4892-bde3-bc55b450336b,segment=NetworkSegment(ee65b9b2-f488-4bdf-858e-382dd828d10a),segment_id=ee65b9b2-f488-4bdf-858e-382dd828d10a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:30:57.137810 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-001a784e-8032-4d62-b7dd-3601c6c239dc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:57.151410 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9625a446-bc6f-4e46-ace9-d8d5a27ea11d None None] The sync data for ids ['eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed'] in dv-cinder-804470-6-iscsi is: [{'id': 'eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed', 'name': 'router1', 'tenant_id': 'c12147c482a94ad7bf62cc2a0beff819', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:30:44Z', 'updated_at': '2021-09-18T08:30:54Z', 'revision_number': 2, 'project_id': 'c12147c482a94ad7bf62cc2a0beff819', 'gw_port_host': None, '_interfaces': [{'id': '5aacda4c-7472-4892-bde3-bc55b450336b', 'name': '', 'network_id': 'a126e1d8-d380-419d-94cd-f62ba5b930ea', 'tenant_id': 'c12147c482a94ad7bf62cc2a0beff819', 'mac_address': 'fa:16:3e:87:5c:fe', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'ddeb1412-631c-4a07-9b46-46e266f817fc', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:30:53Z', 'updated_at': '2021-09-18T08:30:56Z', 'revision_number': 4, 'project_id': 'c12147c482a94ad7bf62cc2a0beff819', 'subnets': [{'id': 'ddeb1412-631c-4a07-9b46-46e266f817fc', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '8ad620d4-6330-4853-96af-eafc3ecd4f22'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:30:57.198264 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-001a784e-8032-4d62-b7dd-3601c6c239dc None None] Pushing event updated for resources: {'Port': ['ID=5aacda4c-7472-4892-bde3-bc55b450336b,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:30:57.497192 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 52704) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:30:57.605801 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4dd8372c-a71f-45d8-9861-54ac1b3f3688 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:30:57.613091 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-4dd8372c-a71f-45d8-9861-54ac1b3f3688 admin admin] 10.222.0.35 "GET /v2.0/networks/2e3b3f85-63e4-4380-917a-8c90c80b3e38 HTTP/1.1" status: 200 len: 842 time: 0.1089315 Sep 18 08:30:57.617235 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-cdb667f0-7270-4dcf-b837-5542be0ae263 admin admin] Request body: {'subnet': {'cidr': '172.27.1.0/24', 'enable_dhcp': False, 'ip_version': 4, 'name': 'public-subnet', 'gateway_ip': '172.27.1.1', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:30:57.638220 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cdb667f0-7270-4dcf-b837-5542be0ae263 admin admin] Made reservation on behalf of a272f5e9604b4d9988c3e4ceb4a05e5a for: {'subnet': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:30:57.640506 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-cdb667f0-7270-4dcf-b837-5542be0ae263 admin admin] Notify callbacks [] for subnet, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:57.983625 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.objects.ports [None req-cdb667f0-7270-4dcf-b837-5542be0ae263 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=94346) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Sep 18 08:30:57.983972 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-cdb667f0-7270-4dcf-b837-5542be0ae263 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for subnet, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:58.044092 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdb667f0-7270-4dcf-b837-5542be0ae263 admin admin] Pushing event updated for resources: {'Subnet': ['ID=cd525bb9-7f93-490c-a5d6-a08911817e54,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:30:58.054672 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cdb667f0-7270-4dcf-b837-5542be0ae263 admin admin] Checking segment: {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94346) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:30:58.055034 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cdb667f0-7270-4dcf-b837-5542be0ae263 admin admin] Network hostable DHCP agents. Network: 2e3b3f85-63e4-4380-917a-8c90c80b3e38, hostable agents: ['6aaa6222-6d04-44a7-b807-bfc2cbd3e99f'], hosted agents: [] {{(pid=94346) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 18 08:30:58.072642 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cdb667f0-7270-4dcf-b837-5542be0ae263 admin admin] Network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 is scheduled to be hosted by DHCP agent 6aaa6222-6d04-44a7-b807-bfc2cbd3e99f with binding_index 1 {{(pid=94346) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 18 08:30:58.082410 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-cdb667f0-7270-4dcf-b837-5542be0ae263 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804470-6-iscsi, 2e3b3f85-63e4-4380-917a-8c90c80b3e38) {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:30:58.086785 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cdb667f0-7270-4dcf-b837-5542be0ae263 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:30:58.087328 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-cdb667f0-7270-4dcf-b837-5542be0ae263 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for subnet, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:30:58.092478 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b83607f6-f683-4176-b706-f1cbd5717da4 None None] Network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:30:58.102598 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-cdb667f0-7270-4dcf-b837-5542be0ae263 admin admin] 10.222.0.35 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4884412 Sep 18 08:30:58.225107 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00d879ef-0563-4ffb-ae96-1bcc6c1e7101 None None] Network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:31:00.391397 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 52716) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:31:00.533257 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-05e25ab3-ab1c-4f97-9366-96c2e86cc3cd admin admin] 10.222.0.35 "GET /v2.0/routers/eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed HTTP/1.1" status: 200 len: 710 time: 0.1390607 Sep 18 08:31:00.618013 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fa97a11e-cc11-49fb-9fb0-d4fc322672c3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:31:00.625473 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-fa97a11e-cc11-49fb-9fb0-d4fc322672c3 admin admin] 10.222.0.35 "GET /v2.0/networks/2e3b3f85-63e4-4380-917a-8c90c80b3e38 HTTP/1.1" status: 200 len: 886 time: 0.0805049 Sep 18 08:31:00.629298 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-6c086a52-6a15-4e69-86c0-0ec183919fd8 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:31:00.876196 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6c086a52-6a15-4e69-86c0-0ec183919fd8 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:01.106146 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6c086a52-6a15-4e69-86c0-0ec183919fd8 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:01.178007 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6c086a52-6a15-4e69-86c0-0ec183919fd8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:01.280645 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_common [None req-6c086a52-6a15-4e69-86c0-0ec183919fd8 admin admin] Allocated IP 172.27.1.128 (2e3b3f85-63e4-4380-917a-8c90c80b3e38/cd525bb9-7f93-490c-a5d6-a08911817e54/b126be72-922a-4ee0-a0b8-e4593c051606) {{(pid=94346) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:31:01.381463 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6c086a52-6a15-4e69-86c0-0ec183919fd8 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:01.415085 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6c086a52-6a15-4e69-86c0-0ec183919fd8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528'] for port, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:01.452061 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6c086a52-6a15-4e69-86c0-0ec183919fd8 admin admin] Network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:31:01.454694 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-6c086a52-6a15-4e69-86c0-0ec183919fd8 admin admin] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:31:01.459981 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c086a52-6a15-4e69-86c0-0ec183919fd8 admin admin] Received port after_create {{(pid=94346) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:31:01.493204 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c086a52-6a15-4e69-86c0-0ec183919fd8 admin admin] Pushing event updated for resources: {'Port': ['ID=b126be72-922a-4ee0-a0b8-e4593c051606,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:31:01.791059 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6c086a52-6a15-4e69-86c0-0ec183919fd8 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:01.978292 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6c086a52-6a15-4e69-86c0-0ec183919fd8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-784567', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-782343', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-2966'] for router, precommit_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:01.981640 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6c086a52-6a15-4e69-86c0-0ec183919fd8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-784982', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-784572', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-784549', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-782348'] for router, after_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:02.086043 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6c086a52-6a15-4e69-86c0-0ec183919fd8 admin admin] Router eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94346) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:31:02.202649 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6c086a52-6a15-4e69-86c0-0ec183919fd8 admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94346) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:31:02.207201 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6c086a52-6a15-4e69-86c0-0ec183919fd8 admin admin] Notify callbacks [] for router, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:02.209197 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-6c086a52-6a15-4e69-86c0-0ec183919fd8 admin admin] 10.222.0.35 "PUT /v2.0/routers/eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed HTTP/1.1" status: 200 len: 890 time: 1.5830619 Sep 18 08:31:02.648885 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 5aacda4c-7472-4892-bde3-bc55b450336b up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:31:02.699522 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 5aacda4c-7472-4892-bde3-bc55b450336b triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:31:02.699904 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:03.532458 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] Sync routers for ids ['eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed'] in dv-cinder-804470-6-iscsi {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:31:03.544409 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] Routers {'eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:31:03.545075 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:30:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:31:03.750497 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] Set router eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:31:04.136559 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed', 'name': 'router1', 'tenant_id': 'c12147c482a94ad7bf62cc2a0beff819', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.128'}], 'enable_snat': True}, 'gw_port_id': 'b126be72-922a-4ee0-a0b8-e4593c051606', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:30:44Z', 'updated_at': '2021-09-18T08:31:01Z', 'revision_number': 4, 'project_id': 'c12147c482a94ad7bf62cc2a0beff819', 'gw_port': {'id': 'b126be72-922a-4ee0-a0b8-e4593c051606', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:7f:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:31:01Z', 'updated_at': '2021-09-18T08:31:01Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '5aacda4c-7472-4892-bde3-bc55b450336b', 'name': '', 'network_id': 'a126e1d8-d380-419d-94cd-f62ba5b930ea', 'tenant_id': 'c12147c482a94ad7bf62cc2a0beff819', 'mac_address': 'fa:16:3e:87:5c:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'ddeb1412-631c-4a07-9b46-46e266f817fc', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:30:53Z', 'updated_at': '2021-09-18T08:30:57Z', 'revision_number': 5, 'project_id': 'c12147c482a94ad7bf62cc2a0beff819', 'subnets': [{'id': 'ddeb1412-631c-4a07-9b46-46e266f817fc', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '8ad620d4-6330-4853-96af-eafc3ecd4f22'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:31:04.187505 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] Checking router: eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed for host: dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:31:04.187855 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] Updating router eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed port b126be72-922a-4ee0-a0b8-e4593c051606 binding host dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 18 08:31:04.233561 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:04.554254 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] Notify callbacks [] for port, precommit_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:04.559535 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:04.612642 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] Attempting to bind port b126be72-922a-4ee0-a0b8-e4593c051606 on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:31:04.613018 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] Attempting to bind port b126be72-922a-4ee0-a0b8-e4593c051606 by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:31:04.613407 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] Attempting to bind port b126be72-922a-4ee0-a0b8-e4593c051606 on network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:31:04.616462 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2a72c3f-27d5-490e-828f-049ee4179d68 None None] Pushing event updated for resources: {'Port': ['ID=b126be72-922a-4ee0-a0b8-e4593c051606,revision_number=2']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:31:04.622236 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 30, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:31:04.622611 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] Checking segment: {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94348) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:31:04.623013 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:04.623399 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] Bound using segment: {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:31:04.623863 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] Bound port: b126be72-922a-4ee0-a0b8-e4593c051606, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:31:04.624259 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:04.652790 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 52728) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:31:04.675132 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] For port b126be72-922a-4ee0-a0b8-e4593c051606, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94348) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:31:04.677974 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] For port b126be72-922a-4ee0-a0b8-e4593c051606, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=b126be72-922a-4ee0-a0b8-e4593c051606,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94348) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:31:04.683362 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:04.742437 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2a72c3f-27d5-490e-828f-049ee4179d68 None None] Pushing event updated for resources: {'Port': ['ID=b126be72-922a-4ee0-a0b8-e4593c051606,revision_number=3']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:31:04.745546 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] Routers {'eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:31:04.746234 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:30:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:31:04.803604 dv-cinder-804470-6-iscsi neutron-server[94347]: WARNING oslo_policy.policy [None req-f433fcc1-deba-4b7b-9450-fb58fc3c3fea admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 18 08:31:04.804245 dv-cinder-804470-6-iscsi neutron-server[94347]: WARNING oslo_policy.policy [None req-f433fcc1-deba-4b7b-9450-fb58fc3c3fea admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 18 08:31:04.919023 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] Set router eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:31:05.131055 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed', 'name': 'router1', 'tenant_id': 'c12147c482a94ad7bf62cc2a0beff819', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.128'}], 'enable_snat': True}, 'gw_port_id': 'b126be72-922a-4ee0-a0b8-e4593c051606', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:30:44Z', 'updated_at': '2021-09-18T08:31:01Z', 'revision_number': 4, 'project_id': 'c12147c482a94ad7bf62cc2a0beff819', 'gw_port': {'id': 'b126be72-922a-4ee0-a0b8-e4593c051606', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:7f:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:31:01Z', 'updated_at': '2021-09-18T08:31:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '5aacda4c-7472-4892-bde3-bc55b450336b', 'name': '', 'network_id': 'a126e1d8-d380-419d-94cd-f62ba5b930ea', 'tenant_id': 'c12147c482a94ad7bf62cc2a0beff819', 'mac_address': 'fa:16:3e:87:5c:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'ddeb1412-631c-4a07-9b46-46e266f817fc', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:30:53Z', 'updated_at': '2021-09-18T08:30:57Z', 'revision_number': 5, 'project_id': 'c12147c482a94ad7bf62cc2a0beff819', 'subnets': [{'id': 'ddeb1412-631c-4a07-9b46-46e266f817fc', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '8ad620d4-6330-4853-96af-eafc3ecd4f22'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:31:05.160693 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-da4fe166-92f0-4942-9fe3-d2575d530e7e None None] The sync data for ids ['eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed'] in dv-cinder-804470-6-iscsi is: [{'id': 'eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed', 'name': 'router1', 'tenant_id': 'c12147c482a94ad7bf62cc2a0beff819', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.128'}], 'enable_snat': True}, 'gw_port_id': 'b126be72-922a-4ee0-a0b8-e4593c051606', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:30:44Z', 'updated_at': '2021-09-18T08:31:01Z', 'revision_number': 4, 'project_id': 'c12147c482a94ad7bf62cc2a0beff819', 'gw_port': {'id': 'b126be72-922a-4ee0-a0b8-e4593c051606', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:4d:7f:0e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.128', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:31:01Z', 'updated_at': '2021-09-18T08:31:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '5aacda4c-7472-4892-bde3-bc55b450336b', 'name': '', 'network_id': 'a126e1d8-d380-419d-94cd-f62ba5b930ea', 'tenant_id': 'c12147c482a94ad7bf62cc2a0beff819', 'mac_address': 'fa:16:3e:87:5c:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'eedb1fcd-9d02-4e1c-8ae4-7b23271a88ed', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': 'ddeb1412-631c-4a07-9b46-46e266f817fc', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:30:53Z', 'updated_at': '2021-09-18T08:30:57Z', 'revision_number': 5, 'project_id': 'c12147c482a94ad7bf62cc2a0beff819', 'subnets': [{'id': 'ddeb1412-631c-4a07-9b46-46e266f817fc', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '8ad620d4-6330-4853-96af-eafc3ecd4f22'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:31:05.208180 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.policy [None req-f433fcc1-deba-4b7b-9450-fb58fc3c3fea admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=94347) register_rules /opt/stack/neutron/neutron/policy.py:73}} Sep 18 08:31:05.268184 dv-cinder-804470-6-iscsi neutron-server[94347]: WARNING oslo_policy.policy [None req-f433fcc1-deba-4b7b-9450-fb58fc3c3fea admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 18 08:31:05.268582 dv-cinder-804470-6-iscsi neutron-server[94347]: WARNING oslo_policy.policy [None req-f433fcc1-deba-4b7b-9450-fb58fc3c3fea admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Sep 18 08:31:05.279466 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-f433fcc1-deba-4b7b-9450-fb58fc3c3fea admin admin] 10.222.0.35 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 411 time: 0.6245089 Sep 18 08:31:06.663142 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device b126be72-922a-4ee0-a0b8-e4593c051606 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:31:06.708355 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port b126be72-922a-4ee0-a0b8-e4593c051606 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:31:06.708732 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:06.782029 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:06.800921 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-536c997d-2873-442a-81bf-9fe918803742 None None] For port b126be72-922a-4ee0-a0b8-e4593c051606, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=b126be72-922a-4ee0-a0b8-e4593c051606,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:31:06.804496 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:06.856140 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Pushing event updated for resources: {'Port': ['ID=b126be72-922a-4ee0-a0b8-e4593c051606,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:31:08.654382 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device b126be72-922a-4ee0-a0b8-e4593c051606 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:31:08.705853 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port b126be72-922a-4ee0-a0b8-e4593c051606 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:31:08.707391 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:18.716053 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 5 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:31:19.573842 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-cf4dc313-2b71-499a-946d-fa7074e39df8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:22.378264 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-b3e6c8d0-a13a-4a32-834d-387cd993975a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:23.153063 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:23.280312 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:24.794520 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:49.578385 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fb0821c6-1622-44ba-9280-5f35c1e3670e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:52.372765 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-84bdbfa2-1882-442c-b20b-ad56c9776d11 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:53.156361 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:53.277423 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:54.803873 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:31:55.715595 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 5 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:32:19.581364 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-b19dbbb3-cfc1-446b-9776-484c0940d62a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:32:22.374691 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-1cb2be4e-ee37-4fa5-95ff-98d44db07503 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:32:23.160591 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:32:23.279121 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:32:24.803819 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:32:32.715059 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 5 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:32:40.820149 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 53298) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:32:40.879920 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.pecan_wsgi.hooks.translation [None req-6dd8b499-c36f-460a-aefc-39d9ec010ca2 admin admin] GET failed (client error): The resource could not be found. Sep 18 08:32:40.881302 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-6dd8b499-c36f-460a-aefc-39d9ec010ca2 admin admin] 10.222.0.35 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0595973 Sep 18 08:32:41.038197 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9fa46a45-473d-45ee-88a4-0833007aef08 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:32:41.039688 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-9fa46a45-473d-45ee-88a4-0833007aef08 admin admin] 10.222.0.35 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1533151 Sep 18 08:32:43.203088 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 53308) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:32:43.294115 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-634cf72e-052d-4a54-9e14-57462c2721f6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:32:43.295387 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-634cf72e-052d-4a54-9e14-57462c2721f6 admin admin] 10.222.0.35 "GET /v2.0/subnets/ddeb1412-631c-4a07-9b46-46e266f817fc HTTP/1.1" status: 200 len: 849 time: 0.0913503 Sep 18 08:32:43.305373 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-28cd8d1c-3375-407d-856a-3bc2d689264c admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:32:43.386282 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-28cd8d1c-3375-407d-856a-3bc2d689264c admin admin] Notify callbacks [] for subnet, before_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:32:43.529372 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-28cd8d1c-3375-407d-856a-3bc2d689264c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8732885775364'] for subnet, after_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:32:43.569874 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5925fd17-5f3f-413b-871e-87e4236eb5b2 None None] Network a126e1d8-d380-419d-94cd-f62ba5b930ea requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:32:43.575418 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28cd8d1c-3375-407d-856a-3bc2d689264c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:32:43.576030 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-28cd8d1c-3375-407d-856a-3bc2d689264c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for subnet, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:32:43.577377 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-28cd8d1c-3375-407d-856a-3bc2d689264c admin admin] 10.222.0.35 "PUT /v2.0/subnets/ddeb1412-631c-4a07-9b46-46e266f817fc HTTP/1.1" status: 200 len: 868 time: 0.2755959 Sep 18 08:32:43.580259 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28cd8d1c-3375-407d-856a-3bc2d689264c admin admin] Pushing event updated for resources: {'Subnet': ['ID=ddeb1412-631c-4a07-9b46-46e266f817fc,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:32:43.587847 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28cd8d1c-3375-407d-856a-3bc2d689264c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:32:43.588234 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28cd8d1c-3375-407d-856a-3bc2d689264c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:32:43.588604 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28cd8d1c-3375-407d-856a-3bc2d689264c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:32:43.588941 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28cd8d1c-3375-407d-856a-3bc2d689264c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:32:43.589428 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28cd8d1c-3375-407d-856a-3bc2d689264c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:32:43.589682 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28cd8d1c-3375-407d-856a-3bc2d689264c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:32:43.590025 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28cd8d1c-3375-407d-856a-3bc2d689264c admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:32:43.590364 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28cd8d1c-3375-407d-856a-3bc2d689264c admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:32:43.590969 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28cd8d1c-3375-407d-856a-3bc2d689264c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:32:43.591314 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28cd8d1c-3375-407d-856a-3bc2d689264c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:32:43.591646 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28cd8d1c-3375-407d-856a-3bc2d689264c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:32:43.591979 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28cd8d1c-3375-407d-856a-3bc2d689264c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:32:43.958423 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-df081400-cd8a-4094-a66a-677cca30b5f2 None None] Provisioning complete for port e2b6d8cd-c990-49c1-9f17-08249efe4ccc triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:32:43.958803 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-df081400-cd8a-4094-a66a-677cca30b5f2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:32:44.048191 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-df081400-cd8a-4094-a66a-677cca30b5f2 None None] Provisioning complete for port 5aacda4c-7472-4892-bde3-bc55b450336b triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:32:44.048500 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-df081400-cd8a-4094-a66a-677cca30b5f2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:32:45.753095 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 53316) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:32:45.953800 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8412244a-0c63-4144-bf1b-bff048b63caf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:32:45.954197 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8412244a-0c63-4144-bf1b-bff048b63caf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:32:45.955778 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-8412244a-0c63-4144-bf1b-bff048b63caf admin admin] 10.222.0.35 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2016945 Sep 18 08:32:48.150211 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 53324) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:32:48.389416 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e69037bf-9dd7-48e5-8120-8ce2261c9d85 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:32:48.389895 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e69037bf-9dd7-48e5-8120-8ce2261c9d85 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:32:48.391445 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-e69037bf-9dd7-48e5-8120-8ce2261c9d85 admin admin] 10.222.0.35 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2402685 Sep 18 08:32:49.581382 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-f4bcd7ef-8de8-4187-9015-4536f7417b2e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:32:50.560572 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 53334) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:32:50.738772 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9980140f-dcf8-4417-8a70-34e322c7c5a1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:32:50.740116 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-9980140f-dcf8-4417-8a70-34e322c7c5a1 admin admin] 10.222.0.35 "GET /v2.0/networks/2e3b3f85-63e4-4380-917a-8c90c80b3e38 HTTP/1.1" status: 200 len: 886 time: 0.1786182 Sep 18 08:32:52.375217 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-3d8b27b5-5387-407c-bc38-f027da0adf28 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:32:52.922592 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 53342) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:32:53.065514 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-46fb75ec-6c62-48f9-b906-25ae6f6253e8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:32:53.066912 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-46fb75ec-6c62-48f9-b906-25ae6f6253e8 admin admin] 10.222.0.35 "GET /v2.0/networks/a126e1d8-d380-419d-94cd-f62ba5b930ea HTTP/1.1" status: 200 len: 869 time: 0.1434350 Sep 18 08:32:53.164062 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:32:53.281200 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:32:54.814099 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:32:55.240307 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 53350) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:32:55.364099 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c469dce7-c50f-4557-aa1f-42e428abc63f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:32:55.364563 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c469dce7-c50f-4557-aa1f-42e428abc63f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:32:55.366104 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-c469dce7-c50f-4557-aa1f-42e428abc63f admin admin] 10.222.0.35 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1248314 Sep 18 08:32:57.535826 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 53358) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:32:57.624426 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b97d01f5-b720-4158-8594-e64573517a6f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:32:57.624889 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b97d01f5-b720-4158-8594-e64573517a6f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:32:57.626417 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-b97d01f5-b720-4158-8594-e64573517a6f admin admin] 10.222.0.35 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.0896552 Sep 18 08:32:59.794723 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 53366) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:32:59.925028 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dad5556f-cc33-44fe-80a3-554f97c3b10a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:32:59.926428 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-dad5556f-cc33-44fe-80a3-554f97c3b10a admin admin] 10.222.0.35 "GET /v2.0/subnets/cd525bb9-7f93-490c-a5d6-a08911817e54 HTTP/1.1" status: 200 len: 816 time: 0.1307647 Sep 18 08:33:02.181526 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 53374) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:33:02.285777 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dc5bfb6f-3bde-40f1-a171-b811e66b7c94 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:33:02.287012 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-dc5bfb6f-3bde-40f1-a171-b811e66b7c94 admin admin] 10.222.0.35 "GET /v2.0/subnets/ddeb1412-631c-4a07-9b46-46e266f817fc HTTP/1.1" status: 200 len: 868 time: 0.1039681 Sep 18 08:33:09.714684 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 5 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:33:19.584139 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-9f6ce0ce-83e1-4ead-8feb-8d5cb0d12ae8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:22.380168 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-92119d8b-fd1a-4b33-ab33-d8dda9d94895 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:23.168107 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:23.287083 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:24.815657 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:25.867479 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 53428) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:33:25.913967 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [None req-d087bc5e-c35a-4c28-9bae-18c970aeb7a7 admin admin] http://10.222.0.35:9696/v2.0/extensions returned with HTTP 200 {{(pid=94346) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 18 08:33:25.914970 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-d087bc5e-c35a-4c28-9bae-18c970aeb7a7 admin admin] 10.222.0.35 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0465424 Sep 18 08:33:28.171639 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 53436) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:33:28.231048 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.pecan_wsgi.hooks.translation [None req-6bbc9726-c8a8-4b49-9f09-9f9d99dc16b0 admin admin] GET failed (client error): The resource could not be found. Sep 18 08:33:28.232370 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-6bbc9726-c8a8-4b49-9f09-9f9d99dc16b0 admin admin] 10.222.0.35 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0597863 Sep 18 08:33:28.316059 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6639fb6e-c054-48e6-b721-f853351c1c6f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:33:28.317549 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-6639fb6e-c054-48e6-b721-f853351c1c6f admin admin] 10.222.0.35 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.0805879 Sep 18 08:33:30.529741 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 53444) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:33:30.575794 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-24f9b1f0-5d75-4512-afe2-19b2239b1664 admin admin] Request body: {'network': {'admin_state_up': True, 'name': 'shared', 'shared': True}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:33:30.595360 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-24f9b1f0-5d75-4512-afe2-19b2239b1664 admin admin] Made reservation on behalf of a272f5e9604b4d9988c3e4ceb4a05e5a for: {'network': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:33:30.597856 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-24f9b1f0-5d75-4512-afe2-19b2239b1664 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for network, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:30.623726 dv-cinder-804470-6-iscsi neutron-server[94346]: WARNING neutron.services.revisions.revision_plugin [None req-24f9b1f0-5d75-4512-afe2-19b2239b1664 admin admin] Could not find related network for resource to bump revision. Sep 18 08:33:30.636280 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-24f9b1f0-5d75-4512-afe2-19b2239b1664 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 242} {{(pid=94346) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 18 08:33:30.645454 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-24f9b1f0-5d75-4512-afe2-19b2239b1664 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:30.645793 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.db.segments_db [None req-24f9b1f0-5d75-4512-afe2-19b2239b1664 admin admin] Added segment 4771e64b-9ced-4a35-b6b5-805d70815e86 of type vlan for network 06bf55c3-5a69-4608-ba2d-4599eb57bfe8 Sep 18 08:33:30.682489 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-24f9b1f0-5d75-4512-afe2-19b2239b1664 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732885226527'] for network, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:30.705061 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-24f9b1f0-5d75-4512-afe2-19b2239b1664 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for network, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:30.706070 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-24f9b1f0-5d75-4512-afe2-19b2239b1664 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:33:30.706603 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-24f9b1f0-5d75-4512-afe2-19b2239b1664 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:30.734655 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-24f9b1f0-5d75-4512-afe2-19b2239b1664 admin admin] 10.222.0.35 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.2038493 Sep 18 08:33:30.766648 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24f9b1f0-5d75-4512-afe2-19b2239b1664 admin admin] Pushing event updated for resources: {'Network': ['ID=06bf55c3-5a69-4608-ba2d-4599eb57bfe8,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:33:30.777822 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Network 06bf55c3-5a69-4608-ba2d-4599eb57bfe8 details requested by agent ovs-agent-dv-cinder-804470-6-iscsi with host dv-cinder-804470-6-iscsi {{(pid=94348) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 18 08:33:32.929263 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 53452) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:33:32.991350 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.pecan_wsgi.hooks.translation [None req-b1ca0e15-69ac-4902-bcac-c6b6bf231d1b admin admin] GET failed (client error): The resource could not be found. Sep 18 08:33:32.992660 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-b1ca0e15-69ac-4902-bcac-c6b6bf231d1b admin admin] 10.222.0.35 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0625169 Sep 18 08:33:33.154397 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b6aa45f0-4a79-4752-a53a-e3c2cd1d3153 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:33:33.155860 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-b6aa45f0-4a79-4752-a53a-e3c2cd1d3153 admin admin] 10.222.0.35 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.1580036 Sep 18 08:33:33.166544 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-0f7ab397-5d60-4222-a709-788b7efa4e3b admin admin] Request body: {'subnet': {'network_id': '06bf55c3-5a69-4608-ba2d-4599eb57bfe8', 'cidr': '192.168.233.0/24', 'description': 'shared-subnet', 'ip_version': 4, 'name': 'shared-subnet'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:33:33.186734 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0f7ab397-5d60-4222-a709-788b7efa4e3b admin admin] Made reservation on behalf of a272f5e9604b4d9988c3e4ceb4a05e5a for: {'subnet': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:33:33.188936 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0f7ab397-5d60-4222-a709-788b7efa4e3b admin admin] Notify callbacks [] for subnet, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:33.348809 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0f7ab397-5d60-4222-a709-788b7efa4e3b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for subnet, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:33.405554 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f7ab397-5d60-4222-a709-788b7efa4e3b admin admin] Pushing event updated for resources: {'Subnet': ['ID=07aca37f-8673-4f2c-a2b8-6de53e548d8a,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:33:33.413863 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f7ab397-5d60-4222-a709-788b7efa4e3b admin admin] Checking segment: {'id': '4771e64b-9ced-4a35-b6b5-805d70815e86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 242, 'network_id': '06bf55c3-5a69-4608-ba2d-4599eb57bfe8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94346) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:33:33.414221 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f7ab397-5d60-4222-a709-788b7efa4e3b admin admin] Network hostable DHCP agents. Network: 06bf55c3-5a69-4608-ba2d-4599eb57bfe8, hostable agents: ['6aaa6222-6d04-44a7-b807-bfc2cbd3e99f'], hosted agents: [] {{(pid=94346) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 18 08:33:33.430260 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f7ab397-5d60-4222-a709-788b7efa4e3b admin admin] Network 06bf55c3-5a69-4608-ba2d-4599eb57bfe8 is scheduled to be hosted by DHCP agent 6aaa6222-6d04-44a7-b807-bfc2cbd3e99f with binding_index 1 {{(pid=94346) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 18 08:33:33.438463 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-0f7ab397-5d60-4222-a709-788b7efa4e3b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804470-6-iscsi, 06bf55c3-5a69-4608-ba2d-4599eb57bfe8) {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:33:33.442405 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f7ab397-5d60-4222-a709-788b7efa4e3b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:33:33.443011 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0f7ab397-5d60-4222-a709-788b7efa4e3b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for subnet, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:33.447879 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d24f4a21-3360-4ac5-a052-ca66d7b455ae None None] Network 06bf55c3-5a69-4608-ba2d-4599eb57bfe8 requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:33:33.456598 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-0f7ab397-5d60-4222-a709-788b7efa4e3b admin admin] 10.222.0.35 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.2938831 Sep 18 08:33:33.695019 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp22fa9bf9-2738-5c16-87a3-3f58ee5e2dc2-06bf55c3-5a69-4608-ba2d-4599eb57bfe8', 'network_id': '06bf55c3-5a69-4608-ba2d-4599eb57bfe8', 'tenant_id': 'a272f5e9604b4d9988c3e4ceb4a05e5a', 'fixed_ips': [{'subnet_id': '07aca37f-8673-4f2c-a2b8-6de53e548d8a'}]}} from dv-cinder-804470-6-iscsi. {{(pid=94348) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 18 08:33:33.695941 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:33.844855 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.db_base_plugin_common [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Allocated IP 192.168.233.2 (06bf55c3-5a69-4608-ba2d-4599eb57bfe8/07aca37f-8673-4f2c-a2b8-6de53e548d8a/467255a5-2dc0-4dc4-a6b5-f6a0081ba0d9) {{(pid=94348) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:33:33.988321 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Notify callbacks [] for port, precommit_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:33.995618 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528'] for port, after_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:34.033129 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Network 06bf55c3-5a69-4608-ba2d-4599eb57bfe8 is already hosted by enough agents. {{(pid=94348) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:33:34.035815 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.scheduler.base_scheduler [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Resources bound (agent type, host, resource id): {{(pid=94348) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:33:34.038382 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Received port after_create {{(pid=94348) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:33:34.051561 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Pushing event updated for resources: {'Port': ['ID=467255a5-2dc0-4dc4-a6b5-f6a0081ba0d9,revision_number=1']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:33:34.061183 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:33:34.061563 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:33:34.061909 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:33:34.062249 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:33:34.062584 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:33:34.062921 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:33:34.063253 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:33:34.063584 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:33:34.063931 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:33:34.064273 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:33:34.064581 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:33:34.064917 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:33:34.110705 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Attempting to bind port 467255a5-2dc0-4dc4-a6b5-f6a0081ba0d9 on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:33:34.111076 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Attempting to bind port 467255a5-2dc0-4dc4-a6b5-f6a0081ba0d9 by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': '4771e64b-9ced-4a35-b6b5-805d70815e86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 242, 'network_id': '06bf55c3-5a69-4608-ba2d-4599eb57bfe8'}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:33:34.111440 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Attempting to bind port 467255a5-2dc0-4dc4-a6b5-f6a0081ba0d9 on network 06bf55c3-5a69-4608-ba2d-4599eb57bfe8 {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:33:34.116256 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 33, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:33:34.116627 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Checking segment: {'id': '4771e64b-9ced-4a35-b6b5-805d70815e86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 242, 'network_id': '06bf55c3-5a69-4608-ba2d-4599eb57bfe8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94348) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:33:34.117025 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:34.117444 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Bound using segment: {'id': '4771e64b-9ced-4a35-b6b5-805d70815e86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 242, 'network_id': '06bf55c3-5a69-4608-ba2d-4599eb57bfe8'} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:33:34.117915 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Bound port: 467255a5-2dc0-4dc4-a6b5-f6a0081ba0d9, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4771e64b-9ced-4a35-b6b5-805d70815e86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 242, 'network_id': '06bf55c3-5a69-4608-ba2d-4599eb57bfe8'}}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:33:34.118313 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:34.187405 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] For port 467255a5-2dc0-4dc4-a6b5-f6a0081ba0d9, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94348) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:33:34.190582 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] For port 467255a5-2dc0-4dc4-a6b5-f6a0081ba0d9, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=467255a5-2dc0-4dc4-a6b5-f6a0081ba0d9,segment=NetworkSegment(4771e64b-9ced-4a35-b6b5-805d70815e86),segment_id=4771e64b-9ced-4a35-b6b5-805d70815e86)] {{(pid=94348) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:33:34.194652 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:34.250220 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de89551e-bc56-4b65-9b3d-be8f3c55eefa None None] Pushing event updated for resources: {'Port': ['ID=467255a5-2dc0-4dc4-a6b5-f6a0081ba0d9,revision_number=2']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:33:34.743301 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 467255a5-2dc0-4dc4-a6b5-f6a0081ba0d9 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:33:34.796436 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 467255a5-2dc0-4dc4-a6b5-f6a0081ba0d9 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:33:34.796436 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:34.880801 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:34.917074 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-536c997d-2873-442a-81bf-9fe918803742 None None] For port 467255a5-2dc0-4dc4-a6b5-f6a0081ba0d9, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=467255a5-2dc0-4dc4-a6b5-f6a0081ba0d9,segment=NetworkSegment(4771e64b-9ced-4a35-b6b5-805d70815e86),segment_id=4771e64b-9ced-4a35-b6b5-805d70815e86)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:33:34.923084 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:34.977273 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Pushing event updated for resources: {'Port': ['ID=467255a5-2dc0-4dc4-a6b5-f6a0081ba0d9,revision_number=3']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:33:35.081410 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2efc5d5a-f55e-4d2e-843b-b5bbb30999c5 None None] Network 06bf55c3-5a69-4608-ba2d-4599eb57bfe8 requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:33:35.148893 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-3d0347b9-713f-4d5c-aeb2-cb1c570a17a5 None None] Provisioning complete for port 467255a5-2dc0-4dc4-a6b5-f6a0081ba0d9 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:33:35.149190 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-3d0347b9-713f-4d5c-aeb2-cb1c570a17a5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:35.508426 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-df53cf62-5712-492f-a1f8-dcbe7db7bb8a None None] Provisioning complete for port 467255a5-2dc0-4dc4-a6b5-f6a0081ba0d9 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:33:35.508804 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-df53cf62-5712-492f-a1f8-dcbe7db7bb8a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:36.724018 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 467255a5-2dc0-4dc4-a6b5-f6a0081ba0d9 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:33:36.770553 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 467255a5-2dc0-4dc4-a6b5-f6a0081ba0d9 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:33:36.770933 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:46.713489 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 5 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:33:49.586309 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-00b33d5f-edde-44a9-8447-03708b4b7f5a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:52.382128 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-36d6724b-55bc-46ec-94a9-17f5523589e8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:53.168522 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:53.287961 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:33:54.821443 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:34:19.587126 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-6b38f65b-35b2-4059-a0cc-925d295c1bd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:34:22.382253 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-d16df984-4cb4-47e1-9a80-5a42737461de None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:34:23.169800 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:34:23.289933 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:34:23.713097 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 5 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:34:24.821885 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:34:47.131699 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 53504) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:34:47.137541 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [None req-69c93092-43d6-43a4-90d7-46abf8d94a3b tempest-verify_tempest_config-203513268 tempest-verify_tempest_config-203513268-project] http://10.222.0.35:9696/v2.0/extensions returned with HTTP 200 {{(pid=94346) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 18 08:34:47.138503 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-69c93092-43d6-43a4-90d7-46abf8d94a3b tempest-verify_tempest_config-203513268 tempest-verify_tempest_config-203513268-project] 10.222.0.35 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13635 time: 0.0058432 Sep 18 08:34:47.424828 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 53522) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:34:47.526252 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-2d030ad9-452c-490d-946c-c40b79117909 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:34:47.630066 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-2d030ad9-452c-490d-946c-c40b79117909 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:34:47.633742 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-2d030ad9-452c-490d-946c-c40b79117909 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:34:47.676985 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-2d030ad9-452c-490d-946c-c40b79117909 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=268b52554bcd44f09383f9f47b7cc812&name=default HTTP/1.1" status: 200 len: 2975 time: 0.2510757 Sep 18 08:34:47.678980 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d030ad9-452c-490d-946c-c40b79117909 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=53c8f1af-04eb-40d8-b729-269535b27bdd,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:34:47.679931 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 53526) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:34:47.685729 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d030ad9-452c-490d-946c-c40b79117909 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:34:47.686103 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d030ad9-452c-490d-946c-c40b79117909 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:34:47.686450 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d030ad9-452c-490d-946c-c40b79117909 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:34:47.686786 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d030ad9-452c-490d-946c-c40b79117909 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:34:47.687122 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d030ad9-452c-490d-946c-c40b79117909 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:34:47.687468 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d030ad9-452c-490d-946c-c40b79117909 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:34:47.687802 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d030ad9-452c-490d-946c-c40b79117909 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:34:47.688131 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d030ad9-452c-490d-946c-c40b79117909 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:34:47.688474 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d030ad9-452c-490d-946c-c40b79117909 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:34:47.688803 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d030ad9-452c-490d-946c-c40b79117909 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:34:47.689126 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d030ad9-452c-490d-946c-c40b79117909 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:34:47.689490 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d030ad9-452c-490d-946c-c40b79117909 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:34:47.765565 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-bc429695-d512-4d63-ac33-12cb5d78eec0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:34:47.785780 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-bc429695-d512-4d63-ac33-12cb5d78eec0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:34:47.874678 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-bc429695-d512-4d63-ac33-12cb5d78eec0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:34:47.877312 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-bc429695-d512-4d63-ac33-12cb5d78eec0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:34:47.878527 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-bc429695-d512-4d63-ac33-12cb5d78eec0 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/53c8f1af-04eb-40d8-b729-269535b27bdd HTTP/1.1" status: 204 len: 168 time: 0.1975062 Sep 18 08:34:47.887151 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc429695-d512-4d63-ac33-12cb5d78eec0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=53c8f1af-04eb-40d8-b729-269535b27bdd,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:34:47.899414 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc429695-d512-4d63-ac33-12cb5d78eec0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:34:47.899926 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc429695-d512-4d63-ac33-12cb5d78eec0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:34:47.900414 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc429695-d512-4d63-ac33-12cb5d78eec0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:34:47.900885 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc429695-d512-4d63-ac33-12cb5d78eec0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:34:47.901381 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc429695-d512-4d63-ac33-12cb5d78eec0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:34:47.901869 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc429695-d512-4d63-ac33-12cb5d78eec0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:34:47.902336 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc429695-d512-4d63-ac33-12cb5d78eec0 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:34:47.902798 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc429695-d512-4d63-ac33-12cb5d78eec0 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:34:47.903280 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc429695-d512-4d63-ac33-12cb5d78eec0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:34:47.903752 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc429695-d512-4d63-ac33-12cb5d78eec0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:34:47.904217 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc429695-d512-4d63-ac33-12cb5d78eec0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:34:47.904674 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc429695-d512-4d63-ac33-12cb5d78eec0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bc429695-d512-4d63-ac33-12cb5d78eec0 admin admin] Tracked resource versions report: Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: pushed versions: Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: { 'AddressGroup': {'1.2'}, Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: 'ConntrackHelper': {'1.0'}, Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: 'Log': {'1.0'}, Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: 'Network': {'1.1'}, Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: 'Port': {'1.7'}, Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: 'PortForwarding': {'1.2'}, Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: 'QosPolicy': {'1.9'}, Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: 'SecurityGroup': {'1.4'}, Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: 'SecurityGroupRule': {'1.2'}, Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: 'SubPort': {'1.0'}, Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: 'Subnet': {'1.1'}, Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: 'Trunk': {'1.1'}} Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: consumer versions: Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: { DHCP agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: L3 agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: Metadata agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: Metering agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: Open vSwitch agent@dv-cinder-804470-6-iscsi: { 'AddressGroup': '1.2', Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: 'ConntrackHelper': '1.0', Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: 'Log': '1.0', Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: 'Network': '1.1', Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: 'Port': '1.7', Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: 'PortForwarding': '1.2', Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: 'QosPolicy': '1.9', Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: 'SecurityGroup': '1.4', Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: 'SecurityGroupRule': '1.2', Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: 'SubPort': '1.0', Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: 'Subnet': '1.1', Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: 'Trunk': '1.1'}} Sep 18 08:34:47.906318 dv-cinder-804470-6-iscsi neutron-server[94347]: {{(pid=94347) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 18 08:34:49.588584 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-24120220-b243-4ccd-8956-852650272911 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:34:52.387106 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-606f37f2-3d18-4ee4-87d3-147525c3a480 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:34:53.170501 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:34:53.294519 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:34:54.827318 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:35:00.711893 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 5 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:35:19.589170 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-26871a16-5047-4fb2-9f8b-4d6554c70877 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:35:22.387561 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-51bafa7e-50fc-4210-9a7d-9eb40da5a2c1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:35:23.171444 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:35:23.296895 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:35:24.827477 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:35:37.711726 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 5 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:35:49.588858 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-7092743f-2204-4e6b-98f3-4534fa5c4513 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:35:52.388371 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-5145af50-0463-40e6-85bd-968c4aa24205 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:35:53.171903 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:35:53.299446 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:35:54.831610 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:36:14.710189 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 5 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:36:18.358485 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-784939'] for agent, after_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:36:19.589231 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-1e6b277f-cf57-4c07-9d04-97e062ad1081 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:36:22.387851 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-df5d8826-3699-4cd9-bf62-e72be1e05b5d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:36:23.182154 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:36:23.301857 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:36:24.834755 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:36:32.356068 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 53604) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:36:32.457551 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-6bf1fead-8a2f-47eb-a6a8-c735472d783a admin admin] 10.222.0.35 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4303 time: 0.1003096 Sep 18 08:36:34.649346 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 53614) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:36:34.706463 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-69326f85-532a-43c1-bbf8-71eeca48d983 admin admin] 10.222.0.35 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4303 time: 0.0560539 Sep 18 08:36:48.342452 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:36:49.589833 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-4a08f748-6389-4d9c-93e3-6585d449d9a2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:36:51.709346 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:36:52.387168 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-9766b4c3-4400-4ccd-b082-2e25479885a8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:36:53.173329 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:36:53.303181 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:36:54.838418 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:37:18.356000 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:37:19.591443 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-da42f841-0c3a-4f68-b429-6981027785b4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:37:22.390905 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-6ac21def-e8c7-45a7-a0e8-ea23aad29079 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:37:23.175078 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:37:23.307793 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:37:24.842634 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:37:28.709082 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:37:48.358421 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:37:49.592536 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-6200a0ba-9c44-4562-9bbb-66589c8bd0ae None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:37:52.391666 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-b2249658-8085-42b5-a200-f346d0f9ee1b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:37:53.178887 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:37:53.309402 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:37:54.844924 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:02.551173 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 53766) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:02.843394 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1079806707-network', 'tenant_id': '79ab1eeea623437e8ca702571b96da7d'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:02.844731 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.quota [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Loaded quota_driver: . Sep 18 08:38:02.891392 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Made reservation on behalf of 79ab1eeea623437e8ca702571b96da7d for: {'network': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:38:02.894524 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for network, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:02.907532 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:03.021876 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:03.026878 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:03.057502 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8ec8ef7b-d527-4952-98bf-d882a759da55,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:03.072494 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 218} {{(pid=94347) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 18 08:38:03.076303 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:03.076671 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:03.077011 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:03.077373 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:03.077704 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:03.078050 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:03.078381 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:03.078701 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:03.079248 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:03.079582 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:03.079906 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:03.080226 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Tracked resource versions report: Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: pushed versions: Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: { 'AddressGroup': {'1.2'}, Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: 'ConntrackHelper': {'1.0'}, Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: 'Log': {'1.0'}, Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: 'Network': {'1.1'}, Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: 'Port': {'1.7'}, Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: 'PortForwarding': {'1.2'}, Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: 'QosPolicy': {'1.9'}, Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: 'SecurityGroup': {'1.4'}, Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: 'SecurityGroupRule': {'1.2'}, Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: 'SubPort': {'1.0'}, Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: 'Subnet': {'1.1'}, Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: 'Trunk': {'1.1'}} Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: consumer versions: Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: { DHCP agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: HyperV agent@hv-cinder-80447: {}, Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: L3 agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: Metadata agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: Metering agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: Open vSwitch agent@dv-cinder-804470-6-iscsi: { 'AddressGroup': '1.2', Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: 'ConntrackHelper': '1.0', Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: 'Log': '1.0', Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: 'Network': '1.1', Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: 'Port': '1.7', Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: 'PortForwarding': '1.2', Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: 'QosPolicy': '1.9', Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: 'SecurityGroup': '1.4', Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: 'SecurityGroupRule': '1.2', Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: 'SubPort': '1.0', Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: 'Subnet': '1.1', Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: 'Trunk': '1.1'}} Sep 18 08:38:03.081261 dv-cinder-804470-6-iscsi neutron-server[94347]: {{(pid=94347) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 18 08:38:03.097756 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Notify callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8732885752724', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:03.098349 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Unsubscribe: segment precommit_create {{(pid=94347) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Sep 18 08:38:03.098836 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.db.segments_db [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Added segment 892b5fda-4f2b-4e3a-af39-7d4f8d89394b of type vlan for network 2c7737b5-792d-4a8d-bacc-cd5c180b7fc0 Sep 18 08:38:03.169909 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732885226527'] for network, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:03.205923 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for network, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:03.207309 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:03.207723 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:03.257739 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] 10.222.0.35 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.7054737 Sep 18 08:38:03.260075 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 53806) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:03.266927 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-097aa29d-1155-41e9-9e61-6d97b901072c admin admin] Request body: {'subnet': {'network_id': '2c7737b5-792d-4a8d-bacc-cd5c180b7fc0', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1079806707-subnet', 'tenant_id': '79ab1eeea623437e8ca702571b96da7d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:03.297764 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-097aa29d-1155-41e9-9e61-6d97b901072c admin admin] Made reservation on behalf of 79ab1eeea623437e8ca702571b96da7d for: {'subnet': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:38:03.300134 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-097aa29d-1155-41e9-9e61-6d97b901072c admin admin] Notify callbacks [] for subnet, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:03.338748 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c13a2195-4e78-489c-bb28-11be563110e8 admin admin] Pushing event updated for resources: {'Network': ['ID=2c7737b5-792d-4a8d-bacc-cd5c180b7fc0,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:03.340639 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 53816) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:03.358212 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Network 2c7737b5-792d-4a8d-bacc-cd5c180b7fc0 details requested by agent ovs-agent-dv-cinder-804470-6-iscsi with host dv-cinder-804470-6-iscsi {{(pid=94348) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 18 08:38:03.484640 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-097aa29d-1155-41e9-9e61-6d97b901072c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for subnet, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:03.540964 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-097aa29d-1155-41e9-9e61-6d97b901072c admin admin] Pushing event updated for resources: {'Subnet': ['ID=9ed653e4-68a0-4108-b090-7571bdc067bc,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:03.549049 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-097aa29d-1155-41e9-9e61-6d97b901072c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:03.549454 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-097aa29d-1155-41e9-9e61-6d97b901072c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:03.549801 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-097aa29d-1155-41e9-9e61-6d97b901072c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:03.550133 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-097aa29d-1155-41e9-9e61-6d97b901072c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:03.550462 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-097aa29d-1155-41e9-9e61-6d97b901072c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:03.550802 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-097aa29d-1155-41e9-9e61-6d97b901072c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:03.551139 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-097aa29d-1155-41e9-9e61-6d97b901072c admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:03.551450 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-097aa29d-1155-41e9-9e61-6d97b901072c admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:03.551776 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-097aa29d-1155-41e9-9e61-6d97b901072c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:03.552093 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-097aa29d-1155-41e9-9e61-6d97b901072c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:03.552413 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-097aa29d-1155-41e9-9e61-6d97b901072c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:03.552734 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-097aa29d-1155-41e9-9e61-6d97b901072c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-097aa29d-1155-41e9-9e61-6d97b901072c admin admin] Tracked resource versions report: Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: pushed versions: Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: { 'AddressGroup': {'1.2'}, Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: 'ConntrackHelper': {'1.0'}, Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: 'Log': {'1.0'}, Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: 'Network': {'1.1'}, Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: 'Port': {'1.7'}, Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: 'PortForwarding': {'1.2'}, Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: 'QosPolicy': {'1.9'}, Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: 'SecurityGroup': {'1.4'}, Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: 'SecurityGroupRule': {'1.2'}, Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: 'SubPort': {'1.0'}, Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: 'Subnet': {'1.1'}, Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: 'Trunk': {'1.1'}} Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: consumer versions: Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: { DHCP agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: HyperV agent@hv-cinder-80447: {}, Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: L3 agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: Metadata agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: Metering agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: Open vSwitch agent@dv-cinder-804470-6-iscsi: { 'AddressGroup': '1.2', Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: 'ConntrackHelper': '1.0', Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: 'Log': '1.0', Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: 'Network': '1.1', Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: 'Port': '1.7', Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: 'PortForwarding': '1.2', Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: 'QosPolicy': '1.9', Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: 'SecurityGroup': '1.4', Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: 'SecurityGroupRule': '1.2', Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: 'SubPort': '1.0', Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: 'Subnet': '1.1', Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: 'Trunk': '1.1'}} Sep 18 08:38:03.553820 dv-cinder-804470-6-iscsi neutron-server[94346]: {{(pid=94346) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 18 08:38:03.562918 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-097aa29d-1155-41e9-9e61-6d97b901072c admin admin] Checking segment: {'id': '892b5fda-4f2b-4e3a-af39-7d4f8d89394b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 218, 'network_id': '2c7737b5-792d-4a8d-bacc-cd5c180b7fc0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94346) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:38:03.563275 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-097aa29d-1155-41e9-9e61-6d97b901072c admin admin] Network hostable DHCP agents. Network: 2c7737b5-792d-4a8d-bacc-cd5c180b7fc0, hostable agents: ['6aaa6222-6d04-44a7-b807-bfc2cbd3e99f'], hosted agents: [] {{(pid=94346) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 18 08:38:03.580473 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-097aa29d-1155-41e9-9e61-6d97b901072c admin admin] Network 2c7737b5-792d-4a8d-bacc-cd5c180b7fc0 is scheduled to be hosted by DHCP agent 6aaa6222-6d04-44a7-b807-bfc2cbd3e99f with binding_index 1 {{(pid=94346) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 18 08:38:03.590638 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-097aa29d-1155-41e9-9e61-6d97b901072c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804470-6-iscsi, 2c7737b5-792d-4a8d-bacc-cd5c180b7fc0) {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:38:03.595913 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-097aa29d-1155-41e9-9e61-6d97b901072c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:03.596502 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-097aa29d-1155-41e9-9e61-6d97b901072c admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for subnet, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:03.602708 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8a4cfb90-af88-4fda-bd73-80a381454aec None None] Network 2c7737b5-792d-4a8d-bacc-cd5c180b7fc0 requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:38:03.610866 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-8bfc66d8-2585-4b3f-8338-9f9c13f2bb41 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-230900396-network', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:03.628165 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-097aa29d-1155-41e9-9e61-6d97b901072c admin admin] 10.222.0.35 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.3589358 Sep 18 08:38:03.636561 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8bfc66d8-2585-4b3f-8338-9f9c13f2bb41 admin admin] Made reservation on behalf of 0700a96e9b3f48e8b6bcdd75b820b813 for: {'network': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:38:03.639600 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8bfc66d8-2585-4b3f-8338-9f9c13f2bb41 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for network, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:03.650092 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8bfc66d8-2585-4b3f-8338-9f9c13f2bb41 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:03.722492 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 53840) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:03.753439 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8bfc66d8-2585-4b3f-8338-9f9c13f2bb41 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:03.759030 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8bfc66d8-2585-4b3f-8338-9f9c13f2bb41 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:03.764205 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e2e4bf4e-a451-452c-b6fc-d5601fd77fc1 None None] Network 2c7737b5-792d-4a8d-bacc-cd5c180b7fc0 requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:38:03.787735 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bfc66d8-2585-4b3f-8338-9f9c13f2bb41 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=91efed16-e97b-4fc5-854f-b61aadeda6c3,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:03.808549 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8bfc66d8-2585-4b3f-8338-9f9c13f2bb41 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 214} {{(pid=94347) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 18 08:38:03.819399 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8bfc66d8-2585-4b3f-8338-9f9c13f2bb41 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:03.820068 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.db.segments_db [None req-8bfc66d8-2585-4b3f-8338-9f9c13f2bb41 admin admin] Added segment 34c1fb08-1711-4a8c-a899-35eb41628d5a of type vlan for network f430397d-03a8-4da2-bd1d-25890a3a0727 Sep 18 08:38:03.869073 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8bfc66d8-2585-4b3f-8338-9f9c13f2bb41 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732885226527'] for network, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:03.897521 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8bfc66d8-2585-4b3f-8338-9f9c13f2bb41 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for network, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:03.899215 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8bfc66d8-2585-4b3f-8338-9f9c13f2bb41 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:03.900042 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8bfc66d8-2585-4b3f-8338-9f9c13f2bb41 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:03.965651 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-8bfc66d8-2585-4b3f-8338-9f9c13f2bb41 admin admin] 10.222.0.35 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.6209235 Sep 18 08:38:03.966224 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 53852) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:03.966805 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bfc66d8-2585-4b3f-8338-9f9c13f2bb41 admin admin] Pushing event updated for resources: {'Network': ['ID=f430397d-03a8-4da2-bd1d-25890a3a0727,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:03.972552 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-02c2f8a4-b824-4727-ac00-4a07036902ec admin admin] Request body: {'subnet': {'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-230900396-subnet', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:03.981128 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Network f430397d-03a8-4da2-bd1d-25890a3a0727 details requested by agent ovs-agent-dv-cinder-804470-6-iscsi with host dv-cinder-804470-6-iscsi {{(pid=94348) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 18 08:38:04.014516 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-02c2f8a4-b824-4727-ac00-4a07036902ec admin admin] Made reservation on behalf of 0700a96e9b3f48e8b6bcdd75b820b813 for: {'subnet': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:38:04.016832 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-02c2f8a4-b824-4727-ac00-4a07036902ec admin admin] Notify callbacks [] for subnet, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:04.184025 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-02c2f8a4-b824-4727-ac00-4a07036902ec admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for subnet, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:04.190721 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 53858) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:04.220679 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-c8a4b07b-c80b-4fef-83ed-13d5ce60908a admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1577305803-network', 'tenant_id': '38bd82e43ad3497aa14e8e4e68a29009'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:04.244781 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02c2f8a4-b824-4727-ac00-4a07036902ec admin admin] Pushing event updated for resources: {'Subnet': ['ID=acdeb8a1-5de9-425f-ae0a-890d310246e9,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:04.271024 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02c2f8a4-b824-4727-ac00-4a07036902ec admin admin] Checking segment: {'id': '34c1fb08-1711-4a8c-a899-35eb41628d5a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 214, 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94346) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:38:04.271746 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-02c2f8a4-b824-4727-ac00-4a07036902ec admin admin] Network hostable DHCP agents. Network: f430397d-03a8-4da2-bd1d-25890a3a0727, hostable agents: ['6aaa6222-6d04-44a7-b807-bfc2cbd3e99f'], hosted agents: [] {{(pid=94346) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 18 08:38:04.287388 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c8a4b07b-c80b-4fef-83ed-13d5ce60908a admin admin] Made reservation on behalf of 38bd82e43ad3497aa14e8e4e68a29009 for: {'network': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:38:04.289762 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c8a4b07b-c80b-4fef-83ed-13d5ce60908a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for network, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:04.299422 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c8a4b07b-c80b-4fef-83ed-13d5ce60908a admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:04.311436 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-02c2f8a4-b824-4727-ac00-4a07036902ec admin admin] Network f430397d-03a8-4da2-bd1d-25890a3a0727 is scheduled to be hosted by DHCP agent 6aaa6222-6d04-44a7-b807-bfc2cbd3e99f with binding_index 1 {{(pid=94346) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 18 08:38:04.325163 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-02c2f8a4-b824-4727-ac00-4a07036902ec admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804470-6-iscsi, f430397d-03a8-4da2-bd1d-25890a3a0727) {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:38:04.331689 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-02c2f8a4-b824-4727-ac00-4a07036902ec admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:04.332344 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-02c2f8a4-b824-4727-ac00-4a07036902ec admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for subnet, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:04.338783 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-15c4bd21-166a-4660-a83c-c874595931ec None None] Network f430397d-03a8-4da2-bd1d-25890a3a0727 requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:38:04.419253 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c8a4b07b-c80b-4fef-83ed-13d5ce60908a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:04.431986 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c8a4b07b-c80b-4fef-83ed-13d5ce60908a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:04.457197 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-02c2f8a4-b824-4727-ac00-4a07036902ec admin admin] 10.222.0.35 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.4898057 Sep 18 08:38:04.460566 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 53868) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:04.465627 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-270fc634-01d3-441e-b9d3-9f2af01503e3 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-230900396-router', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:04.477491 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c8a4b07b-c80b-4fef-83ed-13d5ce60908a admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 233} {{(pid=94346) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 18 08:38:04.513487 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp22fa9bf9-2738-5c16-87a3-3f58ee5e2dc2-f430397d-03a8-4da2-bd1d-25890a3a0727', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'fixed_ips': [{'subnet_id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9'}]}} from dv-cinder-804470-6-iscsi. {{(pid=94348) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 18 08:38:04.514393 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:04.526201 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c8a4b07b-c80b-4fef-83ed-13d5ce60908a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:04.526574 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.db.segments_db [None req-c8a4b07b-c80b-4fef-83ed-13d5ce60908a admin admin] Added segment d1432479-9c27-42c4-87db-6905e7868675 of type vlan for network fe2753d3-7f3b-4739-adbf-6643a840c73e Sep 18 08:38:04.529455 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-270fc634-01d3-441e-b9d3-9f2af01503e3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-784001', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2995'] for router, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:04.530201 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8a4b07b-c80b-4fef-83ed-13d5ce60908a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ca2e95d1-6615-46ef-a777-ca8d0c034440,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:04.532434 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-270fc634-01d3-441e-b9d3-9f2af01503e3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-782353', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-784513', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-710924', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2984'] for router, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:04.625706 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c8a4b07b-c80b-4fef-83ed-13d5ce60908a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732885226527'] for network, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:04.676951 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c8a4b07b-c80b-4fef-83ed-13d5ce60908a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for network, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:04.678221 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8a4b07b-c80b-4fef-83ed-13d5ce60908a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:04.679026 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c8a4b07b-c80b-4fef-83ed-13d5ce60908a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:04.693111 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.db_base_plugin_common [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Allocated IP 172.20.0.2 (f430397d-03a8-4da2-bd1d-25890a3a0727/acdeb8a1-5de9-425f-ae0a-890d310246e9/f64a2ad2-4079-4e29-8c07-3f9846a145a8) {{(pid=94348) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:38:04.809506 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-d43111f8-b6aa-46af-a473-994de5993e00 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-381458811-network', 'tenant_id': 'f439efa4eed0456ab2a914377e490fad'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:04.816548 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-c8a4b07b-c80b-4fef-83ed-13d5ce60908a admin admin] 10.222.0.35 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 1.0903201 Sep 18 08:38:04.816548 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8a4b07b-c80b-4fef-83ed-13d5ce60908a admin admin] Pushing event updated for resources: {'Network': ['ID=fe2753d3-7f3b-4739-adbf-6643a840c73e,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:04.822738 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 53882) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:04.823273 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-270fc634-01d3-441e-b9d3-9f2af01503e3 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:04.835920 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-3f6b4afe-e39c-49e2-92b9-6be3ce3d8d30 admin admin] Request body: {'subnet': {'network_id': 'fe2753d3-7f3b-4739-adbf-6643a840c73e', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1577305803-subnet', 'tenant_id': '38bd82e43ad3497aa14e8e4e68a29009', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:04.911822 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Notify callbacks [] for port, precommit_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:04.915726 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Network fe2753d3-7f3b-4739-adbf-6643a840c73e details requested by agent ovs-agent-dv-cinder-804470-6-iscsi with host dv-cinder-804470-6-iscsi {{(pid=94348) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 18 08:38:04.939059 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528'] for port, after_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:04.967464 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d43111f8-b6aa-46af-a473-994de5993e00 admin admin] Made reservation on behalf of f439efa4eed0456ab2a914377e490fad for: {'network': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:38:04.970531 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d43111f8-b6aa-46af-a473-994de5993e00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for network, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:04.976191 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3f6b4afe-e39c-49e2-92b9-6be3ce3d8d30 admin admin] Made reservation on behalf of 38bd82e43ad3497aa14e8e4e68a29009 for: {'subnet': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:38:04.979615 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3f6b4afe-e39c-49e2-92b9-6be3ce3d8d30 admin admin] Notify callbacks [] for subnet, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:05.019541 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d43111f8-b6aa-46af-a473-994de5993e00 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:05.079748 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Pushing event updated for resources: {'Port': ['ID=f64a2ad2-4079-4e29-8c07-3f9846a145a8,revision_number=1']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:05.093406 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Network f430397d-03a8-4da2-bd1d-25890a3a0727 is already hosted by enough agents. {{(pid=94348) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:38:05.099474 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:05.100068 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-270fc634-01d3-441e-b9d3-9f2af01503e3 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:05.100317 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:05.100869 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:05.101467 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:05.102613 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:05.103198 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:05.103756 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:05.104599 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:05.105672 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:05.106313 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:05.106911 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:05.107579 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Tracked resource versions report: Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: pushed versions: Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: { 'AddressGroup': {'1.2'}, Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: 'ConntrackHelper': {'1.0'}, Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: 'Log': {'1.0'}, Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: 'Network': {'1.1'}, Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: 'Port': {'1.7'}, Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: 'PortForwarding': {'1.2'}, Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: 'QosPolicy': {'1.9'}, Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: 'SecurityGroup': {'1.4'}, Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: 'SecurityGroupRule': {'1.2'}, Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: 'SubPort': {'1.0'}, Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: 'Subnet': {'1.1'}, Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: 'Trunk': {'1.1'}} Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: consumer versions: Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: { DHCP agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: HyperV agent@hv-cinder-80447: {}, Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: L3 agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: Metadata agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: Metering agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: Open vSwitch agent@dv-cinder-804470-6-iscsi: { 'AddressGroup': '1.2', Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: 'ConntrackHelper': '1.0', Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: 'Log': '1.0', Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: 'Network': '1.1', Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: 'Port': '1.7', Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: 'PortForwarding': '1.2', Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: 'QosPolicy': '1.9', Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: 'SecurityGroup': '1.4', Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: 'SecurityGroupRule': '1.2', Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: 'SubPort': '1.0', Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: 'Subnet': '1.1', Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: 'Trunk': '1.1'}} Sep 18 08:38:05.109448 dv-cinder-804470-6-iscsi neutron-server[94348]: {{(pid=94348) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 18 08:38:05.137130 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.scheduler.base_scheduler [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Resources bound (agent type, host, resource id): {{(pid=94348) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:38:05.140899 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Received port after_create {{(pid=94348) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:38:05.207699 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Attempting to bind port f64a2ad2-4079-4e29-8c07-3f9846a145a8 on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:38:05.208088 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Attempting to bind port f64a2ad2-4079-4e29-8c07-3f9846a145a8 by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': '34c1fb08-1711-4a8c-a899-35eb41628d5a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 214, 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727'}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:38:05.208543 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Attempting to bind port f64a2ad2-4079-4e29-8c07-3f9846a145a8 on network f430397d-03a8-4da2-bd1d-25890a3a0727 {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:38:05.214822 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 37, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:38:05.215282 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Checking segment: {'id': '34c1fb08-1711-4a8c-a899-35eb41628d5a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 214, 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94348) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:38:05.216249 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:05.216249 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Bound using segment: {'id': '34c1fb08-1711-4a8c-a899-35eb41628d5a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 214, 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727'} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:38:05.216729 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Bound port: f64a2ad2-4079-4e29-8c07-3f9846a145a8, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '34c1fb08-1711-4a8c-a899-35eb41628d5a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 214, 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727'}}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:38:05.217253 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:05.278975 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3f6b4afe-e39c-49e2-92b9-6be3ce3d8d30 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for subnet, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:05.307554 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] For port f64a2ad2-4079-4e29-8c07-3f9846a145a8, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94348) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:38:05.311461 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] For port f64a2ad2-4079-4e29-8c07-3f9846a145a8, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=f64a2ad2-4079-4e29-8c07-3f9846a145a8,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94348) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:38:05.323062 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:05.364639 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f6b4afe-e39c-49e2-92b9-6be3ce3d8d30 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b96e08ba-91b8-4c1f-bd27-4a1270ccbde2,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:05.374352 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3f6b4afe-e39c-49e2-92b9-6be3ce3d8d30 admin admin] Checking segment: {'id': 'd1432479-9c27-42c4-87db-6905e7868675', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 233, 'network_id': 'fe2753d3-7f3b-4739-adbf-6643a840c73e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94346) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:38:05.374576 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3f6b4afe-e39c-49e2-92b9-6be3ce3d8d30 admin admin] Network hostable DHCP agents. Network: fe2753d3-7f3b-4739-adbf-6643a840c73e, hostable agents: ['6aaa6222-6d04-44a7-b807-bfc2cbd3e99f'], hosted agents: [] {{(pid=94346) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 18 08:38:05.398737 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3f6b4afe-e39c-49e2-92b9-6be3ce3d8d30 admin admin] Network fe2753d3-7f3b-4739-adbf-6643a840c73e is scheduled to be hosted by DHCP agent 6aaa6222-6d04-44a7-b807-bfc2cbd3e99f with binding_index 1 {{(pid=94346) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 18 08:38:05.411810 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-3f6b4afe-e39c-49e2-92b9-6be3ce3d8d30 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804470-6-iscsi, fe2753d3-7f3b-4739-adbf-6643a840c73e) {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:38:05.418438 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3f6b4afe-e39c-49e2-92b9-6be3ce3d8d30 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:05.421353 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3f6b4afe-e39c-49e2-92b9-6be3ce3d8d30 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for subnet, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:05.436740 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-532cdf79-a8f1-400a-9fd7-e4a9a8a7a576 None None] Network fe2753d3-7f3b-4739-adbf-6643a840c73e requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:38:05.604687 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bee15c22-d766-4385-a2d4-f4a848983ee6 None None] Pushing event updated for resources: {'Port': ['ID=f64a2ad2-4079-4e29-8c07-3f9846a145a8,revision_number=2']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:05.617180 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d43111f8-b6aa-46af-a473-994de5993e00 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:05.621290 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-270fc634-01d3-441e-b9d3-9f2af01503e3 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:05.624967 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7bab3b8b-fe2b-4ea5-8611-f6f6496a9fae None None] Network fe2753d3-7f3b-4739-adbf-6643a840c73e requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:38:05.629017 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-3f6b4afe-e39c-49e2-92b9-6be3ce3d8d30 admin admin] 10.222.0.35 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.8052168 Sep 18 08:38:05.731286 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:38:05.752546 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d43111f8-b6aa-46af-a473-994de5993e00 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:05.758560 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-270fc634-01d3-441e-b9d3-9f2af01503e3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:05.806270 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d43111f8-b6aa-46af-a473-994de5993e00 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:05.839753 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d43111f8-b6aa-46af-a473-994de5993e00 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 204} {{(pid=94347) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 18 08:38:05.964397 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d43111f8-b6aa-46af-a473-994de5993e00 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:05.964601 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.db.segments_db [None req-d43111f8-b6aa-46af-a473-994de5993e00 admin admin] Added segment cb92e74f-7545-44c8-a2d3-634d116af362 of type vlan for network fdcbc66e-323e-4b44-be97-566949f4f2ef Sep 18 08:38:06.072244 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d43111f8-b6aa-46af-a473-994de5993e00 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732885226527'] for network, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:06.107951 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_common [None req-270fc634-01d3-441e-b9d3-9f2af01503e3 admin admin] Allocated IP 172.27.1.12 (2e3b3f85-63e4-4380-917a-8c90c80b3e38/cd525bb9-7f93-490c-a5d6-a08911817e54/f6caa699-4d13-4268-b93e-c89e1dbaffb6) {{(pid=94347) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:38:06.141491 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d43111f8-b6aa-46af-a473-994de5993e00 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for network, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:06.142476 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d43111f8-b6aa-46af-a473-994de5993e00 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:06.143080 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d43111f8-b6aa-46af-a473-994de5993e00 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:06.199332 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-d43111f8-b6aa-46af-a473-994de5993e00 admin admin] 10.222.0.35 "POST /v2.0/networks HTTP/1.1" status: 201 len: 891 time: 2.0062547 Sep 18 08:38:06.202394 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 53944) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:06.208865 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-203d344f-3477-4e8e-8364-e6e762572646 admin admin] Request body: {'subnet': {'network_id': 'fdcbc66e-323e-4b44-be97-566949f4f2ef', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-381458811-subnet', 'tenant_id': 'f439efa4eed0456ab2a914377e490fad', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:06.246679 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-203d344f-3477-4e8e-8364-e6e762572646 admin admin] Made reservation on behalf of f439efa4eed0456ab2a914377e490fad for: {'subnet': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:38:06.250480 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-203d344f-3477-4e8e-8364-e6e762572646 admin admin] Notify callbacks [] for subnet, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:06.266232 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d43111f8-b6aa-46af-a473-994de5993e00 admin admin] Pushing event updated for resources: {'Network': ['ID=fdcbc66e-323e-4b44-be97-566949f4f2ef,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:06.277998 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Network fdcbc66e-323e-4b44-be97-566949f4f2ef details requested by agent ovs-agent-dv-cinder-804470-6-iscsi with host dv-cinder-804470-6-iscsi {{(pid=94348) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 18 08:38:06.366479 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-270fc634-01d3-441e-b9d3-9f2af01503e3 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:06.473620 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-270fc634-01d3-441e-b9d3-9f2af01503e3 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528'] for port, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:06.593942 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-203d344f-3477-4e8e-8364-e6e762572646 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for subnet, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:06.643192 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-270fc634-01d3-441e-b9d3-9f2af01503e3 admin admin] Pushing event updated for resources: {'Port': ['ID=f6caa699-4d13-4268-b93e-c89e1dbaffb6,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:06.656098 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-270fc634-01d3-441e-b9d3-9f2af01503e3 admin admin] Network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:38:06.667040 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [None req-270fc634-01d3-441e-b9d3-9f2af01503e3 admin admin] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:38:06.693963 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-203d344f-3477-4e8e-8364-e6e762572646 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e5dc6eef-e778-41a2-a708-c7810ade97db,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:06.697778 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-203d344f-3477-4e8e-8364-e6e762572646 admin admin] Checking segment: {'id': 'cb92e74f-7545-44c8-a2d3-634d116af362', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 204, 'network_id': 'fdcbc66e-323e-4b44-be97-566949f4f2ef'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94346) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:38:06.698304 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-203d344f-3477-4e8e-8364-e6e762572646 admin admin] Network hostable DHCP agents. Network: fdcbc66e-323e-4b44-be97-566949f4f2ef, hostable agents: ['6aaa6222-6d04-44a7-b807-bfc2cbd3e99f'], hosted agents: [] {{(pid=94346) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 18 08:38:06.722560 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [None req-270fc634-01d3-441e-b9d3-9f2af01503e3 admin admin] Received port after_create {{(pid=94347) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:38:06.723246 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-203d344f-3477-4e8e-8364-e6e762572646 admin admin] Network fdcbc66e-323e-4b44-be97-566949f4f2ef is scheduled to be hosted by DHCP agent 6aaa6222-6d04-44a7-b807-bfc2cbd3e99f with binding_index 1 {{(pid=94346) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 18 08:38:06.758299 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-203d344f-3477-4e8e-8364-e6e762572646 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804470-6-iscsi, fdcbc66e-323e-4b44-be97-566949f4f2ef) {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:38:06.764923 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-203d344f-3477-4e8e-8364-e6e762572646 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:06.765565 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-203d344f-3477-4e8e-8364-e6e762572646 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for subnet, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:06.769589 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2ab8e5f4-9bcc-4bff-85f1-566070630df8 None None] Network fdcbc66e-323e-4b44-be97-566949f4f2ef requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:38:06.808004 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-203d344f-3477-4e8e-8364-e6e762572646 admin admin] 10.222.0.35 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 855 time: 0.6041324 Sep 18 08:38:06.808595 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 53978) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:06.812822 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-afe7b9d9-26ab-409b-934e-2633ce9396e8 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-381458811-router', 'tenant_id': 'f439efa4eed0456ab2a914377e490fad', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:06.858368 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-afe7b9d9-26ab-409b-934e-2633ce9396e8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-784001', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2995'] for router, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:06.859832 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-afe7b9d9-26ab-409b-934e-2633ce9396e8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-782353', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-784513', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-710924', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2984'] for router, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:06.970835 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-317f0e5d-3a8e-47d5-a326-636c2ea08aa5 None None] Network f430397d-03a8-4da2-bd1d-25890a3a0727 requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:38:06.981787 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-afe7b9d9-26ab-409b-934e-2633ce9396e8 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:07.029499 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-16101b75-7dcb-4699-ba1b-f67a15a58eb2 None None] Network fdcbc66e-323e-4b44-be97-566949f4f2ef requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:38:07.112439 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device f64a2ad2-4079-4e29-8c07-3f9846a145a8 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:38:07.114348 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-4658cdc4-1766-411c-a3cb-b5cccfde47f9 None None] Provisioning complete for port f64a2ad2-4079-4e29-8c07-3f9846a145a8 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:38:07.114739 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-4658cdc4-1766-411c-a3cb-b5cccfde47f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:07.216709 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 53990) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:07.223426 dv-cinder-804470-6-iscsi neutron-server[94347]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Sep 18 08:38:07.296310 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-afe7b9d9-26ab-409b-934e-2633ce9396e8 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:07.340583 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 54000) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:07.637840 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 54026) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:07.675771 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-06575f0e-e54b-40d5-92d8-64ec29a5deee admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:07.745854 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-4658cdc4-1766-411c-a3cb-b5cccfde47f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:07.770347 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port f64a2ad2-4079-4e29-8c07-3f9846a145a8 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:38:07.771314 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-afe7b9d9-26ab-409b-934e-2633ce9396e8 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:07.771775 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:07.824832 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-afe7b9d9-26ab-409b-934e-2633ce9396e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:07.832827 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-4658cdc4-1766-411c-a3cb-b5cccfde47f9 None None] For port f64a2ad2-4079-4e29-8c07-3f9846a145a8, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=f64a2ad2-4079-4e29-8c07-3f9846a145a8,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:38:07.841130 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9365443-e446-447b-b9f1-13a29817a154 req-6873bd5e-0189-4015-be3f-b562129f38f6 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:07.844054 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-4658cdc4-1766-411c-a3cb-b5cccfde47f9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:07.854453 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d9365443-e446-447b-b9f1-13a29817a154 req-6873bd5e-0189-4015-be3f-b562129f38f6 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/networks?id=fe2753d3-7f3b-4739-adbf-6643a840c73e HTTP/1.1" status: 200 len: 815 time: 0.2102232 Sep 18 08:38:07.895033 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d9365443-e446-447b-b9f1-13a29817a154 req-c2fba52d-7611-4aef-ac32-4436144df26f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/quotas/38bd82e43ad3497aa14e8e4e68a29009 HTTP/1.1" status: 200 len: 375 time: 0.0396006 Sep 18 08:38:07.981868 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d9365443-e446-447b-b9f1-13a29817a154 req-2f184eb8-0f80-4ec2-9d27-50fc524d77b2 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?tenant_id=38bd82e43ad3497aa14e8e4e68a29009&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0858667 Sep 18 08:38:07.985525 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4658cdc4-1766-411c-a3cb-b5cccfde47f9 None None] Pushing event updated for resources: {'Port': ['ID=f64a2ad2-4079-4e29-8c07-3f9846a145a8,revision_number=3']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:07.998289 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-270fc634-01d3-441e-b9d3-9f2af01503e3 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:08.084345 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-33d279ed-1e71-4075-8beb-1e9273c603c9 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:08.086834 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-06575f0e-e54b-40d5-92d8-64ec29a5deee admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:08.094933 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-33d279ed-1e71-4075-8beb-1e9273c603c9 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/networks?id=2c7737b5-792d-4a8d-bacc-cd5c180b7fc0 HTTP/1.1" status: 200 len: 812 time: 0.8770690 Sep 18 08:38:08.100027 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_common [None req-afe7b9d9-26ab-409b-934e-2633ce9396e8 admin admin] Allocated IP 172.27.1.70 (2e3b3f85-63e4-4380-917a-8c90c80b3e38/cd525bb9-7f93-490c-a5d6-a08911817e54/b660dcf0-57cb-4753-901e-b44b4269de3e) {{(pid=94346) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:38:08.103224 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-06575f0e-e54b-40d5-92d8-64ec29a5deee admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:08.120634 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-c6d5035c-fe89-41c4-b3f4-083248fcb5b4 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/quotas/79ab1eeea623437e8ca702571b96da7d HTTP/1.1" status: 200 len: 375 time: 0.0201085 Sep 18 08:38:08.150826 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-4b4bf093-ab8a-451d-898a-ac55223a9143 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?tenant_id=79ab1eeea623437e8ca702571b96da7d&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0339518 Sep 18 08:38:08.155431 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [req-d9365443-e446-447b-b9f1-13a29817a154 req-f74b105c-b408-4e26-a977-84a96911327f service neutron] http://10.222.0.35:9696/v2.0/extensions returned with HTTP 200 {{(pid=94347) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 18 08:38:08.163102 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d9365443-e446-447b-b9f1-13a29817a154 req-f74b105c-b408-4e26-a977-84a96911327f service neutron] 10.222.0.35 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0969057 Sep 18 08:38:08.175473 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-ec148595-5600-4dc2-9c8b-6736b663bc50 None None] Provisioning complete for port f64a2ad2-4079-4e29-8c07-3f9846a145a8 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:38:08.175865 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-ec148595-5600-4dc2-9c8b-6736b663bc50 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:08.244023 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06575f0e-e54b-40d5-92d8-64ec29a5deee admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d454675e-bfb3-44e8-98f5-04152f224be5,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:08.253683 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-06575f0e-e54b-40d5-92d8-64ec29a5deee admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=2d8e7f346ace4893b733962eceec2db2&name=default HTTP/1.1" status: 200 len: 2975 time: 0.9121053 Sep 18 08:38:08.281159 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 54060) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:08.371478 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-afe7b9d9-26ab-409b-934e-2633ce9396e8 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:08.385657 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6db30c02-518d-48e0-9ef9-05963012602e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:08.407596 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-246c13c0-7372-4527-afcb-601b1487d851 service neutron] http://10.222.0.35:9696/v2.0/extensions returned with HTTP 200 {{(pid=94347) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 18 08:38:08.408629 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-246c13c0-7372-4527-afcb-601b1487d851 service neutron] 10.222.0.35 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.1163669 Sep 18 08:38:08.423893 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6db30c02-518d-48e0-9ef9-05963012602e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:08.465237 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-afe7b9d9-26ab-409b-934e-2633ce9396e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528'] for port, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:08.509110 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-afe7b9d9-26ab-409b-934e-2633ce9396e8 admin admin] Network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:38:08.513277 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-afe7b9d9-26ab-409b-934e-2633ce9396e8 admin admin] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:38:08.519186 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [None req-afe7b9d9-26ab-409b-934e-2633ce9396e8 admin admin] Received port after_create {{(pid=94346) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:38:08.556629 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afe7b9d9-26ab-409b-934e-2633ce9396e8 admin admin] Pushing event updated for resources: {'Port': ['ID=b660dcf0-57cb-4753-901e-b44b4269de3e,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:08.561474 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d9365443-e446-447b-b9f1-13a29817a154 req-1ea4d8d0-abe3-4717-b0bd-d63c9cb2f082 service neutron] 10.222.0.35 "GET /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3974240 Sep 18 08:38:08.567282 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6db30c02-518d-48e0-9ef9-05963012602e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:08.570124 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6db30c02-518d-48e0-9ef9-05963012602e admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:08.571797 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-6db30c02-518d-48e0-9ef9-05963012602e admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/d454675e-bfb3-44e8-98f5-04152f224be5 HTTP/1.1" status: 204 len: 168 time: 0.2896852 Sep 18 08:38:08.602271 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-270fc634-01d3-441e-b9d3-9f2af01503e3 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-782366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-784982'] for router, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:08.628587 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6db30c02-518d-48e0-9ef9-05963012602e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d454675e-bfb3-44e8-98f5-04152f224be5,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:08.696434 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-15106862-be69-48c1-a142-78c7e9a46fed service neutron] 10.222.0.35 "GET /v2.0/networks/2c7737b5-792d-4a8d-bacc-cd5c180b7fc0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2778265 Sep 18 08:38:08.809390 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-afe7b9d9-26ab-409b-934e-2633ce9396e8 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:08.836447 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d9365443-e446-447b-b9f1-13a29817a154 req-24f6af93-74ba-4427-900d-57c56efd9676 service neutron] 10.222.0.35 "GET /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2647429 Sep 18 08:38:08.889435 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-22138f83-fbd6-4032-84ef-49eb42385350 service neutron] 10.222.0.35 "GET /v2.0/networks/2c7737b5-792d-4a8d-bacc-cd5c180b7fc0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1846392 Sep 18 08:38:08.924556 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-270fc634-01d3-441e-b9d3-9f2af01503e3 admin admin] Router 73ec8685-1119-4d34-a85d-af65c74d9e25 is scheduled to L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a with binding_index 1 {{(pid=94347) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 18 08:38:08.987185 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device f64a2ad2-4079-4e29-8c07-3f9846a145a8 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:38:09.122833 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 54114) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:09.161137 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port f64a2ad2-4079-4e29-8c07-3f9846a145a8 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:38:09.161550 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:09.164958 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-270fc634-01d3-441e-b9d3-9f2af01503e3 admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94347) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:38:09.181730 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] Sync routers for ids ['73ec8685-1119-4d34-a85d-af65c74d9e25'] in dv-cinder-804470-6-iscsi {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:38:09.182276 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f2d6a261-83fb-4df2-967e-f88a2eeca61a admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:09.192743 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-270fc634-01d3-441e-b9d3-9f2af01503e3 admin admin] Notify callbacks [] for router, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:09.197184 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-270fc634-01d3-441e-b9d3-9f2af01503e3 admin admin] 10.222.0.35 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 4.7322752 Sep 18 08:38:09.197360 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] Routers {'73ec8685-1119-4d34-a85d-af65c74d9e25'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:38:09.197360 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:37:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['73ec8685-1119-4d34-a85d-af65c74d9e25'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:38:09.197997 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 54122) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:09.218887 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-afe7b9d9-26ab-409b-934e-2633ce9396e8 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-782366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-784982'] for router, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:09.467833 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] Set router 73ec8685-1119-4d34-a85d-af65c74d9e25 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:38:09.525830 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7f7ab74e-4912-41ad-b1d3-6c348261b949 req-9e23a364-4bfd-470e-9d7e-be49e50abd5e tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 210 time: 0.0888748 Sep 18 08:38:09.672844 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2c33d08e-9f07-46f9-a8e9-6238f455460a req-fd135395-bdb0-44a2-9d82-b1a3e0968863 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 210 time: 0.0500841 Sep 18 08:38:09.724626 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-afe7b9d9-26ab-409b-934e-2633ce9396e8 admin admin] Router 98715ef0-5893-4888-ae9b-2e8029479489 is scheduled to L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a with binding_index 1 {{(pid=94346) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 18 08:38:09.728633 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f2d6a261-83fb-4df2-967e-f88a2eeca61a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:09.746100 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f2d6a261-83fb-4df2-967e-f88a2eeca61a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:09.899194 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2d6a261-83fb-4df2-967e-f88a2eeca61a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=40fe3252-7fdc-4569-9d36-4e846918116c,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:09.951361 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'name': 'tempest-AttachVolumeShelveTestJSON-230900396-router', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12'}], 'enable_snat': True}, 'gw_port_id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:04Z', 'updated_at': '2021-09-18T08:38:07Z', 'revision_number': 3, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'gw_port': {'id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:ed:50', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:05Z', 'updated_at': '2021-09-18T08:38:06Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:38:09.995106 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] Checking router: 73ec8685-1119-4d34-a85d-af65c74d9e25 for host: dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:38:09.995736 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] Updating router 73ec8685-1119-4d34-a85d-af65c74d9e25 port f6caa699-4d13-4268-b93e-c89e1dbaffb6 binding host dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 18 08:38:10.033821 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:10.044393 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-f2d6a261-83fb-4df2-967e-f88a2eeca61a admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=8f4823b523e24628a3697d9c4d543a16&name=default HTTP/1.1" status: 200 len: 2975 time: 0.9204600 Sep 18 08:38:10.048353 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 54176) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:10.109518 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-afe7b9d9-26ab-409b-934e-2633ce9396e8 admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94346) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:38:10.119859 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] Sync routers for ids ['98715ef0-5893-4888-ae9b-2e8029479489'] in dv-cinder-804470-6-iscsi {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:38:10.136805 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] Routers {'98715ef0-5893-4888-ae9b-2e8029479489'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:38:10.138710 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:37:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['98715ef0-5893-4888-ae9b-2e8029479489'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:38:10.165200 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-afe7b9d9-26ab-409b-934e-2633ce9396e8 admin admin] Notify callbacks [] for router, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:10.166485 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-afe7b9d9-26ab-409b-934e-2633ce9396e8 admin admin] 10.222.0.35 "POST /v2.0/routers HTTP/1.1" status: 201 len: 929 time: 3.3569627 Sep 18 08:38:10.169942 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 54186) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:10.329299 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] Set router 98715ef0-5893-4888-ae9b-2e8029479489 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:38:10.574139 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 54220) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:10.610921 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-63420a34-0559-42ad-a3c6-2fb61d1bfb60 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:10.619251 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9fc02a09-4394-44f8-ad42-81ba09125135 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:10.739669 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98715ef0-5893-4888-ae9b-2e8029479489', 'name': 'tempest-ServerRescueNegativeTestJSON-381458811-router', 'tenant_id': 'f439efa4eed0456ab2a914377e490fad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.70'}], 'enable_snat': True}, 'gw_port_id': 'b660dcf0-57cb-4753-901e-b44b4269de3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:06Z', 'updated_at': '2021-09-18T08:38:08Z', 'revision_number': 3, 'project_id': 'f439efa4eed0456ab2a914377e490fad', 'gw_port': {'id': 'b660dcf0-57cb-4753-901e-b44b4269de3e', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:33:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '98715ef0-5893-4888-ae9b-2e8029479489', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:07Z', 'updated_at': '2021-09-18T08:38:08Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:38:10.741569 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] Notify callbacks [] for port, precommit_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:10.761635 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:10.768472 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-89a59661-68bd-4590-a0a9-6f57645070a1 req-8e512bb6-ac8f-4292-a4ef-155617ed2717 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 210 time: 0.1055906 Sep 18 08:38:10.811874 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] Checking router: 98715ef0-5893-4888-ae9b-2e8029479489 for host: dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:38:10.812132 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] Updating router 98715ef0-5893-4888-ae9b-2e8029479489 port b660dcf0-57cb-4753-901e-b44b4269de3e binding host dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 18 08:38:10.816868 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-babbbb52-82bc-42b4-965a-e636a2aaf33b None None] Pushing event updated for resources: {'Port': ['ID=f6caa699-4d13-4268-b93e-c89e1dbaffb6,revision_number=2']} {{(pid=94349) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:10.829583 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-babbbb52-82bc-42b4-965a-e636a2aaf33b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:10.831038 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-babbbb52-82bc-42b4-965a-e636a2aaf33b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:10.831824 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-babbbb52-82bc-42b4-965a-e636a2aaf33b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:10.832372 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-babbbb52-82bc-42b4-965a-e636a2aaf33b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:10.833041 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-babbbb52-82bc-42b4-965a-e636a2aaf33b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:10.833630 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-babbbb52-82bc-42b4-965a-e636a2aaf33b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:10.834173 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-babbbb52-82bc-42b4-965a-e636a2aaf33b None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:10.834734 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-babbbb52-82bc-42b4-965a-e636a2aaf33b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:10.835308 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-babbbb52-82bc-42b4-965a-e636a2aaf33b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:10.835864 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-babbbb52-82bc-42b4-965a-e636a2aaf33b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:10.837669 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-babbbb52-82bc-42b4-965a-e636a2aaf33b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:10.838323 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-babbbb52-82bc-42b4-965a-e636a2aaf33b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-babbbb52-82bc-42b4-965a-e636a2aaf33b None None] Tracked resource versions report: Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: pushed versions: Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: { 'AddressGroup': {'1.2'}, Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: 'ConntrackHelper': {'1.0'}, Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: 'Log': {'1.0'}, Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: 'Network': {'1.1'}, Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: 'Port': {'1.7'}, Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: 'PortForwarding': {'1.2'}, Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: 'QosPolicy': {'1.9'}, Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: 'SecurityGroup': {'1.4'}, Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: 'SecurityGroupRule': {'1.2'}, Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: 'SubPort': {'1.0'}, Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: 'Subnet': {'1.1'}, Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: 'Trunk': {'1.1'}} Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: consumer versions: Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: { DHCP agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: HyperV agent@hv-cinder-80447: {}, Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: L3 agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: Metadata agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: Metering agent@dv-cinder-804470-6-iscsi: {}, Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: Open vSwitch agent@dv-cinder-804470-6-iscsi: { 'AddressGroup': '1.2', Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: 'ConntrackHelper': '1.0', Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: 'Log': '1.0', Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: 'Network': '1.1', Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: 'Port': '1.7', Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: 'PortForwarding': '1.2', Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: 'QosPolicy': '1.9', Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: 'SecurityGroup': '1.4', Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: 'SecurityGroupRule': '1.2', Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: 'SubPort': '1.0', Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: 'Subnet': '1.1', Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: 'Trunk': '1.1'}} Sep 18 08:38:10.839612 dv-cinder-804470-6-iscsi neutron-server[94349]: {{(pid=94349) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Sep 18 08:38:10.872962 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] Attempting to bind port f6caa699-4d13-4268-b93e-c89e1dbaffb6 on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:38:10.876576 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] Attempting to bind port f6caa699-4d13-4268-b93e-c89e1dbaffb6 by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}] {{(pid=94349) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:38:10.876841 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] Attempting to bind port f6caa699-4d13-4268-b93e-c89e1dbaffb6 on network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:38:10.894370 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 37, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:38:10.894762 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] Checking segment: {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94349) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:38:10.895193 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:10.895607 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] Bound using segment: {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'} {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:38:10.896083 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] Bound port: f6caa699-4d13-4268-b93e-c89e1dbaffb6, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}}] {{(pid=94349) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:38:10.896727 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:10.905540 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:11.047159 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.db [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] For port f6caa699-4d13-4268-b93e-c89e1dbaffb6, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94349) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:38:11.058739 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.db [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] For port f6caa699-4d13-4268-b93e-c89e1dbaffb6, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=f6caa699-4d13-4268-b93e-c89e1dbaffb6,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94349) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:38:11.072690 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:11.202161 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_common [None req-63420a34-0559-42ad-a3c6-2fb61d1bfb60 admin admin] Allocated IP 172.20.0.1 (f430397d-03a8-4da2-bd1d-25890a3a0727/acdeb8a1-5de9-425f-ae0a-890d310246e9/09652b84-a3b3-476f-815f-f0c78f8543ba) {{(pid=94347) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:38:11.213786 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-babbbb52-82bc-42b4-965a-e636a2aaf33b None None] Pushing event updated for resources: {'Port': ['ID=f6caa699-4d13-4268-b93e-c89e1dbaffb6,revision_number=3']} {{(pid=94349) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:11.229139 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] Routers {'73ec8685-1119-4d34-a85d-af65c74d9e25'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:38:11.233904 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:37:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['73ec8685-1119-4d34-a85d-af65c74d9e25'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:38:11.234684 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9fc02a09-4394-44f8-ad42-81ba09125135 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:11.285523 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-35677688-cb31-4f24-bfa4-f5a25bfadd8d admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:11.332158 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] Notify callbacks [] for port, precommit_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:11.348233 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:11.379701 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4a7e2705-b95f-4c9e-a1a4-23642e892a47 req-0f7b40f0-2b83-49e8-a11a-45d823d19b61 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 210 time: 0.1594133 Sep 18 08:38:11.417131 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2a9db1f-0d83-43e6-a2a1-934521cefcde None None] Pushing event updated for resources: {'Port': ['ID=b660dcf0-57cb-4753-901e-b44b4269de3e,revision_number=2']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:11.453095 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] Set router 73ec8685-1119-4d34-a85d-af65c74d9e25 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:38:11.453819 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-63420a34-0559-42ad-a3c6-2fb61d1bfb60 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:11.466184 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] Attempting to bind port b660dcf0-57cb-4753-901e-b44b4269de3e on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:38:11.466476 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] Attempting to bind port b660dcf0-57cb-4753-901e-b44b4269de3e by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:38:11.466951 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] Attempting to bind port b660dcf0-57cb-4753-901e-b44b4269de3e on network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:38:11.474313 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 37, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:38:11.475150 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] Checking segment: {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94348) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:38:11.475752 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:11.476319 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] Bound using segment: {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:38:11.478097 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] Bound port: b660dcf0-57cb-4753-901e-b44b4269de3e, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:38:11.478254 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:11.488997 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9fc02a09-4394-44f8-ad42-81ba09125135 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:11.491548 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9fc02a09-4394-44f8-ad42-81ba09125135 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:11.509097 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-9fc02a09-4394-44f8-ad42-81ba09125135 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/40fe3252-7fdc-4569-9d36-4e846918116c HTTP/1.1" status: 204 len: 168 time: 1.4438486 Sep 18 08:38:11.529054 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-774c6f96-ee7f-45b5-b323-3cbf96302010 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:11.592087 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fc02a09-4394-44f8-ad42-81ba09125135 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=40fe3252-7fdc-4569-9d36-4e846918116c,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:11.673575 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] For port b660dcf0-57cb-4753-901e-b44b4269de3e, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94348) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:38:11.679130 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] For port b660dcf0-57cb-4753-901e-b44b4269de3e, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=b660dcf0-57cb-4753-901e-b44b4269de3e,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94348) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:38:11.689421 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:11.693503 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-63420a34-0559-42ad-a3c6-2fb61d1bfb60 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528'] for port, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:11.757246 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] Routers {'98715ef0-5893-4888-ae9b-2e8029479489'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:38:11.757645 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:37:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['98715ef0-5893-4888-ae9b-2e8029479489'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:38:11.793968 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'name': 'tempest-AttachVolumeShelveTestJSON-230900396-router', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12'}], 'enable_snat': True}, 'gw_port_id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:04Z', 'updated_at': '2021-09-18T08:38:07Z', 'revision_number': 3, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'gw_port': {'id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:ed:50', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:05Z', 'updated_at': '2021-09-18T08:38:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:38:11.820035 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-63420a34-0559-42ad-a3c6-2fb61d1bfb60 admin admin] Network f430397d-03a8-4da2-bd1d-25890a3a0727 is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:38:11.830314 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2a9db1f-0d83-43e6-a2a1-934521cefcde None None] Pushing event updated for resources: {'Port': ['ID=b660dcf0-57cb-4753-901e-b44b4269de3e,revision_number=3']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:11.834751 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [None req-63420a34-0559-42ad-a3c6-2fb61d1bfb60 admin admin] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:38:11.842848 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63420a34-0559-42ad-a3c6-2fb61d1bfb60 admin admin] Received port after_create {{(pid=94347) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:38:11.843391 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-63420a34-0559-42ad-a3c6-2fb61d1bfb60 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-785025'] for router_interface, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:11.847016 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-35677688-cb31-4f24-bfa4-f5a25bfadd8d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:11.861777 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-85e16fd7-5e5b-4e62-b469-1c8a6fe348e8 None None] The sync data for ids ['73ec8685-1119-4d34-a85d-af65c74d9e25'] in dv-cinder-804470-6-iscsi is: [{'id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'name': 'tempest-AttachVolumeShelveTestJSON-230900396-router', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12'}], 'enable_snat': True}, 'gw_port_id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:04Z', 'updated_at': '2021-09-18T08:38:07Z', 'revision_number': 3, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'gw_port': {'id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:ed:50', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:05Z', 'updated_at': '2021-09-18T08:38:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}] {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:38:11.880433 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_common [None req-774c6f96-ee7f-45b5-b323-3cbf96302010 admin admin] Allocated IP 172.20.0.1 (fdcbc66e-323e-4b44-be97-566949f4f2ef/e5dc6eef-e778-41a2-a708-c7810ade97db/5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e) {{(pid=94346) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:38:11.971086 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-35677688-cb31-4f24-bfa4-f5a25bfadd8d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:11.983448 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63420a34-0559-42ad-a3c6-2fb61d1bfb60 admin admin] Pushing event updated for resources: {'Port': ['ID=09652b84-a3b3-476f-815f-f0c78f8543ba,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:12.028477 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] Set router 98715ef0-5893-4888-ae9b-2e8029479489 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:38:12.071573 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-774c6f96-ee7f-45b5-b323-3cbf96302010 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:12.116385 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-774c6f96-ee7f-45b5-b323-3cbf96302010 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528'] for port, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:12.123862 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 54276) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:12.124605 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-35677688-cb31-4f24-bfa4-f5a25bfadd8d admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=6f7ecf22d54e4125b196e7418227f33d&name=default HTTP/1.1" status: 200 len: 2975 time: 1.5476038 Sep 18 08:38:12.127138 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6cd32847-4712-4d47-aa97-a11714792b2a req-3aef2b03-ee00-43c4-9a4b-7a77b7be5421 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 210 time: 0.0804126 Sep 18 08:38:12.188893 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35677688-cb31-4f24-bfa4-f5a25bfadd8d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4fa43af1-093d-4e9d-b130-01b53dff047b,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:12.219714 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-774c6f96-ee7f-45b5-b323-3cbf96302010 admin admin] Network fdcbc66e-323e-4b44-be97-566949f4f2ef is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:38:12.224184 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-774c6f96-ee7f-45b5-b323-3cbf96302010 admin admin] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:38:12.239061 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [None req-774c6f96-ee7f-45b5-b323-3cbf96302010 admin admin] Received port after_create {{(pid=94346) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:38:12.239817 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-774c6f96-ee7f-45b5-b323-3cbf96302010 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-785025'] for router_interface, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:12.249303 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-e12772d3-7958-4876-9660-02a106b62d50 None None] Provisioning complete for port 09652b84-a3b3-476f-815f-f0c78f8543ba triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:38:12.250460 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-e12772d3-7958-4876-9660-02a106b62d50 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:12.333231 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-e12772d3-7958-4876-9660-02a106b62d50 None None] Port 09652b84-a3b3-476f-815f-f0c78f8543ba cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:38:12.380416 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-63420a34-0559-42ad-a3c6-2fb61d1bfb60 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:12.407860 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-774c6f96-ee7f-45b5-b323-3cbf96302010 admin admin] Pushing event updated for resources: {'Port': ['ID=5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:12.440409 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d423900d-f565-409e-838c-5e9d368c679d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:12.477375 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d423900d-f565-409e-838c-5e9d368c679d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:12.493682 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98715ef0-5893-4888-ae9b-2e8029479489', 'name': 'tempest-ServerRescueNegativeTestJSON-381458811-router', 'tenant_id': 'f439efa4eed0456ab2a914377e490fad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.70'}], 'enable_snat': True}, 'gw_port_id': 'b660dcf0-57cb-4753-901e-b44b4269de3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:06Z', 'updated_at': '2021-09-18T08:38:08Z', 'revision_number': 3, 'project_id': 'f439efa4eed0456ab2a914377e490fad', 'gw_port': {'id': 'b660dcf0-57cb-4753-901e-b44b4269de3e', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:33:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '98715ef0-5893-4888-ae9b-2e8029479489', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:07Z', 'updated_at': '2021-09-18T08:38:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:38:12.553784 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-204521e6-35da-42ea-a1dd-f4e5c32dca1b None None] The sync data for ids ['98715ef0-5893-4888-ae9b-2e8029479489'] in dv-cinder-804470-6-iscsi is: [{'id': '98715ef0-5893-4888-ae9b-2e8029479489', 'name': 'tempest-ServerRescueNegativeTestJSON-381458811-router', 'tenant_id': 'f439efa4eed0456ab2a914377e490fad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.70'}], 'enable_snat': True}, 'gw_port_id': 'b660dcf0-57cb-4753-901e-b44b4269de3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:06Z', 'updated_at': '2021-09-18T08:38:08Z', 'revision_number': 3, 'project_id': 'f439efa4eed0456ab2a914377e490fad', 'gw_port': {'id': 'b660dcf0-57cb-4753-901e-b44b4269de3e', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:33:bb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '98715ef0-5893-4888-ae9b-2e8029479489', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:07Z', 'updated_at': '2021-09-18T08:38:11Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}] {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:38:12.581762 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d423900d-f565-409e-838c-5e9d368c679d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:12.584538 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d423900d-f565-409e-838c-5e9d368c679d admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:12.585844 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-d423900d-f565-409e-838c-5e9d368c679d admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/4fa43af1-093d-4e9d-b130-01b53dff047b HTTP/1.1" status: 204 len: 168 time: 0.4438281 Sep 18 08:38:12.605991 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-774c6f96-ee7f-45b5-b323-3cbf96302010 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:12.657143 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d423900d-f565-409e-838c-5e9d368c679d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4fa43af1-093d-4e9d-b130-01b53dff047b,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:12.798075 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-35c9cb42-569f-49be-869f-9f305ccf6c1e req-40ef3fad-b943-49af-a7ad-04cfb49ce4a2 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 210 time: 0.0931442 Sep 18 08:38:12.840976 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-63420a34-0559-42ad-a3c6-2fb61d1bfb60 admin admin] Notify callbacks [] for port, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:12.855363 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-63420a34-0559-42ad-a3c6-2fb61d1bfb60 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:12.856754 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-63420a34-0559-42ad-a3c6-2fb61d1bfb60 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-580051', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-783377'] for router_interface, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:13.012595 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device f6caa699-4d13-4268-b93e-c89e1dbaffb6 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:38:13.028144 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63420a34-0559-42ad-a3c6-2fb61d1bfb60 admin admin] Pushing event updated for resources: {'Port': ['ID=09652b84-a3b3-476f-815f-f0c78f8543ba,revision_number=2']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:13.036151 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-774c6f96-ee7f-45b5-b323-3cbf96302010 admin admin] Notify callbacks [] for port, precommit_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:13.046333 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-774c6f96-ee7f-45b5-b323-3cbf96302010 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:13.047606 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-774c6f96-ee7f-45b5-b323-3cbf96302010 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-580051', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-783377'] for router_interface, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:13.070557 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-63420a34-0559-42ad-a3c6-2fb61d1bfb60 admin admin] Network f430397d-03a8-4da2-bd1d-25890a3a0727 is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:38:13.072067 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [None req-63420a34-0559-42ad-a3c6-2fb61d1bfb60 admin admin] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:38:13.157558 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port f6caa699-4d13-4268-b93e-c89e1dbaffb6 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:38:13.158107 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:13.198238 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-774c6f96-ee7f-45b5-b323-3cbf96302010 admin admin] Pushing event updated for resources: {'Port': ['ID=5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e,revision_number=2']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:13.297874 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-774c6f96-ee7f-45b5-b323-3cbf96302010 admin admin] Network fdcbc66e-323e-4b44-be97-566949f4f2ef is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:38:13.299714 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-774c6f96-ee7f-45b5-b323-3cbf96302010 admin admin] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:38:13.333077 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-63420a34-0559-42ad-a3c6-2fb61d1bfb60 admin admin] Router 73ec8685-1119-4d34-a85d-af65c74d9e25 has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94347) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:38:13.350795 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 54308) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:13.383623 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-120a2d43-a3bf-4ad3-9032-fe616b1e7a73 req-74605abd-3aed-41ec-9435-01274148afa9 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 210 time: 0.0435848 Sep 18 08:38:13.408570 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c42e25bc-383f-4ee1-8a84-438f0c3254aa admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:13.449580 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:13.492484 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-536c997d-2873-442a-81bf-9fe918803742 None None] For port f6caa699-4d13-4268-b93e-c89e1dbaffb6, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=f6caa699-4d13-4268-b93e-c89e1dbaffb6,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:38:13.525942 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-56840659-c4d1-4a9c-b629-0c99dfa42713 None None] Provisioning complete for port 09652b84-a3b3-476f-815f-f0c78f8543ba triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:38:13.526097 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-56840659-c4d1-4a9c-b629-0c99dfa42713 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:13.527970 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:13.555058 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-774c6f96-ee7f-45b5-b323-3cbf96302010 admin admin] Router 98715ef0-5893-4888-ae9b-2e8029479489 has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94346) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:38:13.637051 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Pushing event updated for resources: {'Port': ['ID=f6caa699-4d13-4268-b93e-c89e1dbaffb6,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:13.647942 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-56840659-c4d1-4a9c-b629-0c99dfa42713 None None] Port 09652b84-a3b3-476f-815f-f0c78f8543ba cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:38:13.694948 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-63420a34-0559-42ad-a3c6-2fb61d1bfb60 admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94347) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:38:13.717624 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-63420a34-0559-42ad-a3c6-2fb61d1bfb60 admin admin] 10.222.0.35 "PUT /v2.0/routers/73ec8685-1119-4d34-a85d-af65c74d9e25/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.5101850 Sep 18 08:38:13.733721 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-774c6f96-ee7f-45b5-b323-3cbf96302010 admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94346) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:38:13.743562 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-774c6f96-ee7f-45b5-b323-3cbf96302010 admin admin] 10.222.0.35 "PUT /v2.0/routers/98715ef0-5893-4888-ae9b-2e8029479489/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.5723784 Sep 18 08:38:13.764878 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c42e25bc-383f-4ee1-8a84-438f0c3254aa admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:13.772851 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c42e25bc-383f-4ee1-8a84-438f0c3254aa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:13.815018 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c42e25bc-383f-4ee1-8a84-438f0c3254aa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=15e0e290-361b-4316-bd84-21fecee6feb0,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:13.830077 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-c42e25bc-383f-4ee1-8a84-438f0c3254aa admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=35a13a5819d64089aa81af9064e90d3e&name=default HTTP/1.1" status: 200 len: 2975 time: 0.4490411 Sep 18 08:38:13.832771 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 54330) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:13.921375 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-fcdbbfef-b9a9-42ab-b6f2-c05d276a3895 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:13.944919 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-fcdbbfef-b9a9-42ab-b6f2-c05d276a3895 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:13.979983 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-50ef6fbc-294f-4352-bf63-7def9ce9f9c5 req-0250d757-b733-443c-80d9-9774eee84c08 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 210 time: 0.0687034 Sep 18 08:38:14.028580 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-fcdbbfef-b9a9-42ab-b6f2-c05d276a3895 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:14.033603 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-fcdbbfef-b9a9-42ab-b6f2-c05d276a3895 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:14.035162 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-fcdbbfef-b9a9-42ab-b6f2-c05d276a3895 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/15e0e290-361b-4316-bd84-21fecee6feb0 HTTP/1.1" status: 204 len: 168 time: 0.2011869 Sep 18 08:38:14.054125 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcdbbfef-b9a9-42ab-b6f2-c05d276a3895 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=15e0e290-361b-4316-bd84-21fecee6feb0,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:14.576790 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 54364) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:14.583033 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-ed23d3fa-8a0d-418b-99e8-5edb151d94d7 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Request body: {'security_group': {'name': 'tempest-securitygroup--785451278', 'description': 'tempest-description--363509274'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:14.640300 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ed23d3fa-8a0d-418b-99e8-5edb151d94d7 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:14.700152 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1921beaa-9255-473e-ad34-f0604793036f req-0254f8ab-3dea-462c-a68f-7f43e634e4f0 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 210 time: 0.0311670 Sep 18 08:38:14.838109 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ed23d3fa-8a0d-418b-99e8-5edb151d94d7 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:14.846698 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ed23d3fa-8a0d-418b-99e8-5edb151d94d7 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:14.876843 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ed23d3fa-8a0d-418b-99e8-5edb151d94d7 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:14.879043 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-ed23d3fa-8a0d-418b-99e8-5edb151d94d7 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1776 time: 0.3006518 Sep 18 08:38:14.885995 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 54394) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:14.900521 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-f0b75767-b0fb-48d4-a181-1bf493bd5888 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Request body: {'security_group_rule': {'security_group_id': '45b78aa4-0988-48f2-8caf-b16f679dcdf8', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:14.936432 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed23d3fa-8a0d-418b-99e8-5edb151d94d7 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Pushing event updated for resources: {'SecurityGroup': ['ID=45b78aa4-0988-48f2-8caf-b16f679dcdf8,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:14.939691 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-0bc6895b-4182-4590-81ce-f371b8545d46 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:14.948759 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-0bc6895b-4182-4590-81ce-f371b8545d46 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/networks?id=fdcbc66e-323e-4b44-be97-566949f4f2ef HTTP/1.1" status: 200 len: 818 time: 0.2475772 Sep 18 08:38:14.962512 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-a99eadc9-398a-414f-a632-a5e30565f74f tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/quotas/f439efa4eed0456ab2a914377e490fad HTTP/1.1" status: 200 len: 375 time: 0.0122709 Sep 18 08:38:14.972568 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] Sync routers for ids ['73ec8685-1119-4d34-a85d-af65c74d9e25'] in dv-cinder-804470-6-iscsi {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:38:14.984379 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] Routers {'73ec8685-1119-4d34-a85d-af65c74d9e25'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:38:14.988582 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:37:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['73ec8685-1119-4d34-a85d-af65c74d9e25'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:38:15.076205 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device b660dcf0-57cb-4753-901e-b44b4269de3e up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:38:15.208498 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port b660dcf0-57cb-4753-901e-b44b4269de3e triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:38:15.209119 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:15.285419 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-f0b75767-b0fb-48d4-a181-1bf493bd5888 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:15.310422 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dbe27a2a-da7d-40b5-a037-cee2f9b64175 req-f0b060bf-7b05-436d-8284-d050c7afa6d9 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 210 time: 0.0931153 Sep 18 08:38:15.444936 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-39c78052-eaa8-45a4-8915-91b345baa5c2 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?tenant_id=f439efa4eed0456ab2a914377e490fad&fields=id HTTP/1.1" status: 200 len: 255 time: 0.4601362 Sep 18 08:38:15.489990 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] Set router 73ec8685-1119-4d34-a85d-af65c74d9e25 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:38:15.514732 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:15.544138 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-536c997d-2873-442a-81bf-9fe918803742 None None] For port b660dcf0-57cb-4753-901e-b44b4269de3e, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=b660dcf0-57cb-4753-901e-b44b4269de3e,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:38:15.551723 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] Sync routers for ids ['98715ef0-5893-4888-ae9b-2e8029479489'] in dv-cinder-804470-6-iscsi {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:38:15.557901 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:15.559553 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device f6caa699-4d13-4268-b93e-c89e1dbaffb6 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:38:15.612211 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] Routers {'98715ef0-5893-4888-ae9b-2e8029479489'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:38:15.613174 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:37:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['98715ef0-5893-4888-ae9b-2e8029479489'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:38:15.724614 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Pushing event updated for resources: {'Port': ['ID=b660dcf0-57cb-4753-901e-b44b4269de3e,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:15.733069 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port f6caa699-4d13-4268-b93e-c89e1dbaffb6 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:38:15.734076 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:15.782677 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-fcaeccd5-5a99-44f0-9772-9d4b153dcd6c service neutron] 10.222.0.35 "GET /v2.0/networks/fdcbc66e-323e-4b44-be97-566949f4f2ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3075414 Sep 18 08:38:15.824657 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-f0b75767-b0fb-48d4-a181-1bf493bd5888 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:15.845252 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 54438) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:15.847565 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-f0b75767-b0fb-48d4-a181-1bf493bd5888 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-561193'] for security_group_rule, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:15.945905 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-f0b75767-b0fb-48d4-a181-1bf493bd5888 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:15.953117 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 54442) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:15.957984 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-da5b040f-dd27-4828-b59b-74002c4016ec tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Request body: {'security_group_rule': {'security_group_id': '45b78aa4-0988-48f2-8caf-b16f679dcdf8', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:15.958379 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-f0b75767-b0fb-48d4-a181-1bf493bd5888 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.0702631 Sep 18 08:38:16.026417 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-da5b040f-dd27-4828-b59b-74002c4016ec tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:16.031984 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'name': 'tempest-AttachVolumeShelveTestJSON-230900396-router', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12'}], 'enable_snat': True}, 'gw_port_id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:04Z', 'updated_at': '2021-09-18T08:38:12Z', 'revision_number': 4, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'gw_port': {'id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:ed:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:05Z', 'updated_at': '2021-09-18T08:38:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '09652b84-a3b3-476f-815f-f0c78f8543ba', 'name': '', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'mac_address': 'fa:16:3e:20:cb:6e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:10Z', 'updated_at': '2021-09-18T08:38:12Z', 'revision_number': 2, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'subnets': [{'id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:38:16.084871 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] Checking router: 73ec8685-1119-4d34-a85d-af65c74d9e25 for host: dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:38:16.086020 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] Updating router 73ec8685-1119-4d34-a85d-af65c74d9e25 port 09652b84-a3b3-476f-815f-f0c78f8543ba binding host dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 18 08:38:16.122817 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:16.158711 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0b75767-b0fb-48d4-a181-1bf493bd5888 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=32db6b3b-0824-4584-93cd-c2e996113dad,revision_number=0']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:16.245651 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-eb0f36ae-7635-40d5-be94-62fcae5164b6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:16.255055 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] Set router 98715ef0-5893-4888-ae9b-2e8029479489 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:38:16.289241 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-da5b040f-dd27-4828-b59b-74002c4016ec tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:16.308988 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-da5b040f-dd27-4828-b59b-74002c4016ec tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-561193'] for security_group_rule, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:16.319508 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fc0ffe63-cecd-44b2-af11-a8675ab6112f req-cacf02b6-5675-4918-821a-7ebe3b89fd16 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 210 time: 0.3891823 Sep 18 08:38:16.418709 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-4aef28e8-cc2c-4c6e-a631-d16910bcff51 service neutron] 10.222.0.35 "GET /v2.0/networks/fdcbc66e-323e-4b44-be97-566949f4f2ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6247649 Sep 18 08:38:16.576631 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-eb0f36ae-7635-40d5-be94-62fcae5164b6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:16.649319 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] Notify callbacks [] for port, precommit_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:16.655243 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-eb0f36ae-7635-40d5-be94-62fcae5164b6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:16.657883 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-880465cd-915b-4069-a98f-42171fe383e5 req-c16839f1-566e-43f2-a281-62c0b99fba6d tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 210 time: 0.1317542 Sep 18 08:38:16.668600 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:16.671075 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da5b040f-dd27-4828-b59b-74002c4016ec tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7bafa538-0c78-46db-8936-09de9e7c0e4f,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:16.707046 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-da5b040f-dd27-4828-b59b-74002c4016ec tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:16.711333 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-da5b040f-dd27-4828-b59b-74002c4016ec tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.7554698 Sep 18 08:38:16.715109 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 54466) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:16.722636 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-be298f69-81d9-4dba-a349-98e2637f7681 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Request body: {'floatingip': {'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:16.809954 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-eb0f36ae-7635-40d5-be94-62fcae5164b6 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=7240ef365e8749678510cde21a0ca857&name=default HTTP/1.1" status: 200 len: 2975 time: 0.9598284 Sep 18 08:38:16.810434 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb0f36ae-7635-40d5-be94-62fcae5164b6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9acc9652-7a43-4856-a7bb-fb98a71aa444,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:16.815368 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 54474) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:16.901512 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dd828ce0-ba36-4a44-a019-5cb8ae6395c2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:16.961374 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dd828ce0-ba36-4a44-a019-5cb8ae6395c2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:16.983158 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29387745-1f45-4859-8352-a83294f76604 None None] Pushing event updated for resources: {'Port': ['ID=09652b84-a3b3-476f-815f-f0c78f8543ba,revision_number=3']} {{(pid=94349) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:17.093023 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] Attempting to bind port 09652b84-a3b3-476f-815f-f0c78f8543ba on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:38:17.094066 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] Attempting to bind port 09652b84-a3b3-476f-815f-f0c78f8543ba by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': '34c1fb08-1711-4a8c-a899-35eb41628d5a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 214, 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727'}] {{(pid=94349) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:38:17.094394 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] Attempting to bind port 09652b84-a3b3-476f-815f-f0c78f8543ba on network f430397d-03a8-4da2-bd1d-25890a3a0727 {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:38:17.102669 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0c1a9aed-0133-4a76-afc1-6e9488209fdd req-140be3a6-5cab-4226-9728-7e6c57b919e2 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 210 time: 0.2608111 Sep 18 08:38:17.111415 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 37, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:38:17.111803 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] Checking segment: {'id': '34c1fb08-1711-4a8c-a899-35eb41628d5a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 214, 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94349) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:38:17.112516 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:17.113114 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] Bound using segment: {'id': '34c1fb08-1711-4a8c-a899-35eb41628d5a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 214, 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727'} {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:38:17.113780 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] Bound port: 09652b84-a3b3-476f-815f-f0c78f8543ba, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '34c1fb08-1711-4a8c-a899-35eb41628d5a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 214, 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727'}}] {{(pid=94349) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:38:17.114371 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:17.116757 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-be298f69-81d9-4dba-a349-98e2637f7681 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for floatingip, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:17.197784 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.13', 59044) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:17.283144 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.db [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] For port 09652b84-a3b3-476f-815f-f0c78f8543ba, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94349) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:38:17.311875 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.db [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] For port 09652b84-a3b3-476f-815f-f0c78f8543ba, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=09652b84-a3b3-476f-815f-f0c78f8543ba,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94349) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:38:17.325705 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:17.421385 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] Routers {'73ec8685-1119-4d34-a85d-af65c74d9e25'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:38:17.422413 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:37:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['73ec8685-1119-4d34-a85d-af65c74d9e25'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:38:17.486890 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device b660dcf0-57cb-4753-901e-b44b4269de3e up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:38:17.628773 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] Set router 73ec8685-1119-4d34-a85d-af65c74d9e25 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:38:17.775895 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-13e0f64c-6815-4cb5-86d9-49002f58b4ee None None] Provisioning complete for port 09652b84-a3b3-476f-815f-f0c78f8543ba triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:38:17.776304 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-13e0f64c-6815-4cb5-86d9-49002f58b4ee None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:17.800337 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 54520) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:17.814023 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1958a3fc-465e-4252-a853-1c03ef6f059e req-4bb07b60-234c-48d2-b22c-23be66b455f3 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 210 time: 0.1364598 Sep 18 08:38:17.900463 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98715ef0-5893-4888-ae9b-2e8029479489', 'name': 'tempest-ServerRescueNegativeTestJSON-381458811-router', 'tenant_id': 'f439efa4eed0456ab2a914377e490fad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.70'}], 'enable_snat': True}, 'gw_port_id': 'b660dcf0-57cb-4753-901e-b44b4269de3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:06Z', 'updated_at': '2021-09-18T08:38:12Z', 'revision_number': 4, 'project_id': 'f439efa4eed0456ab2a914377e490fad', 'gw_port': {'id': 'b660dcf0-57cb-4753-901e-b44b4269de3e', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:33:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98715ef0-5893-4888-ae9b-2e8029479489', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:07Z', 'updated_at': '2021-09-18T08:38:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e', 'name': '', 'network_id': 'fdcbc66e-323e-4b44-be97-566949f4f2ef', 'tenant_id': 'f439efa4eed0456ab2a914377e490fad', 'mac_address': 'fa:16:3e:17:5a:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '98715ef0-5893-4888-ae9b-2e8029479489', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': 'e5dc6eef-e778-41a2-a708-c7810ade97db', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:11Z', 'updated_at': '2021-09-18T08:38:12Z', 'revision_number': 2, 'project_id': 'f439efa4eed0456ab2a914377e490fad', 'subnets': [{'id': 'e5dc6eef-e778-41a2-a708-c7810ade97db', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:38:17.943142 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] Checking router: 98715ef0-5893-4888-ae9b-2e8029479489 for host: dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:38:17.943985 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] Updating router 98715ef0-5893-4888-ae9b-2e8029479489 port 5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e binding host dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 18 08:38:17.949810 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port b660dcf0-57cb-4753-901e-b44b4269de3e triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:38:17.950183 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:17.971793 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29387745-1f45-4859-8352-a83294f76604 None None] Pushing event updated for resources: {'Port': ['ID=09652b84-a3b3-476f-815f-f0c78f8543ba,revision_number=4']} {{(pid=94349) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:18.015676 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:18.030781 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a58c4784-ea61-4ee0-93aa-132d2aeee326 req-8e6f0a1d-1398-42a9-a812-bf1dc860db13 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 210 time: 0.0600960 Sep 18 08:38:18.095387 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-d1823c29-78ac-4884-82c9-e0c51f06d88a tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:18.103663 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-d1823c29-78ac-4884-82c9-e0c51f06d88a tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/networks?id=fdcbc66e-323e-4b44-be97-566949f4f2ef HTTP/1.1" status: 200 len: 818 time: 0.3623552 Sep 18 08:38:18.105030 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-13e0f64c-6815-4cb5-86d9-49002f58b4ee None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:18.115140 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-be298f69-81d9-4dba-a349-98e2637f7681 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:18.140130 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7cba12ec-d112-4185-a5dc-a574b98667c2 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:18.141785 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'name': 'tempest-AttachVolumeShelveTestJSON-230900396-router', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12'}], 'enable_snat': True}, 'gw_port_id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:04Z', 'updated_at': '2021-09-18T08:38:12Z', 'revision_number': 4, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'gw_port': {'id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:ed:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:05Z', 'updated_at': '2021-09-18T08:38:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '09652b84-a3b3-476f-815f-f0c78f8543ba', 'name': '', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'mac_address': 'fa:16:3e:20:cb:6e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:10Z', 'updated_at': '2021-09-18T08:38:17Z', 'revision_number': 4, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'subnets': [{'id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:38:18.144129 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9365443-e446-447b-b9f1-13a29817a154 req-d4ea1f6d-d59a-4c28-94e5-54ea05c63f7d tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:18.145795 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-d9365443-e446-447b-b9f1-13a29817a154 req-d4ea1f6d-d59a-4c28-94e5-54ea05c63f7d tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.13 "GET /v2.0/networks?id=fe2753d3-7f3b-4739-adbf-6643a840c73e HTTP/1.1" status: 200 len: 815 time: 0.9454877 Sep 18 08:38:18.145912 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-a289b5f0-81f0-425a-9442-6270c7060d37 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/quotas/f439efa4eed0456ab2a914377e490fad HTTP/1.1" status: 200 len: 375 time: 0.0411727 Sep 18 08:38:18.158322 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dd828ce0-ba36-4a44-a019-5cb8ae6395c2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:18.162450 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dd828ce0-ba36-4a44-a019-5cb8ae6395c2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:18.164198 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-dd828ce0-ba36-4a44-a019-5cb8ae6395c2 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/9acc9652-7a43-4856-a7bb-fb98a71aa444 HTTP/1.1" status: 204 len: 168 time: 1.3471026 Sep 18 08:38:18.185880 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0ac14c73-dfdc-43e3-a092-4b0ca3ce1712 None None] The sync data for ids ['73ec8685-1119-4d34-a85d-af65c74d9e25'] in dv-cinder-804470-6-iscsi is: [{'id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'name': 'tempest-AttachVolumeShelveTestJSON-230900396-router', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12'}], 'enable_snat': True}, 'gw_port_id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:04Z', 'updated_at': '2021-09-18T08:38:12Z', 'revision_number': 4, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'gw_port': {'id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:ed:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:05Z', 'updated_at': '2021-09-18T08:38:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '09652b84-a3b3-476f-815f-f0c78f8543ba', 'name': '', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'mac_address': 'fa:16:3e:20:cb:6e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:10Z', 'updated_at': '2021-09-18T08:38:17Z', 'revision_number': 4, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'subnets': [{'id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:38:18.196033 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd828ce0-ba36-4a44-a019-5cb8ae6395c2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9acc9652-7a43-4856-a7bb-fb98a71aa444,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:18.249293 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-13e0f64c-6815-4cb5-86d9-49002f58b4ee None None] For port 09652b84-a3b3-476f-815f-f0c78f8543ba, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=09652b84-a3b3-476f-815f-f0c78f8543ba,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:38:18.291670 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-13e0f64c-6815-4cb5-86d9-49002f58b4ee None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:18.369803 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-fcfb1856-9785-42cc-a3e9-fe04b0df3c36 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?tenant_id=f439efa4eed0456ab2a914377e490fad&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2168870 Sep 18 08:38:18.373341 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13e0f64c-6815-4cb5-86d9-49002f58b4ee None None] Pushing event updated for resources: {'Port': ['ID=09652b84-a3b3-476f-815f-f0c78f8543ba,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:18.433278 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_common [None req-be298f69-81d9-4dba-a349-98e2637f7681 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Allocated IP 172.27.1.138 (2e3b3f85-63e4-4380-917a-8c90c80b3e38/cd525bb9-7f93-490c-a5d6-a08911817e54/3ccf98ca-0f0c-4ff7-905d-66e17f9de63d) {{(pid=94347) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:38:18.448715 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-1c7c925d-14ae-44c2-963c-68d298f44f94 None None] Provisioning complete for port 09652b84-a3b3-476f-815f-f0c78f8543ba triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:38:18.449034 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-1c7c925d-14ae-44c2-963c-68d298f44f94 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:18.588676 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 54534) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:18.590068 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-476782c1-1928-487f-905f-d6e8414689dc service neutron] 10.222.0.35 "GET /v2.0/networks/fdcbc66e-323e-4b44-be97-566949f4f2ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2193384 Sep 18 08:38:18.604205 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-9d733d7d-19eb-4240-8c60-5a37dd26afcb admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:18.619421 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] Notify callbacks [] for port, precommit_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:18.627959 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:18.681274 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e7ed4d4-de0a-4061-ad97-f7e1ba00d8d5 None None] Pushing event updated for resources: {'Port': ['ID=5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e,revision_number=3']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:18.693180 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7cba12ec-d112-4185-a5dc-a574b98667c2 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:18.704245 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7cba12ec-d112-4185-a5dc-a574b98667c2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:18.734902 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-be298f69-81d9-4dba-a349-98e2637f7681 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for port, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:18.755395 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] Attempting to bind port 5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:38:18.755823 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] Attempting to bind port 5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': 'cb92e74f-7545-44c8-a2d3-634d116af362', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 204, 'network_id': 'fdcbc66e-323e-4b44-be97-566949f4f2ef'}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:38:18.756196 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] Attempting to bind port 5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e on network fdcbc66e-323e-4b44-be97-566949f4f2ef {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:38:18.763989 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 37, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:38:18.764975 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] Checking segment: {'id': 'cb92e74f-7545-44c8-a2d3-634d116af362', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 204, 'network_id': 'fdcbc66e-323e-4b44-be97-566949f4f2ef'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94348) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:38:18.765090 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:18.765517 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] Bound using segment: {'id': 'cb92e74f-7545-44c8-a2d3-634d116af362', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 204, 'network_id': 'fdcbc66e-323e-4b44-be97-566949f4f2ef'} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:38:18.766067 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] Bound port: 5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'cb92e74f-7545-44c8-a2d3-634d116af362', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 204, 'network_id': 'fdcbc66e-323e-4b44-be97-566949f4f2ef'}}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:38:18.766483 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:18.791710 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-ac852b7e-a280-49d1-9331-fb443770b004 service neutron] 10.222.0.35 "GET /v2.0/networks/fdcbc66e-323e-4b44-be97-566949f4f2ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2007136 Sep 18 08:38:18.794200 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-7cba12ec-d112-4185-a5dc-a574b98667c2 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=c2df37fdca5c4fadb7ce84bcd86eaf87&name=default HTTP/1.1" status: 200 len: 2979 time: 0.9780757 Sep 18 08:38:18.796759 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cba12ec-d112-4185-a5dc-a574b98667c2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b196dbb0-f4cd-472f-80a7-3564cdc491e1,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:18.800440 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 54536) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:18.816646 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-9d733d7d-19eb-4240-8c60-5a37dd26afcb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:18.823413 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-9d733d7d-19eb-4240-8c60-5a37dd26afcb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:18.855319 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] For port 5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94348) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:38:18.859079 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] For port 5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e,segment=NetworkSegment(cb92e74f-7545-44c8-a2d3-634d116af362),segment_id=cb92e74f-7545-44c8-a2d3-634d116af362)] {{(pid=94348) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:38:18.865945 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:18.909866 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-9d733d7d-19eb-4240-8c60-5a37dd26afcb admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=de43a3993198459b8d91af2a4a259d10&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3194625 Sep 18 08:38:18.912365 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 54540) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:18.925644 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-be298f69-81d9-4dba-a349-98e2637f7681 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528'] for port, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:18.925958 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] Routers {'98715ef0-5893-4888-ae9b-2e8029479489'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:38:18.926752 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:37:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['98715ef0-5893-4888-ae9b-2e8029479489'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:38:18.942656 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d733d7d-19eb-4240-8c60-5a37dd26afcb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=28ca3edf-8054-4822-93ff-4751e1924353,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:19.040848 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be298f69-81d9-4dba-a349-98e2637f7681 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Pushing event updated for resources: {'Port': ['ID=3ccf98ca-0f0c-4ff7-905d-66e17f9de63d,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:19.050059 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be298f69-81d9-4dba-a349-98e2637f7681 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:38:19.059781 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [None req-be298f69-81d9-4dba-a349-98e2637f7681 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:38:19.066951 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e7ed4d4-de0a-4061-ad97-f7e1ba00d8d5 None None] Pushing event updated for resources: {'Port': ['ID=5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:19.118059 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be298f69-81d9-4dba-a349-98e2637f7681 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Received port after_create {{(pid=94347) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:38:19.123636 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c0c218d5-44b3-4585-9d75-bc3c27ad127f req-0e3b7346-33ed-48b5-954f-8cb8e2db2977 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 210 time: 0.0690188 Sep 18 08:38:19.125420 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-84ee8a95-6219-4ae0-b882-5cf18a2c930f req-17422b51-de0b-426b-a176-05300d202165 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 210 time: 0.1670060 Sep 18 08:38:19.141773 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] Set router 98715ef0-5893-4888-ae9b-2e8029479489 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:38:19.214725 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-be298f69-81d9-4dba-a349-98e2637f7681 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for floatingip, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:19.226130 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-f7ade559-028c-4385-89ab-5f5c199845b2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:19.250171 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-f7ade559-028c-4385-89ab-5f5c199845b2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:19.432534 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 09652b84-a3b3-476f-815f-f0c78f8543ba up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:38:19.485846 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0a648f5c-fe3f-4197-a1ee-e568e7dedbca req-5c9691ea-9b0a-41c8-b841-02950bc5b211 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 210 time: 0.1997373 Sep 18 08:38:19.501522 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-be298f69-81d9-4dba-a349-98e2637f7681 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:19.503456 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-72e69011-8c26-456c-b5d3-d9c60718573e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:19.540984 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-f7ade559-028c-4385-89ab-5f5c199845b2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:19.543442 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-f7ade559-028c-4385-89ab-5f5c199845b2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:19.545030 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-f7ade559-028c-4385-89ab-5f5c199845b2 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/b196dbb0-f4cd-472f-80a7-3564cdc491e1 HTTP/1.1" status: 204 len: 168 time: 0.7318764 Sep 18 08:38:19.576645 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7ade559-028c-4385-89ab-5f5c199845b2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b196dbb0-f4cd-472f-80a7-3564cdc491e1,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:19.584273 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-72e69011-8c26-456c-b5d3-d9c60718573e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:19.608680 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 09652b84-a3b3-476f-815f-f0c78f8543ba triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:38:19.609287 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:19.691779 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-72e69011-8c26-456c-b5d3-d9c60718573e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:19.698068 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-72e69011-8c26-456c-b5d3-d9c60718573e admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:19.699346 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-72e69011-8c26-456c-b5d3-d9c60718573e admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/28ca3edf-8054-4822-93ff-4751e1924353 HTTP/1.1" status: 204 len: 168 time: 0.7858322 Sep 18 08:38:19.721340 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-befa0329-0344-40aa-a5ee-0d0b4e5e4aa3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:19.743037 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:19.760888 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98715ef0-5893-4888-ae9b-2e8029479489', 'name': 'tempest-ServerRescueNegativeTestJSON-381458811-router', 'tenant_id': 'f439efa4eed0456ab2a914377e490fad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.70'}], 'enable_snat': True}, 'gw_port_id': 'b660dcf0-57cb-4753-901e-b44b4269de3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:06Z', 'updated_at': '2021-09-18T08:38:12Z', 'revision_number': 4, 'project_id': 'f439efa4eed0456ab2a914377e490fad', 'gw_port': {'id': 'b660dcf0-57cb-4753-901e-b44b4269de3e', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:33:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98715ef0-5893-4888-ae9b-2e8029479489', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:07Z', 'updated_at': '2021-09-18T08:38:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e', 'name': '', 'network_id': 'fdcbc66e-323e-4b44-be97-566949f4f2ef', 'tenant_id': 'f439efa4eed0456ab2a914377e490fad', 'mac_address': 'fa:16:3e:17:5a:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '98715ef0-5893-4888-ae9b-2e8029479489', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': 'e5dc6eef-e778-41a2-a708-c7810ade97db', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:11Z', 'updated_at': '2021-09-18T08:38:18Z', 'revision_number': 4, 'project_id': 'f439efa4eed0456ab2a914377e490fad', 'subnets': [{'id': 'e5dc6eef-e778-41a2-a708-c7810ade97db', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:38:19.767437 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-be298f69-81d9-4dba-a349-98e2637f7681 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for port, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:19.775682 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72e69011-8c26-456c-b5d3-d9c60718573e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=28ca3edf-8054-4822-93ff-4751e1924353,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:19.783034 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-be298f69-81d9-4dba-a349-98e2637f7681 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:19.809381 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bcbec805-4719-4f57-9a03-c4e9e2dbb501 None None] The sync data for ids ['98715ef0-5893-4888-ae9b-2e8029479489'] in dv-cinder-804470-6-iscsi is: [{'id': '98715ef0-5893-4888-ae9b-2e8029479489', 'name': 'tempest-ServerRescueNegativeTestJSON-381458811-router', 'tenant_id': 'f439efa4eed0456ab2a914377e490fad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.70'}], 'enable_snat': True}, 'gw_port_id': 'b660dcf0-57cb-4753-901e-b44b4269de3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:06Z', 'updated_at': '2021-09-18T08:38:12Z', 'revision_number': 4, 'project_id': 'f439efa4eed0456ab2a914377e490fad', 'gw_port': {'id': 'b660dcf0-57cb-4753-901e-b44b4269de3e', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:33:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98715ef0-5893-4888-ae9b-2e8029479489', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:07Z', 'updated_at': '2021-09-18T08:38:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e', 'name': '', 'network_id': 'fdcbc66e-323e-4b44-be97-566949f4f2ef', 'tenant_id': 'f439efa4eed0456ab2a914377e490fad', 'mac_address': 'fa:16:3e:17:5a:d7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '98715ef0-5893-4888-ae9b-2e8029479489', 'device_owner': 'network:router_interface', 'standard_attr_id': 81, 'fixed_ips': [{'subnet_id': 'e5dc6eef-e778-41a2-a708-c7810ade97db', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:11Z', 'updated_at': '2021-09-18T08:38:18Z', 'revision_number': 4, 'project_id': 'f439efa4eed0456ab2a914377e490fad', 'subnets': [{'id': 'e5dc6eef-e778-41a2-a708-c7810ade97db', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:38:19.818897 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-be298f69-81d9-4dba-a349-98e2637f7681 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-784908'] for floatingip, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:19.848485 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be298f69-81d9-4dba-a349-98e2637f7681 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Pushing event updated for resources: {'Port': ['ID=3ccf98ca-0f0c-4ff7-905d-66e17f9de63d,revision_number=2']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:19.853755 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-be298f69-81d9-4dba-a349-98e2637f7681 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for floatingip, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:19.855237 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-be298f69-81d9-4dba-a349-98e2637f7681 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 3.1387539 Sep 18 08:38:20.121045 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 54586) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:20.136071 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b9660cb0-1c85-4b59-b89f-526b0c23c4fa admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:20.242401 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-0ca26f90-6278-4ee2-80e7-f4fea708ddce tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?name=tempest-securitygroup--785451278&fields=id&tenant_id=0700a96e9b3f48e8b6bcdd75b820b813 HTTP/1.1" status: 200 len: 267 time: 0.0818813 Sep 18 08:38:20.261125 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-234e5fbf-e3ee-43cf-b5b6-348aaae2830a req-93cc9915-a269-4cfc-8f07-0950413a0195 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 210 time: 0.0404198 Sep 18 08:38:20.392070 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1fffc1f2-bccf-410a-ba0e-85e2286693b4 req-c988791b-c3f8-4463-9dd0-c221acc3450b tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 210 time: 0.0440996 Sep 18 08:38:20.438035 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b9660cb0-1c85-4b59-b89f-526b0c23c4fa admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:20.445815 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-f9a15036-0ea0-4ff8-ac25-8cd5b640807d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:20.447351 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-f9a15036-0ea0-4ff8-ac25-8cd5b640807d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/networks?id=f430397d-03a8-4da2-bd1d-25890a3a0727 HTTP/1.1" status: 200 len: 816 time: 0.1887772 Sep 18 08:38:20.448902 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b9660cb0-1c85-4b59-b89f-526b0c23c4fa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:20.493945 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-3231dc2a-6f92-4e8f-bdab-ade687c60276 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/quotas/0700a96e9b3f48e8b6bcdd75b820b813 HTTP/1.1" status: 200 len: 375 time: 0.0344479 Sep 18 08:38:20.517778 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-b9660cb0-1c85-4b59-b89f-526b0c23c4fa admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=911a3120487e473fb4a419aa2494280d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3955665 Sep 18 08:38:20.518504 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9660cb0-1c85-4b59-b89f-526b0c23c4fa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6720ef4a-6797-410b-89e3-2e74883de1c4,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:20.525729 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 54608) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:20.574974 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-804410fc-5eed-4c34-bf1d-06e9927e0c36 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?tenant_id=0700a96e9b3f48e8b6bcdd75b820b813&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0711684 Sep 18 08:38:20.631657 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-32cdefec-2f50-4130-96a9-42187b79a5ad admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:20.653588 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c4959f2d-3b59-4e9f-9c05-cf1b9fbf3eb1 req-05adca43-b3c2-4822-9abc-dc2ee4f784f0 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 210 time: 0.0497029 Sep 18 08:38:20.654575 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-32cdefec-2f50-4130-96a9-42187b79a5ad admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:20.735154 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-32cdefec-2f50-4130-96a9-42187b79a5ad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:20.737717 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-32cdefec-2f50-4130-96a9-42187b79a5ad admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:20.745866 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-32cdefec-2f50-4130-96a9-42187b79a5ad admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/6720ef4a-6797-410b-89e3-2e74883de1c4 HTTP/1.1" status: 204 len: 168 time: 0.2167616 Sep 18 08:38:20.768618 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-9a2660fe-1d43-4d0e-a3c7-d963bb38b1cc service neutron] 10.222.0.35 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1758270 Sep 18 08:38:20.769403 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32cdefec-2f50-4130-96a9-42187b79a5ad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6720ef4a-6797-410b-89e3-2e74883de1c4,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:20.885914 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-335ce921-a50a-478e-be58-31edd4da3c86 service neutron] 10.222.0.35 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1099091 Sep 18 08:38:21.101091 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ec76f4ce-dc74-4021-822b-2a6a74803e6e req-c743ece8-c75d-4daf-84ee-68a9b5c40f07 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0506074 Sep 18 08:38:21.270546 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [req-d9365443-e446-447b-b9f1-13a29817a154 req-c44ce0a9-408f-47fd-b5f8-4813334284d6 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Request body: {'port': {'device_id': '1c2476c0-3321-4eb3-a42d-df9f52eeb4f8', 'network_id': 'fe2753d3-7f3b-4739-adbf-6643a840c73e', 'admin_state_up': True, 'tenant_id': '38bd82e43ad3497aa14e8e4e68a29009'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:21.427594 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:38:21.504734 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-99822f71-eb31-43e2-9b2f-1fe62dc4d03f req-8ccdc451-b5fb-4446-a595-13d449c92b47 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 210 time: 0.0663567 Sep 18 08:38:21.559644 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:38:21.560169 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:21.575598 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.13', 59050) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:21.581838 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bc0c3504-63f2-4f90-8618-e106f3b54bb5 req-5b667608-6194-4a39-b6a9-e66e9748a3ef tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 210 time: 0.0409200 Sep 18 08:38:21.790293 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:21.832300 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-536c997d-2873-442a-81bf-9fe918803742 None None] For port 5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e,segment=NetworkSegment(cb92e74f-7545-44c8-a2d3-634d116af362),segment_id=cb92e74f-7545-44c8-a2d3-634d116af362)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:38:21.842918 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:21.854494 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-40153be5-5691-4f85-9920-2590ace50031 req-44df5dd0-95ba-471d-939b-2b44491e0456 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 210 time: 0.0484068 Sep 18 08:38:21.909462 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-4f7db97d-f38b-40af-b61a-d41acc3e5837 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:21.910978 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-4f7db97d-f38b-40af-b61a-d41acc3e5837 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.13 "GET /v2.0/networks?id=2c7737b5-792d-4a8d-bacc-cd5c180b7fc0 HTTP/1.1" status: 200 len: 812 time: 0.3338702 Sep 18 08:38:21.940310 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-8bf9c6a7-5d28-495b-867b-13d42bd708d3 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Request body: {'port': {'device_id': '6cd27eb8-8447-40a0-9229-d59ec6008eeb', 'network_id': '2c7737b5-792d-4a8d-bacc-cd5c180b7fc0', 'admin_state_up': True, 'tenant_id': '79ab1eeea623437e8ca702571b96da7d'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:22.014345 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Pushing event updated for resources: {'Port': ['ID=5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:22.026869 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d9365443-e446-447b-b9f1-13a29817a154 req-c44ce0a9-408f-47fd-b5f8-4813334284d6 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Made reservation on behalf of 38bd82e43ad3497aa14e8e4e68a29009 for: {'port': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:38:22.031441 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [req-d9365443-e446-447b-b9f1-13a29817a154 req-c44ce0a9-408f-47fd-b5f8-4813334284d6 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:22.244285 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-239ed290-fcd6-4cb7-83c2-acea555aa774 req-0fc5e8d4-4bbd-450d-89fe-b76f7632122d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0405946 Sep 18 08:38:22.418776 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-8703f338-d357-43ae-bdcd-b0bf0bb522e7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:22.425659 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_common [req-d9365443-e446-447b-b9f1-13a29817a154 req-c44ce0a9-408f-47fd-b5f8-4813334284d6 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Allocated IP 172.20.0.10 (fe2753d3-7f3b-4739-adbf-6643a840c73e/b96e08ba-91b8-4c1f-bd27-4a1270ccbde2/9a4f8ce9-f706-4c25-b3f4-05f2173cf516) {{(pid=94346) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:38:22.447145 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-8bf9c6a7-5d28-495b-867b-13d42bd708d3 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Made reservation on behalf of 79ab1eeea623437e8ca702571b96da7d for: {'port': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:38:22.454758 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-8bf9c6a7-5d28-495b-867b-13d42bd708d3 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:22.745720 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b7a9953a-69ae-4787-a169-3a2037aaf7a3 req-3b0d0d56-12e6-49ab-bb8e-a43915ab31e7 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 210 time: 0.0741818 Sep 18 08:38:22.791622 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_common [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-8bf9c6a7-5d28-495b-867b-13d42bd708d3 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Allocated IP 172.20.0.5 (2c7737b5-792d-4a8d-bacc-cd5c180b7fc0/9ed653e4-68a0-4108-b090-7571bdc067bc/324203bb-e8cc-4392-974c-20b4f2896cc6) {{(pid=94346) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:38:22.841483 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b27c83c0-5a22-49a4-a79c-edaceb8bdce8 req-c4ad037e-6504-4f5a-ba0e-fd6683deaf7c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 210 time: 0.0680127 Sep 18 08:38:22.894359 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [req-d9365443-e446-447b-b9f1-13a29817a154 req-c44ce0a9-408f-47fd-b5f8-4813334284d6 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks [] for port, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:23.106439 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-59bb6792-290c-479f-b667-cd2f0dcf8284 req-a35b02bc-8e84-4cc4-b167-4c46268a0388 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 210 time: 0.0692923 Sep 18 08:38:23.116563 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [req-d9365443-e446-447b-b9f1-13a29817a154 req-c44ce0a9-408f-47fd-b5f8-4813334284d6 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528'] for port, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:23.176728 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d9365443-e446-447b-b9f1-13a29817a154 req-c44ce0a9-408f-47fd-b5f8-4813334284d6 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Network fe2753d3-7f3b-4739-adbf-6643a840c73e is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:38:23.192724 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:23.261509 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [req-d9365443-e446-447b-b9f1-13a29817a154 req-c44ce0a9-408f-47fd-b5f8-4813334284d6 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:38:23.265548 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [req-d9365443-e446-447b-b9f1-13a29817a154 req-c44ce0a9-408f-47fd-b5f8-4813334284d6 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Received port after_create {{(pid=94346) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:38:23.282814 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9365443-e446-447b-b9f1-13a29817a154 req-c44ce0a9-408f-47fd-b5f8-4813334284d6 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:23.284877 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [req-d9365443-e446-447b-b9f1-13a29817a154 req-c44ce0a9-408f-47fd-b5f8-4813334284d6 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for port, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:23.289894 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:38:23.368578 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-d9365443-e446-447b-b9f1-13a29817a154 req-c44ce0a9-408f-47fd-b5f8-4813334284d6 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.1050687 Sep 18 08:38:23.403787 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c44ce0a9-408f-47fd-b5f8-4813334284d6 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Pushing event updated for resources: {'Port': ['ID=9a4f8ce9-f706-4c25-b3f4-05f2173cf516,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:23.480150 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-8bf9c6a7-5d28-495b-867b-13d42bd708d3 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Notify callbacks [] for port, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:23.511096 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9456c15f-bb6b-4c1a-ab56-500388c461a3 req-bda30bb7-aa0b-4db1-958a-51fb4d61c633 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0641160 Sep 18 08:38:23.520598 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:38:23.521735 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:23.535682 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:23.563253 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-8bf9c6a7-5d28-495b-867b-13d42bd708d3 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528'] for port, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:23.624869 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-8bf9c6a7-5d28-495b-867b-13d42bd708d3 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Network 2c7737b5-792d-4a8d-bacc-cd5c180b7fc0 is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:38:23.628478 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-8bf9c6a7-5d28-495b-867b-13d42bd708d3 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:38:23.652765 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-8bf9c6a7-5d28-495b-867b-13d42bd708d3 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Received port after_create {{(pid=94346) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:38:23.660853 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-8bf9c6a7-5d28-495b-867b-13d42bd708d3 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:23.661688 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-8bf9c6a7-5d28-495b-867b-13d42bd708d3 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for port, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:23.697883 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bf9c6a7-5d28-495b-867b-13d42bd708d3 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Pushing event updated for resources: {'Port': ['ID=324203bb-e8cc-4392-974c-20b4f2896cc6,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:23.707257 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-8bf9c6a7-5d28-495b-867b-13d42bd708d3 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.7766061 Sep 18 08:38:23.831549 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 54768) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:23.926322 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7a5b46d-8888-44f8-96e3-e086213655ae req-75a30b32-938e-416d-9ae1-a20a337d6144 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:23.935419 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b7a5b46d-8888-44f8-96e3-e086213655ae req-75a30b32-938e-416d-9ae1-a20a337d6144 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 932 time: 0.1140344 Sep 18 08:38:24.022831 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b7a5b46d-8888-44f8-96e3-e086213655ae req-77232cc0-5a1f-42a4-aad5-2d36b5c67b4f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0860658 Sep 18 08:38:24.065264 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6d0a27f1-f474-4da8-a0d6-8bb34f933bed req-67c84e67-8038-4ac3-a545-49b54a03d001 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 210 time: 0.0927343 Sep 18 08:38:24.111805 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-dc2d2416-3d63-4d73-b798-0573b8d335e0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:24.269867 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6042e05c-f3c6-43b2-981f-f3684d11f0d1 req-8a800d98-014f-4b38-81b6-95aa0aa48b63 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:24.277156 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6042e05c-f3c6-43b2-981f-f3684d11f0d1 req-8a800d98-014f-4b38-81b6-95aa0aa48b63 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 931 time: 0.0953896 Sep 18 08:38:24.337554 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6042e05c-f3c6-43b2-981f-f3684d11f0d1 req-42089bb9-c158-4910-a873-d64b10d23d65 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595565 Sep 18 08:38:24.344708 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-dc2d2416-3d63-4d73-b798-0573b8d335e0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:24.350315 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-dc2d2416-3d63-4d73-b798-0573b8d335e0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:24.389327 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-dc2d2416-3d63-4d73-b798-0573b8d335e0 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=e82126a551fd4ce3b70c083a82c83a93&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5561595 Sep 18 08:38:24.390809 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc2d2416-3d63-4d73-b798-0573b8d335e0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=225615b7-76b6-4907-b8e8-097657acf07b,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:24.392130 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 54786) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:24.479783 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1d65a483-5c48-4eca-a3fd-e5f45dfb4492 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:24.512686 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1d65a483-5c48-4eca-a3fd-e5f45dfb4492 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:24.585158 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1d65a483-5c48-4eca-a3fd-e5f45dfb4492 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:24.589878 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1d65a483-5c48-4eca-a3fd-e5f45dfb4492 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:24.596973 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-1d65a483-5c48-4eca-a3fd-e5f45dfb4492 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/225615b7-76b6-4907-b8e8-097657acf07b HTTP/1.1" status: 204 len: 168 time: 0.2020817 Sep 18 08:38:24.607418 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d65a483-5c48-4eca-a3fd-e5f45dfb4492 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=225615b7-76b6-4907-b8e8-097657acf07b,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:24.684086 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d532e372-aa29-4719-a66c-e8bbf948b6df req-34b69ade-7e5f-4ad0-99b1-7b78c8228ed9 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0432818 Sep 18 08:38:24.850448 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:24.862571 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 54812) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:24.968679 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-fc8c5e83-9298-4fbe-b89c-a42d181ff27e admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:25.066578 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-fc8c5e83-9298-4fbe-b89c-a42d181ff27e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:25.075386 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-fc8c5e83-9298-4fbe-b89c-a42d181ff27e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:25.132396 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-fc8c5e83-9298-4fbe-b89c-a42d181ff27e admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=c45783a849b54e77abb06938128a3971&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2686460 Sep 18 08:38:25.133989 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc8c5e83-9298-4fbe-b89c-a42d181ff27e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3f2d4df4-7f82-413b-a7c2-ac41b73b98df,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:25.135795 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 54836) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:25.209895 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8b2484fe-a095-48d5-ae63-4213eaed2f0d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:25.227821 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b2e05af-9f4e-4030-bec4-e0d3d185907f req-2044aae6-576d-46d2-a85c-7d9b62eae9da tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:25.229841 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3b2e05af-9f4e-4030-bec4-e0d3d185907f req-2044aae6-576d-46d2-a85c-7d9b62eae9da tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 932 time: 0.0914087 Sep 18 08:38:25.240086 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8b2484fe-a095-48d5-ae63-4213eaed2f0d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:25.259395 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7b40206d-de4e-4e3e-9993-74edd2c1d205 req-c4c7da70-378f-45aa-914d-7df024bf82b7 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 210 time: 0.0611243 Sep 18 08:38:25.310985 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8b2484fe-a095-48d5-ae63-4213eaed2f0d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:25.317248 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8b2484fe-a095-48d5-ae63-4213eaed2f0d admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:25.317248 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-8b2484fe-a095-48d5-ae63-4213eaed2f0d admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/3f2d4df4-7f82-413b-a7c2-ac41b73b98df HTTP/1.1" status: 204 len: 168 time: 0.1779363 Sep 18 08:38:25.329314 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b2484fe-a095-48d5-ae63-4213eaed2f0d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3f2d4df4-7f82-413b-a7c2-ac41b73b98df,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:25.340673 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3b2e05af-9f4e-4030-bec4-e0d3d185907f req-ec2683ba-1fe6-447f-b239-0f70a5be7244 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0904408 Sep 18 08:38:25.539458 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4c2eb9e-5d32-4d0f-a9ef-a55ec9ac264e req-293ad5d1-01bd-4a36-85fb-29ae5e315627 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:25.554196 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d4c2eb9e-5d32-4d0f-a9ef-a55ec9ac264e req-293ad5d1-01bd-4a36-85fb-29ae5e315627 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 931 time: 0.0907724 Sep 18 08:38:25.620276 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d4c2eb9e-5d32-4d0f-a9ef-a55ec9ac264e req-248d9804-9a73-4202-aa30-8ec82840b4ba tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0614436 Sep 18 08:38:25.808363 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a47de89f-98b1-485e-8b39-f5a694d90d97 req-137b6595-d9a0-4656-b232-3b07fdb3a08c tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0430136 Sep 18 08:38:26.267962 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 54896) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:26.357033 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f661548a-8a31-4261-bb92-ee8fc0e06c86 req-aea48cbb-0a38-4cf9-8f6f-11dbabe154a5 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 210 time: 0.0336878 Sep 18 08:38:26.407727 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-2d2eeea6-368b-4ec4-914c-06c17e5dc30f admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-451596550-network', 'tenant_id': '194467b22f734d23a65c96d5dbd1e0d9'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:26.434410 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2d2eeea6-368b-4ec4-914c-06c17e5dc30f admin admin] Made reservation on behalf of 194467b22f734d23a65c96d5dbd1e0d9 for: {'network': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:38:26.436757 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-2d2eeea6-368b-4ec4-914c-06c17e5dc30f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for network, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:26.476103 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31497ecf-2489-42d7-ba1c-4894f3da2369 req-6c637fa2-a8e8-4906-a7a0-fccfd1838ba8 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:26.478213 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-31497ecf-2489-42d7-ba1c-4894f3da2369 req-6c637fa2-a8e8-4906-a7a0-fccfd1838ba8 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 932 time: 0.0496914 Sep 18 08:38:26.519261 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-31497ecf-2489-42d7-ba1c-4894f3da2369 req-cca5e213-301d-4c5c-a08b-e55daa4bf0b2 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0349905 Sep 18 08:38:26.587732 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-2d2eeea6-368b-4ec4-914c-06c17e5dc30f admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:26.703131 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-2d2eeea6-368b-4ec4-914c-06c17e5dc30f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:26.714142 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-2d2eeea6-368b-4ec4-914c-06c17e5dc30f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:26.747227 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2d2eeea6-368b-4ec4-914c-06c17e5dc30f admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 202} {{(pid=94346) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 18 08:38:26.750978 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4ecead2-20da-4488-be3a-8bfc535c1878 req-d27914c0-2d88-4126-b1ce-87e47dfcc0ae tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:26.754037 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d2eeea6-368b-4ec4-914c-06c17e5dc30f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b8a35b47-7bc7-439e-8307-03e2d007d096,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:26.759784 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e4ecead2-20da-4488-be3a-8bfc535c1878 req-d27914c0-2d88-4126-b1ce-87e47dfcc0ae tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 931 time: 0.0712030 Sep 18 08:38:26.778107 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-2d2eeea6-368b-4ec4-914c-06c17e5dc30f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:26.778853 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.db.segments_db [None req-2d2eeea6-368b-4ec4-914c-06c17e5dc30f admin admin] Added segment 1ece11a5-9769-4131-8d01-eddf33fc8c95 of type vlan for network 2cf40b42-ccb1-46ae-8b65-919b9aca813d Sep 18 08:38:26.810043 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e4ecead2-20da-4488-be3a-8bfc535c1878 req-934fd80c-ac23-4f4e-afd5-bb26b98a53ab tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0490870 Sep 18 08:38:26.841163 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-2d2eeea6-368b-4ec4-914c-06c17e5dc30f admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732885226527'] for network, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:26.871646 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-2d2eeea6-368b-4ec4-914c-06c17e5dc30f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for network, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:26.872622 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2d2eeea6-368b-4ec4-914c-06c17e5dc30f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:26.873236 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-2d2eeea6-368b-4ec4-914c-06c17e5dc30f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:26.904139 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-2d2eeea6-368b-4ec4-914c-06c17e5dc30f admin admin] 10.222.0.35 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 0.6329129 Sep 18 08:38:26.904939 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 54928) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:26.922918 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-a41031b0-a36d-455f-b921-32ed7c7521bd admin admin] Request body: {'subnet': {'network_id': '2cf40b42-ccb1-46ae-8b65-919b9aca813d', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-451596550-subnet', 'tenant_id': '194467b22f734d23a65c96d5dbd1e0d9', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:26.940312 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d2eeea6-368b-4ec4-914c-06c17e5dc30f admin admin] Pushing event updated for resources: {'Network': ['ID=2cf40b42-ccb1-46ae-8b65-919b9aca813d,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:26.949148 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a39681ac-5b92-41d8-abec-4b4e7301e7e4 req-1f1c5e1b-88a7-407f-bdac-a54231f09899 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0462778 Sep 18 08:38:26.951609 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Network 2cf40b42-ccb1-46ae-8b65-919b9aca813d details requested by agent ovs-agent-dv-cinder-804470-6-iscsi with host dv-cinder-804470-6-iscsi {{(pid=94348) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 18 08:38:26.984924 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a41031b0-a36d-455f-b921-32ed7c7521bd admin admin] Made reservation on behalf of 194467b22f734d23a65c96d5dbd1e0d9 for: {'subnet': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:38:26.987791 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a41031b0-a36d-455f-b921-32ed7c7521bd admin admin] Notify callbacks [] for subnet, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:27.201086 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a41031b0-a36d-455f-b921-32ed7c7521bd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for subnet, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:27.267562 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a41031b0-a36d-455f-b921-32ed7c7521bd admin admin] Pushing event updated for resources: {'Subnet': ['ID=ac237a01-d0d2-4e71-82a8-f713001c6a87,revision_number=0']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:27.279167 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a41031b0-a36d-455f-b921-32ed7c7521bd admin admin] Checking segment: {'id': '1ece11a5-9769-4131-8d01-eddf33fc8c95', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 202, 'network_id': '2cf40b42-ccb1-46ae-8b65-919b9aca813d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94347) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:38:27.279597 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a41031b0-a36d-455f-b921-32ed7c7521bd admin admin] Network hostable DHCP agents. Network: 2cf40b42-ccb1-46ae-8b65-919b9aca813d, hostable agents: ['6aaa6222-6d04-44a7-b807-bfc2cbd3e99f'], hosted agents: [] {{(pid=94347) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 18 08:38:27.305702 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a41031b0-a36d-455f-b921-32ed7c7521bd admin admin] Network 2cf40b42-ccb1-46ae-8b65-919b9aca813d is scheduled to be hosted by DHCP agent 6aaa6222-6d04-44a7-b807-bfc2cbd3e99f with binding_index 1 {{(pid=94347) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 18 08:38:27.323576 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [None req-a41031b0-a36d-455f-b921-32ed7c7521bd admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804470-6-iscsi, 2cf40b42-ccb1-46ae-8b65-919b9aca813d) {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:38:27.341888 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bf04bccc-cf88-4a99-86f7-2e200e466efd None None] Network 2cf40b42-ccb1-46ae-8b65-919b9aca813d requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:38:27.342328 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a41031b0-a36d-455f-b921-32ed7c7521bd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:27.342960 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a41031b0-a36d-455f-b921-32ed7c7521bd admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for subnet, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:27.369875 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-a41031b0-a36d-455f-b921-32ed7c7521bd admin admin] 10.222.0.35 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 0.4574528 Sep 18 08:38:27.531909 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7ddfc76e-4291-4444-a98f-68df1ec18402 req-cbec218a-7a18-4260-bf76-6cd19d871db5 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 210 time: 0.0538299 Sep 18 08:38:27.559977 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1a7fbd19-0b95-40c6-8ce4-6606cb0613e4 None None] Network 2cf40b42-ccb1-46ae-8b65-919b9aca813d requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:38:27.669797 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05f965b7-79e1-4568-8e7b-adec3d487e8d req-07e440ea-9204-428b-bc45-c02062f7da8d tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:27.672426 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-05f965b7-79e1-4568-8e7b-adec3d487e8d req-07e440ea-9204-428b-bc45-c02062f7da8d tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 932 time: 0.0749915 Sep 18 08:38:27.720764 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-05f965b7-79e1-4568-8e7b-adec3d487e8d req-2f9d8072-10bc-4e09-839d-ef4b599a0360 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428565 Sep 18 08:38:27.914831 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6dcccd6-d4bd-424d-aed0-d2c2a58e05c5 req-249f78fd-4233-4c44-bb8e-b08eeddec3a5 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:27.916352 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d6dcccd6-d4bd-424d-aed0-d2c2a58e05c5 req-249f78fd-4233-4c44-bb8e-b08eeddec3a5 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 931 time: 0.0497134 Sep 18 08:38:27.960194 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d6dcccd6-d4bd-424d-aed0-d2c2a58e05c5 req-7cc620ce-dfd9-4db7-a644-96ace567108f tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0365653 Sep 18 08:38:28.049705 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-73532db4-35a6-4be7-8baa-a515fae33e33 req-8decd324-6e98-46fc-a89d-ee545470cc78 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0292690 Sep 18 08:38:28.069372 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 54962) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:28.074619 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-3ebe85b2-42c8-499a-95a5-f4190b94c0df admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1765696777-network', 'tenant_id': '7723834dc2e8422791296737427f3a8a'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:28.095315 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3ebe85b2-42c8-499a-95a5-f4190b94c0df admin admin] Made reservation on behalf of 7723834dc2e8422791296737427f3a8a for: {'network': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:38:28.097837 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3ebe85b2-42c8-499a-95a5-f4190b94c0df admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for network, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:28.106557 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3ebe85b2-42c8-499a-95a5-f4190b94c0df admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:28.204090 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3ebe85b2-42c8-499a-95a5-f4190b94c0df admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:28.208546 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3ebe85b2-42c8-499a-95a5-f4190b94c0df admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:28.247101 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3ebe85b2-42c8-499a-95a5-f4190b94c0df admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 234} {{(pid=94346) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 18 08:38:28.253295 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ebe85b2-42c8-499a-95a5-f4190b94c0df admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=33ed553d-1c92-4029-92da-bbfa8cfeef79,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:28.259711 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3ebe85b2-42c8-499a-95a5-f4190b94c0df admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:28.260053 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.db.segments_db [None req-3ebe85b2-42c8-499a-95a5-f4190b94c0df admin admin] Added segment bed9e8ce-3832-4d39-85d7-c715c7f7c48d of type vlan for network 58cca6bb-59a6-4d0d-be36-f45d900aa288 Sep 18 08:38:28.301143 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3ebe85b2-42c8-499a-95a5-f4190b94c0df admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732885226527'] for network, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:28.323294 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3ebe85b2-42c8-499a-95a5-f4190b94c0df admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for network, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:28.324437 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ebe85b2-42c8-499a-95a5-f4190b94c0df admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:28.325048 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3ebe85b2-42c8-499a-95a5-f4190b94c0df admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:28.359906 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-3ebe85b2-42c8-499a-95a5-f4190b94c0df admin admin] 10.222.0.35 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.2889516 Sep 18 08:38:28.362760 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 54964) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:28.367785 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-a3347ad1-05c5-4fa9-804f-1bf147421444 admin admin] Request body: {'subnet': {'network_id': '58cca6bb-59a6-4d0d-be36-f45d900aa288', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1765696777-subnet', 'tenant_id': '7723834dc2e8422791296737427f3a8a', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:28.387707 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a3347ad1-05c5-4fa9-804f-1bf147421444 admin admin] Made reservation on behalf of 7723834dc2e8422791296737427f3a8a for: {'subnet': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:38:28.390117 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a3347ad1-05c5-4fa9-804f-1bf147421444 admin admin] Notify callbacks [] for subnet, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:28.397978 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ebe85b2-42c8-499a-95a5-f4190b94c0df admin admin] Pushing event updated for resources: {'Network': ['ID=58cca6bb-59a6-4d0d-be36-f45d900aa288,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:28.409156 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Network 58cca6bb-59a6-4d0d-be36-f45d900aa288 details requested by agent ovs-agent-dv-cinder-804470-6-iscsi with host dv-cinder-804470-6-iscsi {{(pid=94348) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 18 08:38:28.583415 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a3347ad1-05c5-4fa9-804f-1bf147421444 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for subnet, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:28.652709 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7afd7c02-402b-403c-9cd2-eea83019bb3f req-34cbed76-4c18-4172-abc3-e49cb14d8391 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 210 time: 0.0403192 Sep 18 08:38:28.660143 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3347ad1-05c5-4fa9-804f-1bf147421444 admin admin] Pushing event updated for resources: {'Subnet': ['ID=81620f62-97e2-49fa-8e5c-3ab2216a4db7,revision_number=0']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:28.676271 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a3347ad1-05c5-4fa9-804f-1bf147421444 admin admin] Checking segment: {'id': 'bed9e8ce-3832-4d39-85d7-c715c7f7c48d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 234, 'network_id': '58cca6bb-59a6-4d0d-be36-f45d900aa288'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94347) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:38:28.676603 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3347ad1-05c5-4fa9-804f-1bf147421444 admin admin] Network hostable DHCP agents. Network: 58cca6bb-59a6-4d0d-be36-f45d900aa288, hostable agents: ['6aaa6222-6d04-44a7-b807-bfc2cbd3e99f'], hosted agents: [] {{(pid=94347) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 18 08:38:28.696977 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a3347ad1-05c5-4fa9-804f-1bf147421444 admin admin] Network 58cca6bb-59a6-4d0d-be36-f45d900aa288 is scheduled to be hosted by DHCP agent 6aaa6222-6d04-44a7-b807-bfc2cbd3e99f with binding_index 1 {{(pid=94347) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 18 08:38:28.707530 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [None req-a3347ad1-05c5-4fa9-804f-1bf147421444 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804470-6-iscsi, 58cca6bb-59a6-4d0d-be36-f45d900aa288) {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:38:28.712456 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a3347ad1-05c5-4fa9-804f-1bf147421444 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:28.713150 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a3347ad1-05c5-4fa9-804f-1bf147421444 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for subnet, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:28.720006 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d7c8668f-5ba6-4fcf-a3e4-1cac416a5e0f None None] Network 58cca6bb-59a6-4d0d-be36-f45d900aa288 requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:38:28.753856 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-a3347ad1-05c5-4fa9-804f-1bf147421444 admin admin] 10.222.0.35 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.3899224 Sep 18 08:38:28.865966 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b027dfb-ca17-47cd-a438-98f2ce81cd76 req-0be1944a-b29d-443a-870b-7cec6654e73b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:28.873364 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5b027dfb-ca17-47cd-a438-98f2ce81cd76 req-0be1944a-b29d-443a-870b-7cec6654e73b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 932 time: 0.0575829 Sep 18 08:38:28.874270 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d7a52a67-a438-4def-86d5-89d7744287df None None] Network 58cca6bb-59a6-4d0d-be36-f45d900aa288 requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:38:28.936650 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5b027dfb-ca17-47cd-a438-98f2ce81cd76 req-3ba768a1-b60b-459b-9f89-0c072f67921e tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0566893 Sep 18 08:38:28.968479 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 54978) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:29.066208 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_v2 [None req-fcc477a0-054c-4ecd-934e-eaf8c6b7696f admin admin] Deleting subnet ac237a01-d0d2-4e71-82a8-f713001c6a87 {{(pid=94346) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 18 08:38:29.069916 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-fcc477a0-054c-4ecd-934e-eaf8c6b7696f admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:29.106550 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-fcc477a0-054c-4ecd-934e-eaf8c6b7696f admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:29.115578 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-fcc477a0-054c-4ecd-934e-eaf8c6b7696f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1821528'] for subnet, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:29.116722 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77d8bb56-212d-47f3-ac33-77e56171c56e req-2f3c74cd-f4f5-44b1-8059-5048f625f220 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:29.118368 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-77d8bb56-212d-47f3-ac33-77e56171c56e req-2f3c74cd-f4f5-44b1-8059-5048f625f220 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 931 time: 0.0523133 Sep 18 08:38:29.161971 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9daee44f-b3f3-4b4a-85d3-8e2500453be8 req-cfa3b2f9-2a35-4bc8-b689-bae656d1ac5a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0386207 Sep 18 08:38:29.177437 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-fcc477a0-054c-4ecd-934e-eaf8c6b7696f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1821519', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for subnet, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:29.184945 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-77d8bb56-212d-47f3-ac33-77e56171c56e req-53e71e0a-2422-4a84-88be-4313d409788c tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0599859 Sep 18 08:38:29.216973 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcc477a0-054c-4ecd-934e-eaf8c6b7696f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ac237a01-d0d2-4e71-82a8-f713001c6a87,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:29.225720 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-fcc477a0-054c-4ecd-934e-eaf8c6b7696f admin admin] Notify callbacks [] for subnet, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:29.228618 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-fcc477a0-054c-4ecd-934e-eaf8c6b7696f admin admin] 10.222.0.35 "DELETE /v2.0/subnets/ac237a01-d0d2-4e71-82a8-f713001c6a87 HTTP/1.1" status: 204 len: 168 time: 0.2591279 Sep 18 08:38:29.231086 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 54986) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:29.303310 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1861545'] for network, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:29.385935 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1806559', 'neutron.services.segments.db._delete_segments_for_network-8732885752733'] for network, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:29.406021 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] Subscribe: > segment before_delete 55550000 {{(pid=94346) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:29.406366 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=94346) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:29.407141 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=94346) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:29.407491 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] Subscribe: > port after_create 55550000 {{(pid=94346) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:29.407830 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] Subscribe: > port after_delete 55550000 {{(pid=94346) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:29.408162 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] Subscribe: > port after_update 55550000 {{(pid=94346) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:29.408482 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] Subscribe: > segment after_delete 55550000 {{(pid=94346) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:29.408802 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] Subscribe: > subnet after_create 55550000 {{(pid=94346) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:29.409114 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=94346) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:29.409454 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] Subscribe: > subnet after_update 55550000 {{(pid=94346) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:29.645266 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] Subscribe: > subnet after_create 55550000 {{(pid=94346) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:29.645620 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=94346) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:29.645953 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] Subscribe: > subnet before_create 55550000 {{(pid=94346) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:29.646285 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] Subscribe: > subnet before_update 55550000 {{(pid=94346) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:29.646645 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2cf40b42-ccb1-46ae-8b65-919b9aca813d']}} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:38:29.667799 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1ece11a5-9769-4131-8d01-eddf33fc8c95') {'for_net_delete': True} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:38:29.668100 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1ece11a5-9769-4131-8d01-eddf33fc8c95') {} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:38:29.683582 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732885753254', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14122733'] for segment, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:29.705062 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:29.726937 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] Releasing vlan 202 on physical network physnet1 to pool {{(pid=94346) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 18 08:38:29.727491 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14289667'] for segment, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: from cryptography.utils import int_from_bytes Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: from cryptography.utils import int_from_bytes Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: Traceback (most recent call last): Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: timer() Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: cb(*args, **kw) Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: return func(*args, **kwargs) Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: self._notify() Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: self.callback(batched_events) Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: event.method(event) Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: aggregate_uuid = self.p_client.list_aggregates( Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: return f(self, *a, **k) Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: return self._get(url).json() Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: return self.request(url, 'GET', **kwargs) Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: base_url = self.get_endpoint(auth, allow=allow, Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 18 08:38:29.731763 dv-cinder-804470-6-iscsi neutron-server[94346]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 18 08:38:29.746202 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6c9306ec-e58f-44cc-bdd9-e13fd5e647c9 req-97c09e7e-a963-4107-9891-97d470048170 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 210 time: 0.0260851 Sep 18 08:38:29.791645 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1806534', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-784926'] for network, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:29.799506 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:29.802065 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] 10.222.0.35 "DELETE /v2.0/networks/2cf40b42-ccb1-46ae-8b65-919b9aca813d HTTP/1.1" status: 204 len: 168 time: 0.5697401 Sep 18 08:38:29.805251 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 54994) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:29.819005 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e8ffa34-3486-4545-81fa-ef698482792b admin admin] Pushing event deleted for resources: {'Network': ['ID=2cf40b42-ccb1-46ae-8b65-919b9aca813d,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:29.851578 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_v2 [None req-f31f724f-531e-471e-86df-7b2cbe7bbd98 admin admin] Deleting subnet 81620f62-97e2-49fa-8e5c-3ab2216a4db7 {{(pid=94347) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 18 08:38:29.855285 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-f31f724f-531e-471e-86df-7b2cbe7bbd98 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:29.892063 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-f31f724f-531e-471e-86df-7b2cbe7bbd98 admin admin] Notify callbacks [] for subnet, precommit_delete_associations {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:29.901342 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-f31f724f-531e-471e-86df-7b2cbe7bbd98 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1821528'] for subnet, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:30.107915 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ade7a97-192d-448a-a523-791826687623 req-c759a983-04c1-4015-9296-a2a29bdd6f06 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:30.109408 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8ade7a97-192d-448a-a523-791826687623 req-c759a983-04c1-4015-9296-a2a29bdd6f06 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 932 time: 0.0630615 Sep 18 08:38:30.123752 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-f31f724f-531e-471e-86df-7b2cbe7bbd98 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1821519', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for subnet, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:30.159182 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f31f724f-531e-471e-86df-7b2cbe7bbd98 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=81620f62-97e2-49fa-8e5c-3ab2216a4db7,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:30.169628 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-f31f724f-531e-471e-86df-7b2cbe7bbd98 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for subnet, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:30.171497 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-f31f724f-531e-471e-86df-7b2cbe7bbd98 admin admin] 10.222.0.35 "DELETE /v2.0/subnets/81620f62-97e2-49fa-8e5c-3ab2216a4db7 HTTP/1.1" status: 204 len: 168 time: 0.3652763 Sep 18 08:38:30.174109 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 55002) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:30.178384 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8ade7a97-192d-448a-a523-791826687623 req-ec87cb37-336b-4a2f-8311-c6f135655d15 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0628095 Sep 18 08:38:30.270330 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1861545'] for network, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:30.273508 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b8b8dfcf-1e30-4afd-a482-b5f5707f8141 req-da1c30e4-0618-4836-8e29-1cc26a2ca8f8 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0358579 Sep 18 08:38:30.355929 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67cec969-9be4-4ade-8097-f03f7aa740fa req-8c334d9d-a2b2-4b75-a321-bd9c38a80b85 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:30.357346 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-67cec969-9be4-4ade-8097-f03f7aa740fa req-8c334d9d-a2b2-4b75-a321-bd9c38a80b85 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 931 time: 0.0901728 Sep 18 08:38:30.406888 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1806559', 'neutron.services.segments.db._delete_segments_for_network-8732885752733'] for network, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:30.441482 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-67cec969-9be4-4ade-8097-f03f7aa740fa req-fbc2fa81-9d9c-4126-9c3e-02bfb3eb166b tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0759323 Sep 18 08:38:30.443477 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=94347) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:30.443827 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=94347) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:30.444614 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=94347) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:30.445016 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] Subscribe: > port after_create 55550000 {{(pid=94347) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:30.445398 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] Subscribe: > port after_delete 55550000 {{(pid=94347) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:30.445739 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] Subscribe: > port after_update 55550000 {{(pid=94347) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:30.446066 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=94347) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:30.446397 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=94347) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:30.446720 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=94347) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:30.447047 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=94347) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:30.623972 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=94347) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:30.624225 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=94347) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:30.624681 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=94347) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:30.625020 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=94347) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Sep 18 08:38:30.625436 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.services.segments.db [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['58cca6bb-59a6-4d0d-be36-f45d900aa288']}} {{(pid=94347) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:38:30.642408 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.services.segments.db [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bed9e8ce-3832-4d39-85d7-c715c7f7c48d') {'for_net_delete': True} {{(pid=94347) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:38:30.642701 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.services.segments.db [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bed9e8ce-3832-4d39-85d7-c715c7f7c48d') {} {{(pid=94347) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:38:30.658899 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732885753254', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-13659327'] for segment, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:30.679322 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:30.686931 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] Releasing vlan 234 on physical network physnet1 to pool {{(pid=94347) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 18 08:38:30.687302 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15067250'] for segment, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: from cryptography.utils import int_from_bytes Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: from cryptography.utils import int_from_bytes Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: Traceback (most recent call last): Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: timer() Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: cb(*args, **kw) Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: return func(*args, **kwargs) Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: self._notify() Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: self.callback(batched_events) Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: event.method(event) Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: aggregate_uuid = self.p_client.list_aggregates( Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: return f(self, *a, **k) Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: return self._get(url).json() Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: return self.request(url, 'GET', **kwargs) Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: base_url = self.get_endpoint(auth, allow=allow, Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 18 08:38:30.691342 dv-cinder-804470-6-iscsi neutron-server[94347]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 18 08:38:30.766968 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1806534', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-784926'] for network, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:30.776701 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:30.781432 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] 10.222.0.35 "DELETE /v2.0/networks/58cca6bb-59a6-4d0d-be36-f45d900aa288 HTTP/1.1" status: 204 len: 168 time: 0.6038182 Sep 18 08:38:30.793745 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4d3e4d8-bb31-4af2-9fc8-ab96acbd7dd5 admin admin] Pushing event deleted for resources: {'Network': ['ID=58cca6bb-59a6-4d0d-be36-f45d900aa288,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:30.868496 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bbc2cabc-d057-40a7-81c5-17659ed304b4 req-90cc9118-3e76-4d32-8454-ca427f810f2e tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 210 time: 0.0260117 Sep 18 08:38:30.948393 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 55016) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:30.986891 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-5b76b4f9-e9af-4c87-b3de-a9d0979ef829 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=194467b22f734d23a65c96d5dbd1e0d9&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0373774 Sep 18 08:38:30.989237 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 55018) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:31.035743 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0d271ee8-4ba0-4d3a-8b7d-62414444f170 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:31.055524 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0d271ee8-4ba0-4d3a-8b7d-62414444f170 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:31.102258 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0d271ee8-4ba0-4d3a-8b7d-62414444f170 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:31.105544 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0d271ee8-4ba0-4d3a-8b7d-62414444f170 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:31.106693 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-0d271ee8-4ba0-4d3a-8b7d-62414444f170 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/b8a35b47-7bc7-439e-8307-03e2d007d096 HTTP/1.1" status: 204 len: 168 time: 0.1165822 Sep 18 08:38:31.114457 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d271ee8-4ba0-4d3a-8b7d-62414444f170 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b8a35b47-7bc7-439e-8307-03e2d007d096,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:31.312774 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-470300bc-fb6c-4801-bdcb-9515f11dd5ef req-dcf8c96e-3293-44df-94df-714a468b523e tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:31.314431 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-470300bc-fb6c-4801-bdcb-9515f11dd5ef req-dcf8c96e-3293-44df-94df-714a468b523e tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 932 time: 0.0589356 Sep 18 08:38:31.378830 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-470300bc-fb6c-4801-bdcb-9515f11dd5ef req-050c9ecb-6b71-4e1f-9903-adc01e13444c tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0574858 Sep 18 08:38:31.380790 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6583d218-2e1c-4fef-9e58-bd29ba98e7c1 req-6a6212bd-e09e-4baa-845d-0e95740f3514 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0296330 Sep 18 08:38:31.464274 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 55032) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:31.508502 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-06729552-3a38-4bf7-8b20-4f1b2eafad54 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=7723834dc2e8422791296737427f3a8a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0430648 Sep 18 08:38:31.519062 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 55036) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:31.587720 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-47fa1636-f0b5-4831-9d94-641eefb125b5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:31.607716 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dcd4236-4ede-441d-9cf0-ee916a382e49 req-a5e2082a-d127-4ffa-9c47-63a0ae4cb60c tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:31.609866 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-47fa1636-f0b5-4831-9d94-641eefb125b5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:31.618238 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1dcd4236-4ede-441d-9cf0-ee916a382e49 req-a5e2082a-d127-4ffa-9c47-63a0ae4cb60c tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 931 time: 0.1089361 Sep 18 08:38:31.662909 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-47fa1636-f0b5-4831-9d94-641eefb125b5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:31.664862 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1dcd4236-4ede-441d-9cf0-ee916a382e49 req-96699fa7-abac-433d-9b95-1078ba01f11f tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455339 Sep 18 08:38:31.665594 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-47fa1636-f0b5-4831-9d94-641eefb125b5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:31.667017 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-47fa1636-f0b5-4831-9d94-641eefb125b5 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/33ed553d-1c92-4029-92da-bbfa8cfeef79 HTTP/1.1" status: 204 len: 168 time: 0.1464689 Sep 18 08:38:31.691177 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47fa1636-f0b5-4831-9d94-641eefb125b5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=33ed553d-1c92-4029-92da-bbfa8cfeef79,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:32.000795 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c708f0ac-d891-4147-aa41-c8e20fdd9e7c req-d16d8486-cdd3-42c6-bb19-dc22763f1a34 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 210 time: 0.0274889 Sep 18 08:38:32.530010 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7e967d11-880b-4d19-a958-89d9fab40e29 req-a976d0a9-ca4f-4e64-bbbd-547ecef20d4f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0413775 Sep 18 08:38:32.575815 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dab3b00-f336-4daf-94c9-ddce8f6cf3d8 req-33a06803-383c-4dd2-b606-030d05edac18 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:32.577803 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4dab3b00-f336-4daf-94c9-ddce8f6cf3d8 req-33a06803-383c-4dd2-b606-030d05edac18 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 932 time: 0.0755806 Sep 18 08:38:32.619760 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4dab3b00-f336-4daf-94c9-ddce8f6cf3d8 req-c2ca0905-d8fa-4976-b548-f03e6ed3f318 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0358706 Sep 18 08:38:32.782534 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edf0c599-8786-4748-8fce-1eac45c741ff req-4ed6432b-93e9-47a1-9988-fbe4c2aaefcb tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:32.784078 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-edf0c599-8786-4748-8fce-1eac45c741ff req-4ed6432b-93e9-47a1-9988-fbe4c2aaefcb tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 931 time: 0.0496147 Sep 18 08:38:32.828645 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-edf0c599-8786-4748-8fce-1eac45c741ff req-c67d54ac-7219-4c5d-a989-cb8f8a76ecc5 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385687 Sep 18 08:38:33.141859 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e496d1a2-1299-415a-85c4-a401546b7724 req-e9e4e903-ccbc-46a3-97d4-2b101980fd2c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 210 time: 0.0370002 Sep 18 08:38:33.675380 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e0376fcb-4a08-46f6-ad03-e891535183d8 req-a51c8a0d-ce4b-462b-aa83-ae8ac40c086d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0376675 Sep 18 08:38:33.744419 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeb98767-ff23-49fc-ad2e-5193c33035cf req-817ba206-e1ea-4fef-9355-3c8f2a9f95f3 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:33.745869 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-aeb98767-ff23-49fc-ad2e-5193c33035cf req-817ba206-e1ea-4fef-9355-3c8f2a9f95f3 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 932 time: 0.0493972 Sep 18 08:38:33.784974 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-aeb98767-ff23-49fc-ad2e-5193c33035cf req-575d0a91-67f3-4849-82d4-e67bd0cbe948 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0332520 Sep 18 08:38:33.993634 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc52601d-9c85-45a9-a94e-9deb6b2b7776 req-f5b8ca1e-1678-4696-96ba-4c184a1889d6 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:33.995020 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fc52601d-9c85-45a9-a94e-9deb6b2b7776 req-f5b8ca1e-1678-4696-96ba-4c184a1889d6 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 931 time: 0.0503256 Sep 18 08:38:34.031098 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fc52601d-9c85-45a9-a94e-9deb6b2b7776 req-e6e9d2ba-bf1a-43be-ac83-2835fb96209f tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0299184 Sep 18 08:38:34.234806 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-545df006-cb1a-4f44-a00e-c5168c88e5e6 req-d69da014-d7e6-4824-ad11-3a1557d07116 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 210 time: 0.0286469 Sep 18 08:38:34.784816 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cbab04c5-44c0-4511-b205-385a96e92ac1 req-db005f9e-981a-4c9b-a1a1-e7304b42f06d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0278945 Sep 18 08:38:34.898752 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a474adb1-3a68-4522-bcc5-941439a7c140 req-c99806a0-09b9-4033-a4a5-061ef9599eee tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:34.900245 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a474adb1-3a68-4522-bcc5-941439a7c140 req-c99806a0-09b9-4033-a4a5-061ef9599eee tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 932 time: 0.0480504 Sep 18 08:38:34.939734 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a474adb1-3a68-4522-bcc5-941439a7c140 req-e850c0fb-332b-4005-bcfc-4fa8a4752f52 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0331767 Sep 18 08:38:35.159370 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a83e00d-dbaa-4f18-9130-f88c1af6c301 req-13ab6f34-6283-451d-99f1-465740e08365 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:35.160845 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6a83e00d-dbaa-4f18-9130-f88c1af6c301 req-13ab6f34-6283-451d-99f1-465740e08365 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 931 time: 0.0580764 Sep 18 08:38:35.197687 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6a83e00d-dbaa-4f18-9130-f88c1af6c301 req-4f5b6962-4037-4c65-a4df-da772b5809ec tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0310214 Sep 18 08:38:35.338968 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e57eb360-390f-4b47-99e0-f04c6e5bcc52 req-f1ee8863-1114-4d78-9e75-f8297e3cedec tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 210 time: 0.0349193 Sep 18 08:38:35.877377 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-53bca50b-dda3-4e3f-a164-a8bd7bb3cb46 req-d58c772d-ca2f-42d9-8fee-703ad4f4924e tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0253737 Sep 18 08:38:36.095231 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef643e91-3e63-4c73-bc04-45fcadf3dea2 req-93c996e4-dc22-4158-b2a8-1ae9b16b4fb5 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:36.096726 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ef643e91-3e63-4c73-bc04-45fcadf3dea2 req-93c996e4-dc22-4158-b2a8-1ae9b16b4fb5 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 932 time: 0.0558257 Sep 18 08:38:36.136930 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ef643e91-3e63-4c73-bc04-45fcadf3dea2 req-20c46342-b55b-4984-b0f1-327bc721c320 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0325646 Sep 18 08:38:36.338637 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c68ea06-595e-4977-a643-233d5da624c9 req-560a2d67-b2ea-4aa3-b476-c65040141eba tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:36.340557 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1c68ea06-595e-4977-a643-233d5da624c9 req-560a2d67-b2ea-4aa3-b476-c65040141eba tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 931 time: 0.0535810 Sep 18 08:38:36.382988 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1c68ea06-595e-4977-a643-233d5da624c9 req-fc9fa392-d037-4786-a679-150e84d1380c tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0355937 Sep 18 08:38:36.453163 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1591dad5-c06d-44d1-b54e-41cdbf243ce2 req-40b1033f-cbc1-4fc4-b492-e8271b775d8d tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 210 time: 0.0336671 Sep 18 08:38:36.969997 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-59fdec78-6322-4614-9945-36824a2b8a6c req-844c8e45-faaf-49f1-8efb-8c29170d2c06 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0252211 Sep 18 08:38:37.260372 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5579d7b0-6741-41a3-a226-d8587b9a6487 req-70c57795-7dcd-4390-9935-dfa3fa3c0651 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:37.262033 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5579d7b0-6741-41a3-a226-d8587b9a6487 req-70c57795-7dcd-4390-9935-dfa3fa3c0651 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 932 time: 0.0526378 Sep 18 08:38:37.300384 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5579d7b0-6741-41a3-a226-d8587b9a6487 req-4ef2a302-c8ec-4f7e-87b4-c787f76abf35 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0323851 Sep 18 08:38:37.494097 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2526e58-93f3-4bac-9210-baaf280b1cd5 req-cde5c4d1-e442-4f83-a717-3f17cd8903d1 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:37.495620 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e2526e58-93f3-4bac-9210-baaf280b1cd5 req-cde5c4d1-e442-4f83-a717-3f17cd8903d1 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 931 time: 0.0478361 Sep 18 08:38:37.544024 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e2526e58-93f3-4bac-9210-baaf280b1cd5 req-ad138554-897c-46ae-acf7-52a4bdc72a7d tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414762 Sep 18 08:38:37.561468 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b74f67fe-6cc0-4b1f-be78-4406c49fc134 req-f20b3ad4-9597-4acc-b3e8-d209cb87a38b tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 210 time: 0.0393131 Sep 18 08:38:38.063715 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0a3c4f8f-6c5b-4377-bbf0-99190fdd04a1 req-f1f8ed41-cf0c-4d66-b456-2454af29cb36 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0250108 Sep 18 08:38:38.410532 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2746c231-d4c8-4e33-b4b7-c7d63f57934c req-4766ecc7-a897-4dec-b809-1e5ba689eaff tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:38.411971 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2746c231-d4c8-4e33-b4b7-c7d63f57934c req-4766ecc7-a897-4dec-b809-1e5ba689eaff tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 932 time: 0.0469437 Sep 18 08:38:38.449902 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2746c231-d4c8-4e33-b4b7-c7d63f57934c req-79802e29-7f4b-4538-ab0b-a174ee327ea0 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0315132 Sep 18 08:38:38.687035 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c746e5d1-d832-434f-9200-79da5ce992d2 req-c614dd0c-5ee4-43e2-b490-bdf9b124d3b0 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 210 time: 0.0325520 Sep 18 08:38:38.702572 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d9684a9-d401-4363-a88a-2ba2eeb87c46 req-6449a4a6-8851-4749-9b52-f4767c09c9ec tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:38.704158 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9d9684a9-d401-4363-a88a-2ba2eeb87c46 req-6449a4a6-8851-4749-9b52-f4767c09c9ec tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 931 time: 0.0855477 Sep 18 08:38:38.742431 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9d9684a9-d401-4363-a88a-2ba2eeb87c46 req-8055153e-a3ba-4aa0-8112-85f05ac407a8 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0325248 Sep 18 08:38:39.166391 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-22b9cfc2-5589-4688-a63e-f7f4e1224fb7 req-d76af3d5-0105-437d-82db-f57791e34642 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0277531 Sep 18 08:38:39.580878 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8613d57-a509-4b89-b506-299cd08ad82a req-a0b712cf-14b4-4c01-a4af-503d3ea2c225 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:39.582412 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b8613d57-a509-4b89-b506-299cd08ad82a req-a0b712cf-14b4-4c01-a4af-503d3ea2c225 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 932 time: 0.0593374 Sep 18 08:38:39.621733 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b8613d57-a509-4b89-b506-299cd08ad82a req-88bd6e4b-6897-4034-a41e-a3560bdf6c8b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0333269 Sep 18 08:38:39.796119 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7c5e9a4a-bcdc-4450-ab5a-4d6715a16f46 req-03266684-43fa-41d3-ac2a-290b575a132a tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 210 time: 0.0328183 Sep 18 08:38:39.824213 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [req-d9365443-e446-447b-b9f1-13a29817a154 req-6014f13d-c150-4e93-8384-cf92396c8ead tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] http://10.222.0.35:9696/v2.0/extensions returned with HTTP 200 {{(pid=94346) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 18 08:38:39.825375 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-d9365443-e446-447b-b9f1-13a29817a154 req-6014f13d-c150-4e93-8384-cf92396c8ead tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0078661 Sep 18 08:38:39.830178 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-6dada862-d003-42da-8ada-ea915cf4a67b tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] http://10.222.0.35:9696/v2.0/extensions returned with HTTP 200 {{(pid=94346) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 18 08:38:39.831452 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-6dada862-d003-42da-8ada-ea915cf4a67b tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0049245 Sep 18 08:38:39.860972 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b852a17-9b28-44c7-a00d-f17341a2b075 req-30972ccb-ffb1-497f-9399-35c095a9691d tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:39.862715 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2b852a17-9b28-44c7-a00d-f17341a2b075 req-30972ccb-ffb1-497f-9399-35c095a9691d tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 931 time: 0.0529716 Sep 18 08:38:39.916373 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2b852a17-9b28-44c7-a00d-f17341a2b075 req-43034c54-c339-4d64-a7ba-3321dc7e4036 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444100 Sep 18 08:38:40.045194 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [req-d9365443-e446-447b-b9f1-13a29817a154 req-0e3c1f61-5395-417e-bcc0-e233938d5b72 service neutron] Request body: {'port': {'device_id': '1c2476c0-3321-4eb3-a42d-df9f52eeb4f8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80447'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:40.052723 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-39e9492d-1d20-4278-8c48-0f55411a6ebb service neutron] Request body: {'port': {'device_id': '6cd27eb8-8447-40a0-9229-d59ec6008eeb', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80447'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:40.141471 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [req-d9365443-e446-447b-b9f1-13a29817a154 req-0e3c1f61-5395-417e-bcc0-e233938d5b72 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:40.149340 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-39e9492d-1d20-4278-8c48-0f55411a6ebb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:40.286209 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.13', 59084) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:40.327349 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-11baa9f8-e96a-4d06-90d6-227bdd2524e1 req-2452fc3c-1801-43c6-9522-8e5dde5297e0 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0549085 Sep 18 08:38:40.434658 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-9530e823-aa8e-4486-8d7e-5ee697e6b685 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:40.436763 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-9530e823-aa8e-4486-8d7e-5ee697e6b685 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.13 "GET /v2.0/networks?id=fdcbc66e-323e-4b44-be97-566949f4f2ef HTTP/1.1" status: 200 len: 818 time: 0.1486964 Sep 18 08:38:40.466043 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-a2045e47-fe5b-4cde-b268-0683831a7259 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Request body: {'port': {'device_id': 'a8fb23c6-6606-497f-820d-0643e56a39d1', 'network_id': 'fdcbc66e-323e-4b44-be97-566949f4f2ef', 'admin_state_up': True, 'tenant_id': 'f439efa4eed0456ab2a914377e490fad'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:40.633923 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-a2045e47-fe5b-4cde-b268-0683831a7259 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Made reservation on behalf of f439efa4eed0456ab2a914377e490fad for: {'port': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:38:40.637842 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-a2045e47-fe5b-4cde-b268-0683831a7259 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:40.765742 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.notifiers.nova [req-d9365443-e446-447b-b9f1-13a29817a154 req-0e3c1f61-5395-417e-bcc0-e233938d5b72 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9a4f8ce9-f706-4c25-b3f4-05f2173cf516 {{(pid=94346) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:38:40.775213 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [req-d9365443-e446-447b-b9f1-13a29817a154 req-0e3c1f61-5395-417e-bcc0-e233938d5b72 service neutron] Notify callbacks [] for port, precommit_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:40.827140 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.provisioning_blocks [req-d9365443-e446-447b-b9f1-13a29817a154 req-0e3c1f61-5395-417e-bcc0-e233938d5b72 service neutron] Transition to ACTIVE for port object 9a4f8ce9-f706-4c25-b3f4-05f2173cf516 will not be triggered until provisioned by entity L2. {{(pid=94346) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 18 08:38:40.839225 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [req-d9365443-e446-447b-b9f1-13a29817a154 req-0e3c1f61-5395-417e-bcc0-e233938d5b72 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14290155'] for port, after_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:40.856062 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.notifiers.nova [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-39e9492d-1d20-4278-8c48-0f55411a6ebb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 324203bb-e8cc-4392-974c-20b4f2896cc6 {{(pid=94346) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:38:40.867466 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-39e9492d-1d20-4278-8c48-0f55411a6ebb service neutron] Notify callbacks [] for port, precommit_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:40.889279 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.provisioning_blocks [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-39e9492d-1d20-4278-8c48-0f55411a6ebb service neutron] Transition to ACTIVE for port object 324203bb-e8cc-4392-974c-20b4f2896cc6 will not be triggered until provisioned by entity L2. {{(pid=94346) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 18 08:38:40.918804 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-39e9492d-1d20-4278-8c48-0f55411a6ebb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14290155'] for port, after_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:41.030323 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e3c1f61-5395-417e-bcc0-e233938d5b72 service neutron] Pushing event updated for resources: {'Port': ['ID=9a4f8ce9-f706-4c25-b3f4-05f2173cf516,revision_number=2']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:41.047863 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.13', 59088) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:41.081678 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86fda9e5-50dd-4f79-b414-c7bc41f534e9 req-c355e9d3-2b47-4744-80d6-abc52cdf0710 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:41.083212 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-86fda9e5-50dd-4f79-b414-c7bc41f534e9 req-c355e9d3-2b47-4744-80d6-abc52cdf0710 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 932 time: 0.3338192 Sep 18 08:38:41.108081 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39e9492d-1d20-4278-8c48-0f55411a6ebb service neutron] Pushing event updated for resources: {'Port': ['ID=324203bb-e8cc-4392-974c-20b4f2896cc6,revision_number=2']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:41.124880 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b0258caa-f606-4a2f-bb88-7baa4b45574d req-6b6e47e1-d8e1-4f51-96da-a6e72c3d8577 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 210 time: 0.0799224 Sep 18 08:38:41.216307 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.managers [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-39e9492d-1d20-4278-8c48-0f55411a6ebb service neutron] Attempting to bind port 324203bb-e8cc-4392-974c-20b4f2896cc6 on host hv-cinder-80447 for vnic_type normal with profile {{(pid=94346) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:38:41.216673 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.managers [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-39e9492d-1d20-4278-8c48-0f55411a6ebb service neutron] Attempting to bind port 324203bb-e8cc-4392-974c-20b4f2896cc6 by drivers openvswitch,hyperv on host hv-cinder-80447 at level 0 using segments [{'id': '892b5fda-4f2b-4e3a-af39-7d4f8d89394b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 218, 'network_id': '2c7737b5-792d-4a8d-bacc-cd5c180b7fc0'}] {{(pid=94346) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:38:41.217014 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-39e9492d-1d20-4278-8c48-0f55411a6ebb service neutron] Attempting to bind port 324203bb-e8cc-4392-974c-20b4f2896cc6 on network 2c7737b5-792d-4a8d-bacc-cd5c180b7fc0 {{(pid=94346) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:38:41.229633 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-39e9492d-1d20-4278-8c48-0f55411a6ebb service neutron] Port 324203bb-e8cc-4392-974c-20b4f2896cc6 on network 2c7737b5-792d-4a8d-bacc-cd5c180b7fc0 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80447 {{(pid=94346) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 18 08:38:41.229970 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-39e9492d-1d20-4278-8c48-0f55411a6ebb service neutron] Attempting to bind port 324203bb-e8cc-4392-974c-20b4f2896cc6 on network 2c7737b5-792d-4a8d-bacc-cd5c180b7fc0 {{(pid=94346) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:38:41.235420 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_common [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-a2045e47-fe5b-4cde-b268-0683831a7259 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Allocated IP 172.20.0.11 (fdcbc66e-323e-4b44-be97-566949f4f2ef/e5dc6eef-e778-41a2-a708-c7810ade97db/59d1e8a2-e4aa-44e5-8014-91de86026543) {{(pid=94347) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:38:41.244886 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-39e9492d-1d20-4278-8c48-0f55411a6ebb service neutron] Checking agent: {'id': '8d51fdc4-974b-4200-9c3f-5dddea60a869', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80447', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'started_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 38, 20), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94346) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:38:41.245270 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-39e9492d-1d20-4278-8c48-0f55411a6ebb service neutron] Checking segment: {'id': '892b5fda-4f2b-4e3a-af39-7d4f8d89394b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 218, 'network_id': '2c7737b5-792d-4a8d-bacc-cd5c180b7fc0'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94346) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:38:41.245954 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-39e9492d-1d20-4278-8c48-0f55411a6ebb service neutron] Bound using segment: {'id': '892b5fda-4f2b-4e3a-af39-7d4f8d89394b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 218, 'network_id': '2c7737b5-792d-4a8d-bacc-cd5c180b7fc0'} {{(pid=94346) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:38:41.246268 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.managers [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-39e9492d-1d20-4278-8c48-0f55411a6ebb service neutron] Bound port: 324203bb-e8cc-4392-974c-20b4f2896cc6, host: hv-cinder-80447, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '892b5fda-4f2b-4e3a-af39-7d4f8d89394b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 218, 'network_id': '2c7737b5-792d-4a8d-bacc-cd5c180b7fc0'}}] {{(pid=94346) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:38:41.246676 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-39e9492d-1d20-4278-8c48-0f55411a6ebb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:41.262413 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.managers [req-d9365443-e446-447b-b9f1-13a29817a154 req-0e3c1f61-5395-417e-bcc0-e233938d5b72 service neutron] Attempting to bind port 9a4f8ce9-f706-4c25-b3f4-05f2173cf516 on host hv-cinder-80447 for vnic_type normal with profile {{(pid=94346) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:38:41.262751 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.managers [req-d9365443-e446-447b-b9f1-13a29817a154 req-0e3c1f61-5395-417e-bcc0-e233938d5b72 service neutron] Attempting to bind port 9a4f8ce9-f706-4c25-b3f4-05f2173cf516 by drivers openvswitch,hyperv on host hv-cinder-80447 at level 0 using segments [{'id': 'd1432479-9c27-42c4-87db-6905e7868675', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 233, 'network_id': 'fe2753d3-7f3b-4739-adbf-6643a840c73e'}] {{(pid=94346) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:38:41.263093 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d9365443-e446-447b-b9f1-13a29817a154 req-0e3c1f61-5395-417e-bcc0-e233938d5b72 service neutron] Attempting to bind port 9a4f8ce9-f706-4c25-b3f4-05f2173cf516 on network fe2753d3-7f3b-4739-adbf-6643a840c73e {{(pid=94346) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:38:41.270944 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d9365443-e446-447b-b9f1-13a29817a154 req-0e3c1f61-5395-417e-bcc0-e233938d5b72 service neutron] Port 9a4f8ce9-f706-4c25-b3f4-05f2173cf516 on network fe2753d3-7f3b-4739-adbf-6643a840c73e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80447 {{(pid=94346) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 18 08:38:41.271274 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d9365443-e446-447b-b9f1-13a29817a154 req-0e3c1f61-5395-417e-bcc0-e233938d5b72 service neutron] Attempting to bind port 9a4f8ce9-f706-4c25-b3f4-05f2173cf516 on network fe2753d3-7f3b-4739-adbf-6643a840c73e {{(pid=94346) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:38:41.295065 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d9365443-e446-447b-b9f1-13a29817a154 req-0e3c1f61-5395-417e-bcc0-e233938d5b72 service neutron] Checking agent: {'id': '8d51fdc4-974b-4200-9c3f-5dddea60a869', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80447', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'started_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 38, 20), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94346) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:38:41.295065 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d9365443-e446-447b-b9f1-13a29817a154 req-0e3c1f61-5395-417e-bcc0-e233938d5b72 service neutron] Checking segment: {'id': 'd1432479-9c27-42c4-87db-6905e7868675', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 233, 'network_id': 'fe2753d3-7f3b-4739-adbf-6643a840c73e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94346) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:38:41.295386 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d9365443-e446-447b-b9f1-13a29817a154 req-0e3c1f61-5395-417e-bcc0-e233938d5b72 service neutron] Bound using segment: {'id': 'd1432479-9c27-42c4-87db-6905e7868675', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 233, 'network_id': 'fe2753d3-7f3b-4739-adbf-6643a840c73e'} {{(pid=94346) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:38:41.295890 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.managers [req-d9365443-e446-447b-b9f1-13a29817a154 req-0e3c1f61-5395-417e-bcc0-e233938d5b72 service neutron] Bound port: 9a4f8ce9-f706-4c25-b3f4-05f2173cf516, host: hv-cinder-80447, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd1432479-9c27-42c4-87db-6905e7868675', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 233, 'network_id': 'fe2753d3-7f3b-4739-adbf-6643a840c73e'}}] {{(pid=94346) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:38:41.296211 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [req-d9365443-e446-447b-b9f1-13a29817a154 req-0e3c1f61-5395-417e-bcc0-e233938d5b72 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:41.310189 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-86fda9e5-50dd-4f79-b414-c7bc41f534e9 req-eedf1a07-809c-450a-903b-a6d39b3ea8ab tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2018721 Sep 18 08:38:41.338188 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-4c5637c9-d47c-4513-be68-d3240a73b5b1 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:41.339845 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-4c5637c9-d47c-4513-be68-d3240a73b5b1 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.13 "GET /v2.0/networks?id=fdcbc66e-323e-4b44-be97-566949f4f2ef HTTP/1.1" status: 200 len: 818 time: 0.2661903 Sep 18 08:38:41.372739 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.db [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-39e9492d-1d20-4278-8c48-0f55411a6ebb service neutron] For port 324203bb-e8cc-4392-974c-20b4f2896cc6, host hv-cinder-80447, cleared binding levels {{(pid=94346) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:38:41.374107 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee9d0d4d-ed94-4804-8685-c2945b9be296 req-5e33713f-6867-413a-9136-ffc5cd98c468 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:41.383211 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ee9d0d4d-ed94-4804-8685-c2945b9be296 req-5e33713f-6867-413a-9136-ffc5cd98c468 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 943 time: 0.1540275 Sep 18 08:38:41.404307 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.db [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-39e9492d-1d20-4278-8c48-0f55411a6ebb service neutron] For port 324203bb-e8cc-4392-974c-20b4f2896cc6, host hv-cinder-80447, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=324203bb-e8cc-4392-974c-20b4f2896cc6,segment=NetworkSegment(892b5fda-4f2b-4e3a-af39-7d4f8d89394b),segment_id=892b5fda-4f2b-4e3a-af39-7d4f8d89394b)] {{(pid=94346) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:38:41.409306 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.db [req-d9365443-e446-447b-b9f1-13a29817a154 req-0e3c1f61-5395-417e-bcc0-e233938d5b72 service neutron] For port 9a4f8ce9-f706-4c25-b3f4-05f2173cf516, host hv-cinder-80447, cleared binding levels {{(pid=94346) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:38:41.422646 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-39e9492d-1d20-4278-8c48-0f55411a6ebb service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14290155'] for port, after_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:41.436775 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.db [req-d9365443-e446-447b-b9f1-13a29817a154 req-0e3c1f61-5395-417e-bcc0-e233938d5b72 service neutron] For port 9a4f8ce9-f706-4c25-b3f4-05f2173cf516, host hv-cinder-80447, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=9a4f8ce9-f706-4c25-b3f4-05f2173cf516,segment=NetworkSegment(d1432479-9c27-42c4-87db-6905e7868675),segment_id=d1432479-9c27-42c4-87db-6905e7868675)] {{(pid=94346) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:38:41.454906 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ee9d0d4d-ed94-4804-8685-c2945b9be296 req-31e9ece9-fa43-4809-a88f-448510b84cd4 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0707419 Sep 18 08:38:41.467295 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-39e9492d-1d20-4278-8c48-0f55411a6ebb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:41.468148 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-39e9492d-1d20-4278-8c48-0f55411a6ebb service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for port, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:41.469896 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-39e9492d-1d20-4278-8c48-0f55411a6ebb service neutron] 10.222.0.13 "PUT /v2.0/ports/324203bb-e8cc-4392-974c-20b4f2896cc6 HTTP/1.1" status: 200 len: 1093 time: 1.4742038 Sep 18 08:38:41.470964 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [req-d9365443-e446-447b-b9f1-13a29817a154 req-0e3c1f61-5395-417e-bcc0-e233938d5b72 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14290155'] for port, after_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:41.475240 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6cd27eb8-8447-40a0-9229-d59ec6008eeb', 'tag': '324203bb-e8cc-4392-974c-20b4f2896cc6'}] {{(pid=94346) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:38:41.480662 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d3de5c93-5b59-4611-9af3-fe488b1c39e5 req-e1539278-d85d-4fa8-af63-d2e29d20592f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0477312 Sep 18 08:38:41.505238 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9365443-e446-447b-b9f1-13a29817a154 req-0e3c1f61-5395-417e-bcc0-e233938d5b72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:41.506106 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [req-d9365443-e446-447b-b9f1-13a29817a154 req-0e3c1f61-5395-417e-bcc0-e233938d5b72 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for port, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:41.507947 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-d9365443-e446-447b-b9f1-13a29817a154 req-0e3c1f61-5395-417e-bcc0-e233938d5b72 service neutron] 10.222.0.13 "PUT /v2.0/ports/9a4f8ce9-f706-4c25-b3f4-05f2173cf516 HTTP/1.1" status: 200 len: 1094 time: 1.5177898 Sep 18 08:38:41.528853 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39e9492d-1d20-4278-8c48-0f55411a6ebb service neutron] Pushing event updated for resources: {'Port': ['ID=324203bb-e8cc-4392-974c-20b4f2896cc6,revision_number=3']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:41.580152 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e3c1f61-5395-417e-bcc0-e233938d5b72 service neutron] Pushing event updated for resources: {'Port': ['ID=9a4f8ce9-f706-4c25-b3f4-05f2173cf516,revision_number=3']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:41.582440 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-a2045e47-fe5b-4cde-b268-0683831a7259 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Notify callbacks [] for port, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:41.619467 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-a2045e47-fe5b-4cde-b268-0683831a7259 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:41.637803 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9c65146fa140f7f105fbfe1cfc0ed8a4aa4ddea85af05f4a70363726e3aa059" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3807c902-64e7-4f7c-9d25-636bee8f7ad9" -d '{"events": [{"name": "network-changed", "server_uuid": "6cd27eb8-8447-40a0-9229-d59ec6008eeb", "tag": "324203bb-e8cc-4392-974c-20b4f2896cc6"}]}' {{(pid=94346) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:38:41.695514 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-a2045e47-fe5b-4cde-b268-0683831a7259 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Network fdcbc66e-323e-4b44-be97-566949f4f2ef is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:38:41.701987 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-a2045e47-fe5b-4cde-b268-0683831a7259 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:38:41.711330 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-a2045e47-fe5b-4cde-b268-0683831a7259 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Received port after_create {{(pid=94347) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:38:41.734986 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2045e47-fe5b-4cde-b268-0683831a7259 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Pushing event updated for resources: {'Port': ['ID=59d1e8a2-e4aa-44e5-8014-91de86026543,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:41.769314 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-a2045e47-fe5b-4cde-b268-0683831a7259 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:41.769939 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-a2045e47-fe5b-4cde-b268-0683831a7259 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:41.786594 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:38:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-54fe1f09-3c75-4024-a6c2-5c507af76304 x-openstack-request-id: req-54fe1f09-3c75-4024-a6c2-5c507af76304 {{(pid=94346) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:38:41.787059 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6cd27eb8-8447-40a0-9229-d59ec6008eeb", "tag": "324203bb-e8cc-4392-974c-20b4f2896cc6", "status": "completed", "code": 200}]} {{(pid=94346) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:38:41.787312 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-54fe1f09-3c75-4024-a6c2-5c507af76304 {{(pid=94346) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:38:41.789123 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6cd27eb8-8447-40a0-9229-d59ec6008eeb', 'tag': '324203bb-e8cc-4392-974c-20b4f2896cc6', 'status': 'completed', 'code': 200} Sep 18 08:38:41.792229 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-a2045e47-fe5b-4cde-b268-0683831a7259 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.3303046 Sep 18 08:38:42.246202 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5ebe6d7-87f3-4edd-ab09-ec0cd2f6b2f5 req-01585855-c025-4e43-a31b-e5fa61f63100 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:42.247594 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b5ebe6d7-87f3-4edd-ab09-ec0cd2f6b2f5 req-01585855-c025-4e43-a31b-e5fa61f63100 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 932 time: 0.0473218 Sep 18 08:38:42.283881 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b5ebe6d7-87f3-4edd-ab09-ec0cd2f6b2f5 req-44a3a749-9cad-48b0-b7b4-7e69e0cb85dd tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0305390 Sep 18 08:38:42.433716 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2952db79-fea7-49f9-9fe6-0a0470f28766 req-2fc74841-2aa1-4c1c-8641-8e20e4f51381 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:42.435187 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2952db79-fea7-49f9-9fe6-0a0470f28766 req-2fc74841-2aa1-4c1c-8641-8e20e4f51381 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 944 time: 0.0463431 Sep 18 08:38:42.471782 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2952db79-fea7-49f9-9fe6-0a0470f28766 req-a8ca5126-b2a0-4640-a6f0-507a9f9493aa tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0308845 Sep 18 08:38:42.593760 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-36c5dea6-fd35-4c6b-a7f7-7b761102f717 req-d8867390-009d-404a-94ac-234a6b5fd6bb tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0311596 Sep 18 08:38:42.605123 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-586ef11e-fa0a-4a0f-847b-ab851815a19b req-6c8d4a56-d306-4c15-a033-1a8775958bb0 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:42.606560 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-586ef11e-fa0a-4a0f-847b-ab851815a19b req-6c8d4a56-d306-4c15-a033-1a8775958bb0 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 943 time: 0.0751488 Sep 18 08:38:42.644561 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-586ef11e-fa0a-4a0f-847b-ab851815a19b req-4246020e-4a65-4fd3-abb6-a43236e713c7 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0320797 Sep 18 08:38:42.710592 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:38:43.393135 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43e913da-ecad-4c74-b3c1-8acaa8100dfd req-810a8442-6d2d-477a-b0a6-95b826f820ea tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:43.394698 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-43e913da-ecad-4c74-b3c1-8acaa8100dfd req-810a8442-6d2d-477a-b0a6-95b826f820ea tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 932 time: 0.0482028 Sep 18 08:38:43.431474 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-43e913da-ecad-4c74-b3c1-8acaa8100dfd req-28f7e762-036f-4536-bf12-0a2309670fb6 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0303569 Sep 18 08:38:43.581874 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8acc71c0-a370-4927-89f0-b3edf19c6ad3 req-8c3f90a5-a643-4a61-b564-bb11d823e0ee tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:43.583913 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8acc71c0-a370-4927-89f0-b3edf19c6ad3 req-8c3f90a5-a643-4a61-b564-bb11d823e0ee tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 944 time: 0.0481532 Sep 18 08:38:43.621597 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8acc71c0-a370-4927-89f0-b3edf19c6ad3 req-dbf6e20e-dbb8-4d83-b160-0cf826ab6f52 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324028 Sep 18 08:38:43.692251 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-047b1d37-fe4b-4976-a4a8-7e45b37cc7bb req-e6b53e8e-7ec6-409b-ac6b-01619ea417bb tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0299904 Sep 18 08:38:43.756067 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ff217dc-51ae-4598-b6ca-eb2c7931a0a8 req-db920d5f-bfbc-4c9d-b48d-1abf50651f1a tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:43.757656 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5ff217dc-51ae-4598-b6ca-eb2c7931a0a8 req-db920d5f-bfbc-4c9d-b48d-1abf50651f1a tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 943 time: 0.0476027 Sep 18 08:38:43.789298 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1c2476c0-3321-4eb3-a42d-df9f52eeb4f8', 'tag': '9a4f8ce9-f706-4c25-b3f4-05f2173cf516'}] {{(pid=94346) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:38:43.791530 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9c65146fa140f7f105fbfe1cfc0ed8a4aa4ddea85af05f4a70363726e3aa059" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5bae2fef-0d58-4b69-9459-bbfe67a3bc57" -d '{"events": [{"name": "network-changed", "server_uuid": "1c2476c0-3321-4eb3-a42d-df9f52eeb4f8", "tag": "9a4f8ce9-f706-4c25-b3f4-05f2173cf516"}]}' {{(pid=94346) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:38:43.793754 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5ff217dc-51ae-4598-b6ca-eb2c7931a0a8 req-090b01cd-7cce-48f1-a0c5-06a6a2ffb038 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0302644 Sep 18 08:38:43.825062 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:38:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4baee3a9-4bbb-4863-ba94-b7b9834acc5f x-openstack-request-id: req-4baee3a9-4bbb-4863-ba94-b7b9834acc5f {{(pid=94346) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:38:43.825383 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1c2476c0-3321-4eb3-a42d-df9f52eeb4f8", "tag": "9a4f8ce9-f706-4c25-b3f4-05f2173cf516", "status": "completed", "code": 200}]} {{(pid=94346) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:38:43.825627 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-4baee3a9-4bbb-4863-ba94-b7b9834acc5f {{(pid=94346) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:38:43.826006 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1c2476c0-3321-4eb3-a42d-df9f52eeb4f8', 'tag': '9a4f8ce9-f706-4c25-b3f4-05f2173cf516', 'status': 'completed', 'code': 200} Sep 18 08:38:44.542262 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-484d50ff-5253-4c50-8a0c-d91adea2e7f6 req-dc8ae2fb-9f8d-4c0a-8015-3856ebb0cbb7 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:44.543719 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-484d50ff-5253-4c50-8a0c-d91adea2e7f6 req-dc8ae2fb-9f8d-4c0a-8015-3856ebb0cbb7 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 932 time: 0.0476608 Sep 18 08:38:44.579534 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-484d50ff-5253-4c50-8a0c-d91adea2e7f6 req-d3f13dfe-f554-4cf4-a226-10a184e6c38d tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0299461 Sep 18 08:38:44.738694 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81ffea58-8f11-4bf9-8f87-c1e5e4d33a39 req-b3b3f4f8-db1f-429d-bd2c-fdd896a0d9c2 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:44.740455 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-81ffea58-8f11-4bf9-8f87-c1e5e4d33a39 req-b3b3f4f8-db1f-429d-bd2c-fdd896a0d9c2 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 944 time: 0.0527382 Sep 18 08:38:44.801829 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-81ffea58-8f11-4bf9-8f87-c1e5e4d33a39 req-04df0518-d1fc-420e-935e-60ff8114cabc tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0533838 Sep 18 08:38:44.803804 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0d8ced70-9764-4e20-9a05-6cf72cca3a72 req-c832d6f3-4e1e-4595-a683-0e6a89f66cdf tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0292163 Sep 18 08:38:44.925807 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e98a44d6-3e69-45a2-a5a6-d93ee2d05ed6 req-31a5d6ed-3d9d-478e-97a3-62d2098032ee tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:44.933959 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e98a44d6-3e69-45a2-a5a6-d93ee2d05ed6 req-31a5d6ed-3d9d-478e-97a3-62d2098032ee tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 943 time: 0.0679040 Sep 18 08:38:44.969864 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e98a44d6-3e69-45a2-a5a6-d93ee2d05ed6 req-4050bba3-02cb-49ab-b1e0-4224f0f3f23f tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0330284 Sep 18 08:38:45.175788 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-bb2ee439-fc0a-4418-bd48-ba4c1b74889c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Request body: {'port': {'device_id': 'f8a97551-ea2e-41f9-9a70-491f3e39e166', 'network_id': 'fdcbc66e-323e-4b44-be97-566949f4f2ef', 'admin_state_up': True, 'tenant_id': 'f439efa4eed0456ab2a914377e490fad'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:45.184064 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-885ad1ce-b005-4577-9f28-e871d4c55a49 service neutron] Request body: {'port': {'device_id': 'a8fb23c6-6606-497f-820d-0643e56a39d1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80447'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:45.302250 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-885ad1ce-b005-4577-9f28-e871d4c55a49 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:45.417569 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3807c902-64e7-4f7c-9d25-636bee8f7ad9 req-d434e5ae-ac65-415d-b2fa-63fb2df6abdd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:45.419086 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-3807c902-64e7-4f7c-9d25-636bee8f7ad9 req-d434e5ae-ac65-415d-b2fa-63fb2df6abdd service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=79ab1eeea623437e8ca702571b96da7d&device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 1096 time: 0.2440093 Sep 18 08:38:45.419523 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-bb2ee439-fc0a-4418-bd48-ba4c1b74889c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Made reservation on behalf of f439efa4eed0456ab2a914377e490fad for: {'port': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:38:45.423248 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-bb2ee439-fc0a-4418-bd48-ba4c1b74889c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:45.427509 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9365443-e446-447b-b9f1-13a29817a154 req-38a7fbf2-61b1-40b2-a68a-e1cc2fe0838f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:45.429558 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-d9365443-e446-447b-b9f1-13a29817a154 req-38a7fbf2-61b1-40b2-a68a-e1cc2fe0838f service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=38bd82e43ad3497aa14e8e4e68a29009&device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 1097 time: 0.2085211 Sep 18 08:38:45.594986 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-d9365443-e446-447b-b9f1-13a29817a154 req-9a229586-59f3-4d95-9ec9-d2ecafa7b801 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=9a4f8ce9-f706-4c25-b3f4-05f2173cf516 HTTP/1.1" status: 200 len: 217 time: 0.1087983 Sep 18 08:38:45.613918 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.13', 59093) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:45.768173 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3807c902-64e7-4f7c-9d25-636bee8f7ad9 req-22150030-95ed-4f4c-840d-392ad96a8ec4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:45.770294 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-3807c902-64e7-4f7c-9d25-636bee8f7ad9 req-22150030-95ed-4f4c-840d-392ad96a8ec4 service neutron] 10.222.0.13 "GET /v2.0/networks?tenant_id=79ab1eeea623437e8ca702571b96da7d&shared=False HTTP/1.1" status: 200 len: 913 time: 0.3002193 Sep 18 08:38:45.789234 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9365443-e446-447b-b9f1-13a29817a154 req-6e249767-2300-4d0e-b68e-ee32b8a8ebd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:45.790803 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-d9365443-e446-447b-b9f1-13a29817a154 req-6e249767-2300-4d0e-b68e-ee32b8a8ebd0 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=b96e08ba-91b8-4c1f-bd27-4a1270ccbde2 HTTP/1.1" status: 200 len: 855 time: 0.1499951 Sep 18 08:38:45.839451 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9be57fe-7db2-4dd7-8828-f13ef730c277 req-f1fc462d-34d5-4907-8fa5-b336acff5e23 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:45.841014 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e9be57fe-7db2-4dd7-8828-f13ef730c277 req-f1fc462d-34d5-4907-8fa5-b336acff5e23 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 932 time: 0.1841416 Sep 18 08:38:45.888917 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-d9365443-e446-447b-b9f1-13a29817a154 req-efb00592-b085-4f46-b06c-a9e91f31a3d8 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fe2753d3-7f3b-4739-adbf-6643a840c73e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0819507 Sep 18 08:38:46.060251 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-2ad1fb35-5c26-4ffd-96da-cd70e173140b tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:46.061798 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-2ad1fb35-5c26-4ffd-96da-cd70e173140b tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.13 "GET /v2.0/networks?id=f430397d-03a8-4da2-bd1d-25890a3a0727 HTTP/1.1" status: 200 len: 816 time: 0.4037828 Sep 18 08:38:46.073132 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3807c902-64e7-4f7c-9d25-636bee8f7ad9 req-bd065f82-47fe-497c-b619-ef8fddcb0552 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:46.074767 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-3807c902-64e7-4f7c-9d25-636bee8f7ad9 req-bd065f82-47fe-497c-b619-ef8fddcb0552 service neutron] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2830756 Sep 18 08:38:46.091278 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-d9365443-e446-447b-b9f1-13a29817a154 req-532382b7-b149-41f7-a30a-4640b0e8aa65 service neutron] 10.222.0.13 "GET /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1782634 Sep 18 08:38:46.128567 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-885ad1ce-b005-4577-9f28-e871d4c55a49 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 59d1e8a2-e4aa-44e5-8014-91de86026543 {{(pid=94347) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:38:46.139563 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e9be57fe-7db2-4dd7-8828-f13ef730c277 req-0a91f55f-74b6-40c9-8f97-f15ebf6bf616 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2732742 Sep 18 08:38:46.141276 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-885ad1ce-b005-4577-9f28-e871d4c55a49 service neutron] Notify callbacks [] for port, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:46.166153 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afd4d978-397b-45fa-ab5e-e1da6b6f1878 req-ec8d207b-86da-4735-b6be-e03e62293eac tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:46.168122 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-afd4d978-397b-45fa-ab5e-e1da6b6f1878 req-ec8d207b-86da-4735-b6be-e03e62293eac tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 944 time: 0.1468122 Sep 18 08:38:46.216317 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.provisioning_blocks [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-885ad1ce-b005-4577-9f28-e871d4c55a49 service neutron] Transition to ACTIVE for port object 59d1e8a2-e4aa-44e5-8014-91de86026543 will not be triggered until provisioned by entity L2. {{(pid=94347) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 18 08:38:46.242685 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-885ad1ce-b005-4577-9f28-e871d4c55a49 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:46.263058 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-d9365443-e446-447b-b9f1-13a29817a154 req-83a77af4-9933-42b2-8abd-0a57ffc1874d service neutron] 10.222.0.13 "GET /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0939941 Sep 18 08:38:46.315796 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-79d93729-c8e4-424a-a17b-bc66ce0882be tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.13 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=0700a96e9b3f48e8b6bcdd75b820b813 HTTP/1.1" status: 200 len: 379 time: 0.1465163 Sep 18 08:38:46.353722 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-922c3cb9-0d66-4e44-9822-5a0e620d1865 req-f168ea74-639b-4da8-9e7a-510eadf5e497 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.1204481 Sep 18 08:38:46.368590 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-afd4d978-397b-45fa-ab5e-e1da6b6f1878 req-1e63dfa6-5334-4eb1-b9f9-aafe72cb4e5c tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1885879 Sep 18 08:38:46.387184 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_common [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-bb2ee439-fc0a-4418-bd48-ba4c1b74889c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Allocated IP 172.20.0.8 (fdcbc66e-323e-4b44-be97-566949f4f2ef/e5dc6eef-e778-41a2-a708-c7810ade97db/b03411eb-66ff-4691-88c8-2c570d78c323) {{(pid=94347) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:38:46.393255 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-885ad1ce-b005-4577-9f28-e871d4c55a49 service neutron] Pushing event updated for resources: {'Port': ['ID=59d1e8a2-e4aa-44e5-8014-91de86026543,revision_number=2']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:46.572716 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a83fee-a0c2-432c-8553-900511555436 req-5b8437c3-d623-40bd-aba1-736d253a412d tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:46.574200 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-32a83fee-a0c2-432c-8553-900511555436 req-5b8437c3-d623-40bd-aba1-736d253a412d tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 943 time: 0.1356206 Sep 18 08:38:46.574908 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-885ad1ce-b005-4577-9f28-e871d4c55a49 service neutron] Attempting to bind port 59d1e8a2-e4aa-44e5-8014-91de86026543 on host hv-cinder-80447 for vnic_type normal with profile {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:38:46.575335 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-885ad1ce-b005-4577-9f28-e871d4c55a49 service neutron] Attempting to bind port 59d1e8a2-e4aa-44e5-8014-91de86026543 by drivers openvswitch,hyperv on host hv-cinder-80447 at level 0 using segments [{'id': 'cb92e74f-7545-44c8-a2d3-634d116af362', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 204, 'network_id': 'fdcbc66e-323e-4b44-be97-566949f4f2ef'}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:38:46.575675 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-885ad1ce-b005-4577-9f28-e871d4c55a49 service neutron] Attempting to bind port 59d1e8a2-e4aa-44e5-8014-91de86026543 on network fdcbc66e-323e-4b44-be97-566949f4f2ef {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:38:46.591396 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-885ad1ce-b005-4577-9f28-e871d4c55a49 service neutron] Port 59d1e8a2-e4aa-44e5-8014-91de86026543 on network fdcbc66e-323e-4b44-be97-566949f4f2ef not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80447 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 18 08:38:46.591709 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-885ad1ce-b005-4577-9f28-e871d4c55a49 service neutron] Attempting to bind port 59d1e8a2-e4aa-44e5-8014-91de86026543 on network fdcbc66e-323e-4b44-be97-566949f4f2ef {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:38:46.630701 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-885ad1ce-b005-4577-9f28-e871d4c55a49 service neutron] Checking agent: {'id': '8d51fdc4-974b-4200-9c3f-5dddea60a869', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80447', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'started_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 38, 20), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:38:46.631299 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-885ad1ce-b005-4577-9f28-e871d4c55a49 service neutron] Checking segment: {'id': 'cb92e74f-7545-44c8-a2d3-634d116af362', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 204, 'network_id': 'fdcbc66e-323e-4b44-be97-566949f4f2ef'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94347) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:38:46.631495 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-885ad1ce-b005-4577-9f28-e871d4c55a49 service neutron] Bound using segment: {'id': 'cb92e74f-7545-44c8-a2d3-634d116af362', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 204, 'network_id': 'fdcbc66e-323e-4b44-be97-566949f4f2ef'} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:38:46.632710 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-885ad1ce-b005-4577-9f28-e871d4c55a49 service neutron] Bound port: 59d1e8a2-e4aa-44e5-8014-91de86026543, host: hv-cinder-80447, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'cb92e74f-7545-44c8-a2d3-634d116af362', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 204, 'network_id': 'fdcbc66e-323e-4b44-be97-566949f4f2ef'}}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:38:46.633069 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-885ad1ce-b005-4577-9f28-e871d4c55a49 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:46.704264 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-32a83fee-a0c2-432c-8553-900511555436 req-ffa2e69c-e820-4ca1-a469-6c41103fd89f tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1160614 Sep 18 08:38:46.735256 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-bb2ee439-fc0a-4418-bd48-ba4c1b74889c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Notify callbacks [] for port, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:46.752736 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-885ad1ce-b005-4577-9f28-e871d4c55a49 service neutron] For port 59d1e8a2-e4aa-44e5-8014-91de86026543, host hv-cinder-80447, cleared binding levels {{(pid=94347) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:38:46.758627 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-885ad1ce-b005-4577-9f28-e871d4c55a49 service neutron] For port 59d1e8a2-e4aa-44e5-8014-91de86026543, host hv-cinder-80447, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=59d1e8a2-e4aa-44e5-8014-91de86026543,segment=NetworkSegment(cb92e74f-7545-44c8-a2d3-634d116af362),segment_id=cb92e74f-7545-44c8-a2d3-634d116af362)] {{(pid=94347) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:38:46.764959 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-885ad1ce-b005-4577-9f28-e871d4c55a49 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:46.806796 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-885ad1ce-b005-4577-9f28-e871d4c55a49 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:46.807414 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-885ad1ce-b005-4577-9f28-e871d4c55a49 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:46.809225 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-885ad1ce-b005-4577-9f28-e871d4c55a49 service neutron] 10.222.0.13 "PUT /v2.0/ports/59d1e8a2-e4aa-44e5-8014-91de86026543 HTTP/1.1" status: 200 len: 1094 time: 1.6301360 Sep 18 08:38:46.812432 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a8fb23c6-6606-497f-820d-0643e56a39d1', 'tag': '59d1e8a2-e4aa-44e5-8014-91de86026543'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:38:46.847534 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-bb2ee439-fc0a-4418-bd48-ba4c1b74889c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:46.862857 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-885ad1ce-b005-4577-9f28-e871d4c55a49 service neutron] Pushing event updated for resources: {'Port': ['ID=59d1e8a2-e4aa-44e5-8014-91de86026543,revision_number=3']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:46.874383 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f9f3c1e1-f39d-4b17-a585-099816339eaa" -d '{"events": [{"name": "network-changed", "server_uuid": "a8fb23c6-6606-497f-820d-0643e56a39d1", "tag": "59d1e8a2-e4aa-44e5-8014-91de86026543"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:38:46.908506 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-bb2ee439-fc0a-4418-bd48-ba4c1b74889c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Network fdcbc66e-323e-4b44-be97-566949f4f2ef is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:38:46.911545 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-bb2ee439-fc0a-4418-bd48-ba4c1b74889c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:38:46.915175 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-bb2ee439-fc0a-4418-bd48-ba4c1b74889c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Received port after_create {{(pid=94347) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:38:46.948906 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb2ee439-fc0a-4418-bd48-ba4c1b74889c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Pushing event updated for resources: {'Port': ['ID=b03411eb-66ff-4691-88c8-2c570d78c323,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:46.970501 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-bb2ee439-fc0a-4418-bd48-ba4c1b74889c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:46.971125 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-bb2ee439-fc0a-4418-bd48-ba4c1b74889c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:46.981991 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:38:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5146d2d7-e49d-4eec-8eed-c487eb30fe83 x-openstack-request-id: req-5146d2d7-e49d-4eec-8eed-c487eb30fe83 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:38:46.982282 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a8fb23c6-6606-497f-820d-0643e56a39d1", "tag": "59d1e8a2-e4aa-44e5-8014-91de86026543", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:38:46.982534 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-5146d2d7-e49d-4eec-8eed-c487eb30fe83 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:38:46.982984 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a8fb23c6-6606-497f-820d-0643e56a39d1', 'tag': '59d1e8a2-e4aa-44e5-8014-91de86026543', 'status': 'completed', 'code': 200} Sep 18 08:38:46.984927 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-bb2ee439-fc0a-4418-bd48-ba4c1b74889c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.8131733 Sep 18 08:38:47.256904 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25397cc5-cdb2-4610-a022-608b94a61edc req-62c608dd-f5ac-4a61-adc8-3edfaa729b96 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:47.259086 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-25397cc5-cdb2-4610-a022-608b94a61edc req-62c608dd-f5ac-4a61-adc8-3edfaa729b96 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 944 time: 0.0513024 Sep 18 08:38:47.294944 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-25397cc5-cdb2-4610-a022-608b94a61edc req-ff3c22ac-e0f9-4f80-ba8b-0dba0687cfc2 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0298800 Sep 18 08:38:47.461276 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-095b7573-e328-476a-a95a-0b332b7b4ee9 req-343764b2-7bb0-48d6-aaf4-fb35b63884b9 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0335391 Sep 18 08:38:47.503030 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09a5afa1-921c-4d50-9c72-62c103c789ed req-1eff1641-87c8-408f-80b4-3513eaff5695 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:47.504511 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-09a5afa1-921c-4d50-9c72-62c103c789ed req-1eff1641-87c8-408f-80b4-3513eaff5695 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 944 time: 0.0664551 Sep 18 08:38:47.540866 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-09a5afa1-921c-4d50-9c72-62c103c789ed req-3e43b929-4c79-49e6-929d-c247f66207a5 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0304327 Sep 18 08:38:47.813772 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e90dd68-b294-4c47-8d33-d40d3feaa0be req-cd62c2b0-fc7b-4209-9cb9-e38a4515e7b8 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:47.815251 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4e90dd68-b294-4c47-8d33-d40d3feaa0be req-cd62c2b0-fc7b-4209-9cb9-e38a4515e7b8 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 943 time: 0.0475724 Sep 18 08:38:47.852382 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4e90dd68-b294-4c47-8d33-d40d3feaa0be req-907430e1-fc48-43ac-9957-193cae818e0b tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313437 Sep 18 08:38:48.404728 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acd3b294-68e2-483d-b770-4fa11f931c35 req-f21e54e3-dbb9-4fbb-b573-f0a03b747f2f tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:48.406194 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-acd3b294-68e2-483d-b770-4fa11f931c35 req-f21e54e3-dbb9-4fbb-b573-f0a03b747f2f tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 944 time: 0.0467262 Sep 18 08:38:48.441018 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-acd3b294-68e2-483d-b770-4fa11f931c35 req-c8c8047a-0f02-4165-b802-553dfa776bdb tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0291381 Sep 18 08:38:48.562592 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6af8e12c-1c46-4cbc-b877-44e8f0a4bf78 req-b9990fa3-fac5-409f-8a92-ea028daf89c5 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0289245 Sep 18 08:38:48.650677 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75f4430b-4e13-4eb8-aa35-855b5448cc9c req-1020f02a-5726-4220-b99b-d370a040008a tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:48.652113 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-75f4430b-4e13-4eb8-aa35-855b5448cc9c req-1020f02a-5726-4220-b99b-d370a040008a tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 944 time: 0.0470991 Sep 18 08:38:48.688077 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-75f4430b-4e13-4eb8-aa35-855b5448cc9c req-238849bc-87c4-46a5-bd32-e6c8c23f5566 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0301638 Sep 18 08:38:48.961922 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21cfaa1c-0ad8-4f82-b4ba-fae4f36d8961 req-b003bac5-356e-4c0d-bbc1-a9f3cbef819e tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:48.963417 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-21cfaa1c-0ad8-4f82-b4ba-fae4f36d8961 req-b003bac5-356e-4c0d-bbc1-a9f3cbef819e tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 943 time: 0.0478513 Sep 18 08:38:49.000433 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-21cfaa1c-0ad8-4f82-b4ba-fae4f36d8961 req-3cbd25fb-c977-40f4-94f8-bd82f375bc69 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0308802 Sep 18 08:38:49.550016 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfac0271-7522-4d8f-bbff-35f529bad0cd req-d27f8836-4075-4eb4-b35f-64c63fe8b122 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:49.551469 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dfac0271-7522-4d8f-bbff-35f529bad0cd req-d27f8836-4075-4eb4-b35f-64c63fe8b122 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 944 time: 0.0462463 Sep 18 08:38:49.592544 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dfac0271-7522-4d8f-bbff-35f529bad0cd req-e0b4e058-355f-4c33-a804-3d71a93a339e tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0347686 Sep 18 08:38:49.599745 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-0ce15e77-d8a7-4fab-9fb7-410559e712c8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:49.661433 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1c9cab2f-669e-4adb-b98d-06275e607717 req-4d8f1dc7-2e96-44e8-9361-9897df4ba401 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0248866 Sep 18 08:38:49.799554 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac3ff590-a7b7-4f9e-9ce6-8c3af62c2949 req-1074f3dc-967d-4b85-9b14-2012d3e32e9f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:49.801008 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ac3ff590-a7b7-4f9e-9ce6-8c3af62c2949 req-1074f3dc-967d-4b85-9b14-2012d3e32e9f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 944 time: 0.0479186 Sep 18 08:38:49.837424 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ac3ff590-a7b7-4f9e-9ce6-8c3af62c2949 req-d4363dbb-561e-485e-885f-03b19cf0d136 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0299315 Sep 18 08:38:49.855757 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:49.927123 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-42fea611-f5fe-48e7-912e-21a5d93ff6ff tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Request body: {'port': {'device_id': '4248ac92-ce7b-4560-9f83-de05a7069a99', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'admin_state_up': True, 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'security_groups': ['45b78aa4-0988-48f2-8caf-b16f679dcdf8']}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:49.946114 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-a3397d79-abd5-412b-bbc0-135a12db72bd service neutron] Request body: {'port': {'device_id': 'f8a97551-ea2e-41f9-9a70-491f3e39e166', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80447'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:49.985858 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-e8de8828-b61b-4b88-8fe5-8aa10bae2feb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:49.987382 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-e8de8828-b61b-4b88-8fe5-8aa10bae2feb service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=79ab1eeea623437e8ca702571b96da7d&device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 1096 time: 0.0484500 Sep 18 08:38:50.078939 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-2236aa3d-e4e2-480e-913b-2f7818359a47 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=324203bb-e8cc-4392-974c-20b4f2896cc6 HTTP/1.1" status: 200 len: 217 time: 0.0551701 Sep 18 08:38:50.108275 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-a3397d79-abd5-412b-bbc0-135a12db72bd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:50.124393 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bae2fef-0d58-4b69-9459-bbfe67a3bc57 req-0d9f8598-4c14-42ec-851e-be74c5b2016a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:50.125916 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-5bae2fef-0d58-4b69-9459-bbfe67a3bc57 req-0d9f8598-4c14-42ec-851e-be74c5b2016a service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=38bd82e43ad3497aa14e8e4e68a29009&device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 1097 time: 0.1010590 Sep 18 08:38:50.161647 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-0ba2b420-b869-446d-965f-485051e213bf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:50.163087 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-0ba2b420-b869-446d-965f-485051e213bf service neutron] 10.222.0.13 "GET /v2.0/subnets?id=9ed653e4-68a0-4108-b090-7571bdc067bc HTTP/1.1" status: 200 len: 852 time: 0.0742893 Sep 18 08:38:50.196604 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9f3c1e1-f39d-4b17-a585-099816339eaa req-3696f93f-bb07-4e64-8a59-91583141b0d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:50.198102 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f9f3c1e1-f39d-4b17-a585-099816339eaa req-3696f93f-bb07-4e64-8a59-91583141b0d3 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=f439efa4eed0456ab2a914377e490fad&device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 1097 time: 0.1633925 Sep 18 08:38:50.215921 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-dad47696-b85f-498a-854a-f1ac1f0559af service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=2c7737b5-792d-4a8d-bacc-cd5c180b7fc0&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0383425 Sep 18 08:38:50.224244 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-874e8e87-a14e-427f-8060-ce38f45d2903 req-14ad0528-58d3-42f4-a9a6-d15d29579248 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:50.226287 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-874e8e87-a14e-427f-8060-ce38f45d2903 req-14ad0528-58d3-42f4-a9a6-d15d29579248 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 943 time: 0.1364114 Sep 18 08:38:50.235594 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-42fea611-f5fe-48e7-912e-21a5d93ff6ff tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Made reservation on behalf of 0700a96e9b3f48e8b6bcdd75b820b813 for: {'port': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:38:50.239002 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-42fea611-f5fe-48e7-912e-21a5d93ff6ff tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:50.353688 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bae2fef-0d58-4b69-9459-bbfe67a3bc57 req-18dcef4a-b486-42e1-a923-7062e544fc62 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:50.355174 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-5bae2fef-0d58-4b69-9459-bbfe67a3bc57 req-18dcef4a-b486-42e1-a923-7062e544fc62 service neutron] 10.222.0.13 "GET /v2.0/networks?id=fe2753d3-7f3b-4739-adbf-6643a840c73e HTTP/1.1" status: 200 len: 916 time: 0.2221663 Sep 18 08:38:50.401502 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-5bae2fef-0d58-4b69-9459-bbfe67a3bc57 req-ee1a65f7-c6b0-4cd3-8ab8-56c18337d693 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=9a4f8ce9-f706-4c25-b3f4-05f2173cf516 HTTP/1.1" status: 200 len: 217 time: 0.0382166 Sep 18 08:38:50.441839 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-48cf729e-f573-41f3-83aa-e0c33c3bf1b5 service neutron] 10.222.0.13 "GET /v2.0/networks/2c7737b5-792d-4a8d-bacc-cd5c180b7fc0?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1724455 Sep 18 08:38:50.481380 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bae2fef-0d58-4b69-9459-bbfe67a3bc57 req-23c6d600-9f07-4210-9276-d1ee0889e89e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:50.482801 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-5bae2fef-0d58-4b69-9459-bbfe67a3bc57 req-23c6d600-9f07-4210-9276-d1ee0889e89e service neutron] 10.222.0.13 "GET /v2.0/subnets?id=b96e08ba-91b8-4c1f-bd27-4a1270ccbde2 HTTP/1.1" status: 200 len: 855 time: 0.0713177 Sep 18 08:38:50.542691 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-5bae2fef-0d58-4b69-9459-bbfe67a3bc57 req-5c522f53-cf6a-4c2f-9e54-509eab5eb72f service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fe2753d3-7f3b-4739-adbf-6643a840c73e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0309782 Sep 18 08:38:50.561551 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-c2a46b45-0b77-4811-9760-958f83a3e8a5 service neutron] 10.222.0.13 "GET /v2.0/networks/2c7737b5-792d-4a8d-bacc-cd5c180b7fc0?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1124876 Sep 18 08:38:50.649482 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-874e8e87-a14e-427f-8060-ce38f45d2903 req-90e7dc85-a8a6-4872-a93b-c3c502714a35 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4147468 Sep 18 08:38:50.822068 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9f3c1e1-f39d-4b17-a585-099816339eaa req-b2b4624a-8e11-4a0c-9647-53dd238058fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:50.823508 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f9f3c1e1-f39d-4b17-a585-099816339eaa req-b2b4624a-8e11-4a0c-9647-53dd238058fb service neutron] 10.222.0.13 "GET /v2.0/networks?tenant_id=f439efa4eed0456ab2a914377e490fad&shared=False HTTP/1.1" status: 200 len: 919 time: 0.3834591 Sep 18 08:38:50.839309 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-5bae2fef-0d58-4b69-9459-bbfe67a3bc57 req-f1496643-a4ea-41bc-a7e4-96b09c640142 service neutron] 10.222.0.13 "GET /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2594659 Sep 18 08:38:50.856909 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-90bf53dc-87bd-4266-8b28-2a55fad7d0c6 req-1093bf39-b320-445f-992c-c2d6a950ccf7 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0867386 Sep 18 08:38:50.891929 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_common [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-42fea611-f5fe-48e7-912e-21a5d93ff6ff tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Allocated IP 172.20.0.12 (f430397d-03a8-4da2-bd1d-25890a3a0727/acdeb8a1-5de9-425f-ae0a-890d310246e9/2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1) {{(pid=94347) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:38:50.908035 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3bb8a62-b907-41cb-98cf-9c7d08f949ab req-c8b3e95e-03dd-4865-bedb-5c269f915fb8 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:50.909558 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b3bb8a62-b907-41cb-98cf-9c7d08f949ab req-c8b3e95e-03dd-4865-bedb-5c269f915fb8 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 944 time: 0.1884468 Sep 18 08:38:50.971332 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-5bae2fef-0d58-4b69-9459-bbfe67a3bc57 req-50367c77-195a-49ae-8e7c-d56e7385db6f service neutron] 10.222.0.13 "GET /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0834177 Sep 18 08:38:51.163260 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b3bb8a62-b907-41cb-98cf-9c7d08f949ab req-f081fdef-8629-4e2c-b28e-d81fcafaa656 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2423248 Sep 18 08:38:51.165018 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-a3397d79-abd5-412b-bbc0-135a12db72bd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b03411eb-66ff-4691-88c8-2c570d78c323 {{(pid=94347) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:38:51.186889 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-a3397d79-abd5-412b-bbc0-135a12db72bd service neutron] Notify callbacks [] for port, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:51.234203 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d357adb-23a5-4da7-a94a-0c17fe45f47c req-118e1fce-b0cd-466c-b6d5-8ef9e9181763 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:51.235673 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4d357adb-23a5-4da7-a94a-0c17fe45f47c req-118e1fce-b0cd-466c-b6d5-8ef9e9181763 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 944 time: 0.2882397 Sep 18 08:38:51.239785 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9f3c1e1-f39d-4b17-a585-099816339eaa req-5fba4850-7869-43c8-9d90-43aa724a1216 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:51.241125 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f9f3c1e1-f39d-4b17-a585-099816339eaa req-5fba4850-7869-43c8-9d90-43aa724a1216 service neutron] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3526616 Sep 18 08:38:51.243147 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.provisioning_blocks [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-a3397d79-abd5-412b-bbc0-135a12db72bd service neutron] Transition to ACTIVE for port object b03411eb-66ff-4691-88c8-2c570d78c323 will not be triggered until provisioned by entity L2. {{(pid=94347) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 18 08:38:51.252418 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-a3397d79-abd5-412b-bbc0-135a12db72bd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:51.402583 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4d357adb-23a5-4da7-a94a-0c17fe45f47c req-1a54d1f2-8dd2-4dc3-a640-4549a244f25a tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1603906 Sep 18 08:38:51.426487 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3397d79-abd5-412b-bbc0-135a12db72bd service neutron] Pushing event updated for resources: {'Port': ['ID=b03411eb-66ff-4691-88c8-2c570d78c323,revision_number=2']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:51.440196 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-42fea611-f5fe-48e7-912e-21a5d93ff6ff tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for port, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:51.497597 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-9d66e7f5-9be6-4c63-8378-14ac6a08166b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:51.499187 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-9d66e7f5-9be6-4c63-8378-14ac6a08166b service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=f439efa4eed0456ab2a914377e490fad&device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 1097 time: 0.1859438 Sep 18 08:38:51.584699 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-c737332b-23c7-4151-b32f-dfca672eb273 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=59d1e8a2-e4aa-44e5-8014-91de86026543 HTTP/1.1" status: 200 len: 217 time: 0.0685108 Sep 18 08:38:51.609889 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-a3397d79-abd5-412b-bbc0-135a12db72bd service neutron] Attempting to bind port b03411eb-66ff-4691-88c8-2c570d78c323 on host hv-cinder-80447 for vnic_type normal with profile {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:38:51.610221 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-a3397d79-abd5-412b-bbc0-135a12db72bd service neutron] Attempting to bind port b03411eb-66ff-4691-88c8-2c570d78c323 by drivers openvswitch,hyperv on host hv-cinder-80447 at level 0 using segments [{'id': 'cb92e74f-7545-44c8-a2d3-634d116af362', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 204, 'network_id': 'fdcbc66e-323e-4b44-be97-566949f4f2ef'}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:38:51.610545 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-a3397d79-abd5-412b-bbc0-135a12db72bd service neutron] Attempting to bind port b03411eb-66ff-4691-88c8-2c570d78c323 on network fdcbc66e-323e-4b44-be97-566949f4f2ef {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:38:51.634340 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-42fea611-f5fe-48e7-912e-21a5d93ff6ff tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:51.645828 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-a3397d79-abd5-412b-bbc0-135a12db72bd service neutron] Port b03411eb-66ff-4691-88c8-2c570d78c323 on network fdcbc66e-323e-4b44-be97-566949f4f2ef not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80447 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 18 08:38:51.646145 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-a3397d79-abd5-412b-bbc0-135a12db72bd service neutron] Attempting to bind port b03411eb-66ff-4691-88c8-2c570d78c323 on network fdcbc66e-323e-4b44-be97-566949f4f2ef {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:38:51.676852 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-a3397d79-abd5-412b-bbc0-135a12db72bd service neutron] Checking agent: {'id': '8d51fdc4-974b-4200-9c3f-5dddea60a869', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80447', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'started_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 38, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:38:51.677113 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-a3397d79-abd5-412b-bbc0-135a12db72bd service neutron] Checking segment: {'id': 'cb92e74f-7545-44c8-a2d3-634d116af362', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 204, 'network_id': 'fdcbc66e-323e-4b44-be97-566949f4f2ef'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94347) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:38:51.677510 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-a3397d79-abd5-412b-bbc0-135a12db72bd service neutron] Bound using segment: {'id': 'cb92e74f-7545-44c8-a2d3-634d116af362', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 204, 'network_id': 'fdcbc66e-323e-4b44-be97-566949f4f2ef'} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:38:51.677943 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-a3397d79-abd5-412b-bbc0-135a12db72bd service neutron] Bound port: b03411eb-66ff-4691-88c8-2c570d78c323, host: hv-cinder-80447, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'cb92e74f-7545-44c8-a2d3-634d116af362', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 204, 'network_id': 'fdcbc66e-323e-4b44-be97-566949f4f2ef'}}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:38:51.678286 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-a3397d79-abd5-412b-bbc0-135a12db72bd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:51.695328 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-42fea611-f5fe-48e7-912e-21a5d93ff6ff tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Network f430397d-03a8-4da2-bd1d-25890a3a0727 is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:38:51.705303 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-a7c370d5-b43b-4101-a381-16971d2be48d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:51.706758 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-a7c370d5-b43b-4101-a381-16971d2be48d service neutron] 10.222.0.13 "GET /v2.0/subnets?id=e5dc6eef-e778-41a2-a708-c7810ade97db HTTP/1.1" status: 200 len: 858 time: 0.1143785 Sep 18 08:38:51.707531 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-42fea611-f5fe-48e7-912e-21a5d93ff6ff tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:38:51.712426 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-42fea611-f5fe-48e7-912e-21a5d93ff6ff tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Received port after_create {{(pid=94347) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:38:51.807108 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42fea611-f5fe-48e7-912e-21a5d93ff6ff tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Pushing event updated for resources: {'Port': ['ID=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:51.811177 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-820c9fc1-1dea-4f14-9394-0ebf15c6973a service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fdcbc66e-323e-4b44-be97-566949f4f2ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0947864 Sep 18 08:38:51.918066 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-42fea611-f5fe-48e7-912e-21a5d93ff6ff tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:51.918741 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-42fea611-f5fe-48e7-912e-21a5d93ff6ff tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:51.992401 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-4d54013a-87dd-4919-b0df-2c9971b07288 None None] Provisioning complete for port 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:38:51.992953 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-4d54013a-87dd-4919-b0df-2c9971b07288 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:52.041912 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-4d54013a-87dd-4919-b0df-2c9971b07288 None None] Port 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:38:52.181161 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-42fea611-f5fe-48e7-912e-21a5d93ff6ff tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.2577150 Sep 18 08:38:52.203546 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8681fce2-1860-4dde-a58e-db8a7c133b47 req-6aa31727-e1bc-4fa4-a380-7f9f8bbe98cb tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:52.205059 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8681fce2-1860-4dde-a58e-db8a7c133b47 req-6aa31727-e1bc-4fa4-a380-7f9f8bbe98cb tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 943 time: 0.4256113 Sep 18 08:38:52.210955 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-a3397d79-abd5-412b-bbc0-135a12db72bd service neutron] For port b03411eb-66ff-4691-88c8-2c570d78c323, host hv-cinder-80447, cleared binding levels {{(pid=94347) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:38:52.217401 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-03bb9956-dc48-4c24-bd3c-ef920a5d60e7 service neutron] Request body: {'port': {'device_id': '4248ac92-ce7b-4560-9f83-de05a7069a99', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80447'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:52.245073 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-a3397d79-abd5-412b-bbc0-135a12db72bd service neutron] For port b03411eb-66ff-4691-88c8-2c570d78c323, host hv-cinder-80447, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=b03411eb-66ff-4691-88c8-2c570d78c323,segment=NetworkSegment(cb92e74f-7545-44c8-a2d3-634d116af362),segment_id=cb92e74f-7545-44c8-a2d3-634d116af362)] {{(pid=94347) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:38:52.276120 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-a3397d79-abd5-412b-bbc0-135a12db72bd service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:52.329607 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-b1f2be61-bbfc-451b-8b83-09eee03433c5 service neutron] 10.222.0.13 "GET /v2.0/networks/fdcbc66e-323e-4b44-be97-566949f4f2ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4859695 Sep 18 08:38:52.379503 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81d3c64a-2e9d-4634-8340-508771d0415f req-370001a4-2c4c-46e2-a492-2aca9eb3be10 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:52.380988 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-81d3c64a-2e9d-4634-8340-508771d0415f req-370001a4-2c4c-46e2-a492-2aca9eb3be10 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 932 time: 0.2319174 Sep 18 08:38:52.385302 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-a3397d79-abd5-412b-bbc0-135a12db72bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:52.386314 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-a3397d79-abd5-412b-bbc0-135a12db72bd service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:52.388522 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-a3397d79-abd5-412b-bbc0-135a12db72bd service neutron] 10.222.0.13 "PUT /v2.0/ports/b03411eb-66ff-4691-88c8-2c570d78c323 HTTP/1.1" status: 200 len: 1093 time: 2.4465048 Sep 18 08:38:52.394099 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-b7f061e2-5986-445d-af5b-79dfc20939da None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:52.395925 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f8a97551-ea2e-41f9-9a70-491f3e39e166', 'tag': 'b03411eb-66ff-4691-88c8-2c570d78c323'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:38:52.398227 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5c578f1b-32c1-42d8-8a25-6ccc9c841a10" -d '{"events": [{"name": "network-changed", "server_uuid": "f8a97551-ea2e-41f9-9a70-491f3e39e166", "tag": "b03411eb-66ff-4691-88c8-2c570d78c323"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:38:52.419745 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 55592) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:52.439364 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-03bb9956-dc48-4c24-bd3c-ef920a5d60e7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:52.444588 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8681fce2-1860-4dde-a58e-db8a7c133b47 req-ff9aba3a-ed0c-4f3f-9c70-279d83f2ee09 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2209764 Sep 18 08:38:52.482961 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3397d79-abd5-412b-bbc0-135a12db72bd service neutron] Pushing event updated for resources: {'Port': ['ID=b03411eb-66ff-4691-88c8-2c570d78c323,revision_number=3']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:52.582120 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-4f8e5254-f9ae-4765-84fd-97bb8c96ad44 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:52.613974 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-81d3c64a-2e9d-4634-8340-508771d0415f req-97a822ac-6f85-410c-a119-86d58dacd5ea tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1967199 Sep 18 08:38:52.665770 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-28565129-f6be-4abd-bc90-b5fd5d20adea req-7ed51503-58a3-41be-8498-61e24a0719b2 service neutron] 10.222.0.13 "GET /v2.0/networks/fdcbc66e-323e-4b44-be97-566949f4f2ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3133743 Sep 18 08:38:52.674427 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-5fb5281c-6987-4379-acd7-2f2428ff5a43 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:52.675903 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-5fb5281c-6987-4379-acd7-2f2428ff5a43 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=f439efa4eed0456ab2a914377e490fad&device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 1096 time: 0.2192547 Sep 18 08:38:52.729443 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:38:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-43a1832e-f592-4a20-b2ca-bafb0a510b9b x-openstack-request-id: req-43a1832e-f592-4a20-b2ca-bafb0a510b9b {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:38:52.729941 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f8a97551-ea2e-41f9-9a70-491f3e39e166", "tag": "b03411eb-66ff-4691-88c8-2c570d78c323", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:38:52.730183 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-43a1832e-f592-4a20-b2ca-bafb0a510b9b {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:38:52.730726 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f8a97551-ea2e-41f9-9a70-491f3e39e166', 'tag': 'b03411eb-66ff-4691-88c8-2c570d78c323', 'status': 'completed', 'code': 200} Sep 18 08:38:52.754530 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6a761f2-f8cb-48ff-8847-09cf382630e0 req-3a1f620e-a011-411c-977e-cf6c97f4dfff tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:52.756041 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a6a761f2-f8cb-48ff-8847-09cf382630e0 req-3a1f620e-a011-411c-977e-cf6c97f4dfff tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 944 time: 0.2034028 Sep 18 08:38:52.759479 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-4f8e5254-f9ae-4765-84fd-97bb8c96ad44 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:52.769480 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-4f8e5254-f9ae-4765-84fd-97bb8c96ad44 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:52.790145 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-cd79d258-4e8d-4866-9dc5-7d5069dcb6af service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b03411eb-66ff-4691-88c8-2c570d78c323 HTTP/1.1" status: 200 len: 217 time: 0.0664001 Sep 18 08:38:52.845356 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-4f8e5254-f9ae-4765-84fd-97bb8c96ad44 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=d3854c8517a849f7803f828016b3b050&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4238031 Sep 18 08:38:52.847527 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 55614) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:52.872235 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f8e5254-f9ae-4765-84fd-97bb8c96ad44 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8341ab65-af80-4cad-99d5-d34982f2112f,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:52.966925 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a6a761f2-f8cb-48ff-8847-09cf382630e0 req-2e58f067-c501-42a6-8200-338f43d429d3 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1815188 Sep 18 08:38:52.968207 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-8aa7b1aa-a315-44df-86eb-2dfea462c56b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:52.969852 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-8aa7b1aa-a315-44df-86eb-2dfea462c56b service neutron] 10.222.0.13 "GET /v2.0/subnets?id=e5dc6eef-e778-41a2-a708-c7810ade97db HTTP/1.1" status: 200 len: 858 time: 0.1609728 Sep 18 08:38:52.994723 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 55618) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:53.023442 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-36a8ab88-c196-4404-a220-2dc785770818 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fdcbc66e-323e-4b44-be97-566949f4f2ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0411160 Sep 18 08:38:53.036607 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7f60b57-62c3-4db4-956b-032580ea1a17 req-652115db-cd96-471d-93a3-5fbcda422980 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:53.038101 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c7f60b57-62c3-4db4-956b-032580ea1a17 req-652115db-cd96-471d-93a3-5fbcda422980 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 944 time: 0.1936734 Sep 18 08:38:53.099370 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-799739ad-3468-4654-9f61-7a419265da3e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:53.103552 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-805222da-5bb8-4e85-8b53-36a906118312 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:53.177988 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-799739ad-3468-4654-9f61-7a419265da3e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:53.183031 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:53.192522 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-805222da-5bb8-4e85-8b53-36a906118312 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:53.197855 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-805222da-5bb8-4e85-8b53-36a906118312 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:53.201199 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c7f60b57-62c3-4db4-956b-032580ea1a17 req-7d416e12-00fe-4eb2-8c93-38460fec1b02 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1568723 Sep 18 08:38:53.235921 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-805222da-5bb8-4e85-8b53-36a906118312 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8f2903d4-d218-45b9-a34c-939b1d25fb12,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:53.248601 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-805222da-5bb8-4e85-8b53-36a906118312 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=8ac81dcd50d24b818772c040e9a652b8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2511296 Sep 18 08:38:53.249895 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 55624) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:53.264942 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-03bb9956-dc48-4c24-bd3c-ef920a5d60e7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 {{(pid=94347) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:38:53.269825 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-7efc8d1f-a5cf-4e99-a66b-0e25bce6ca48 service neutron] 10.222.0.13 "GET /v2.0/networks/fdcbc66e-323e-4b44-be97-566949f4f2ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2308626 Sep 18 08:38:53.273924 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-03bb9956-dc48-4c24-bd3c-ef920a5d60e7 service neutron] Notify callbacks [] for port, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:53.307415 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-5ee50233-f6ee-407f-b520-4aece9dc175d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:53.321909 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:53.335349 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-5ee50233-f6ee-407f-b520-4aece9dc175d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:53.347971 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.provisioning_blocks [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-03bb9956-dc48-4c24-bd3c-ef920a5d60e7 service neutron] Transition to ACTIVE for port object 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 will not be triggered until provisioned by entity L2. {{(pid=94347) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 18 08:38:53.350327 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-799739ad-3468-4654-9f61-7a419265da3e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:53.353517 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-799739ad-3468-4654-9f61-7a419265da3e admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:53.354689 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-799739ad-3468-4654-9f61-7a419265da3e admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/8341ab65-af80-4cad-99d5-d34982f2112f HTTP/1.1" status: 204 len: 168 time: 0.5027969 Sep 18 08:38:53.362382 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-03bb9956-dc48-4c24-bd3c-ef920a5d60e7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:53.391806 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-5ee50233-f6ee-407f-b520-4aece9dc175d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:53.396305 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-5ee50233-f6ee-407f-b520-4aece9dc175d admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:53.400432 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-5ee50233-f6ee-407f-b520-4aece9dc175d admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/8f2903d4-d218-45b9-a34c-939b1d25fb12 HTTP/1.1" status: 204 len: 168 time: 0.1476054 Sep 18 08:38:53.400584 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-799739ad-3468-4654-9f61-7a419265da3e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8341ab65-af80-4cad-99d5-d34982f2112f,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:53.435416 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5496e74e-8d2c-48d0-a32f-fcefb73ea712 req-3e1e874e-5eb3-4bd0-9042-36d6dc20924d service neutron] 10.222.0.13 "GET /v2.0/networks/fdcbc66e-323e-4b44-be97-566949f4f2ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1572535 Sep 18 08:38:53.440426 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03bb9956-dc48-4c24-bd3c-ef920a5d60e7 service neutron] Pushing event updated for resources: {'Port': ['ID=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1,revision_number=2']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:53.447979 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ee50233-f6ee-407f-b520-4aece9dc175d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8f2903d4-d218-45b9-a34c-939b1d25fb12,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:53.527834 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-03bb9956-dc48-4c24-bd3c-ef920a5d60e7 service neutron] Attempting to bind port 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 on host hv-cinder-80447 for vnic_type normal with profile {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:38:53.528174 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-03bb9956-dc48-4c24-bd3c-ef920a5d60e7 service neutron] Attempting to bind port 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 by drivers openvswitch,hyperv on host hv-cinder-80447 at level 0 using segments [{'id': '34c1fb08-1711-4a8c-a899-35eb41628d5a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 214, 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727'}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:38:53.528501 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-03bb9956-dc48-4c24-bd3c-ef920a5d60e7 service neutron] Attempting to bind port 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 on network f430397d-03a8-4da2-bd1d-25890a3a0727 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:38:53.534347 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-03bb9956-dc48-4c24-bd3c-ef920a5d60e7 service neutron] Port 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 on network f430397d-03a8-4da2-bd1d-25890a3a0727 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80447 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 18 08:38:53.534743 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-03bb9956-dc48-4c24-bd3c-ef920a5d60e7 service neutron] Attempting to bind port 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 on network f430397d-03a8-4da2-bd1d-25890a3a0727 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:38:53.541549 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-03bb9956-dc48-4c24-bd3c-ef920a5d60e7 service neutron] Checking agent: {'id': '8d51fdc4-974b-4200-9c3f-5dddea60a869', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80447', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'started_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 38, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:38:53.543923 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-03bb9956-dc48-4c24-bd3c-ef920a5d60e7 service neutron] Checking segment: {'id': '34c1fb08-1711-4a8c-a899-35eb41628d5a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 214, 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94347) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:38:53.544425 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-03bb9956-dc48-4c24-bd3c-ef920a5d60e7 service neutron] Bound using segment: {'id': '34c1fb08-1711-4a8c-a899-35eb41628d5a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 214, 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727'} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:38:53.546033 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-03bb9956-dc48-4c24-bd3c-ef920a5d60e7 service neutron] Bound port: 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1, host: hv-cinder-80447, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '34c1fb08-1711-4a8c-a899-35eb41628d5a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 214, 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727'}}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:38:53.546864 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-03bb9956-dc48-4c24-bd3c-ef920a5d60e7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:53.639262 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0be4c3a1-276f-454a-a40b-a72c1bee2b63 req-60e3efce-19a8-46a9-98c3-8cb874031fa6 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:53.646456 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0be4c3a1-276f-454a-a40b-a72c1bee2b63 req-60e3efce-19a8-46a9-98c3-8cb874031fa6 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 943 time: 0.0963192 Sep 18 08:38:53.706321 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0be4c3a1-276f-454a-a40b-a72c1bee2b63 req-1eaddf65-7d6a-4789-8550-835ef7289aef tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0589147 Sep 18 08:38:53.711341 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-03bb9956-dc48-4c24-bd3c-ef920a5d60e7 service neutron] For port 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1, host hv-cinder-80447, cleared binding levels {{(pid=94347) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:38:53.715067 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-03bb9956-dc48-4c24-bd3c-ef920a5d60e7 service neutron] For port 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1, host hv-cinder-80447, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94347) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:38:53.733981 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-03bb9956-dc48-4c24-bd3c-ef920a5d60e7 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:53.784521 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 55644) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:53.798321 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-03bb9956-dc48-4c24-bd3c-ef920a5d60e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:53.798955 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-03bb9956-dc48-4c24-bd3c-ef920a5d60e7 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:53.799140 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-556ba7da-2dc1-4fb6-93bb-077d9da01de6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:53.800427 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-03bb9956-dc48-4c24-bd3c-ef920a5d60e7 service neutron] 10.222.0.13 "PUT /v2.0/ports/2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 HTTP/1.1" status: 200 len: 1094 time: 1.5912426 Sep 18 08:38:53.822729 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03bb9956-dc48-4c24-bd3c-ef920a5d60e7 service neutron] Pushing event updated for resources: {'Port': ['ID=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1,revision_number=3']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:53.833285 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c188b8f-78be-41d3-9413-d1ae9c2184ef req-2275c7aa-fdac-4dd1-b1ad-c8ebf548bbfb tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:53.834771 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9c188b8f-78be-41d3-9413-d1ae9c2184ef req-2275c7aa-fdac-4dd1-b1ad-c8ebf548bbfb tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.1144722 Sep 18 08:38:53.898908 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9c188b8f-78be-41d3-9413-d1ae9c2184ef req-34a7c255-5845-4700-a9b5-872ea275dfeb tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0569246 Sep 18 08:38:53.920929 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-556ba7da-2dc1-4fb6-93bb-077d9da01de6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:53.926171 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-556ba7da-2dc1-4fb6-93bb-077d9da01de6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:53.967959 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-556ba7da-2dc1-4fb6-93bb-077d9da01de6 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=c5ce3b325187497985bbc86fa68ffad7&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1819613 Sep 18 08:38:53.969069 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-556ba7da-2dc1-4fb6-93bb-077d9da01de6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=740cda33-747f-4a59-9306-820450335cb9,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:53.970948 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 55648) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:54.026588 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 55652) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:54.032043 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-68ff8cb0-697b-4d73-bfcb-3835a9fdb7da admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:54.041818 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-9dcee77e-fab6-4e03-834e-acebcb89fc45 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:54.056158 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-68ff8cb0-697b-4d73-bfcb-3835a9fdb7da admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:54.126386 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1859d588-daef-4bec-8ae6-91454fcc5c95 req-2f98c954-796a-4278-9dd0-9339c3f0e7b4 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:54.127863 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1859d588-daef-4bec-8ae6-91454fcc5c95 req-2f98c954-796a-4278-9dd0-9339c3f0e7b4 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 944 time: 0.0768676 Sep 18 08:38:54.135682 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-9dcee77e-fab6-4e03-834e-acebcb89fc45 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:54.139344 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-9dcee77e-fab6-4e03-834e-acebcb89fc45 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:54.156623 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-68ff8cb0-697b-4d73-bfcb-3835a9fdb7da admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:54.159055 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-68ff8cb0-697b-4d73-bfcb-3835a9fdb7da admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:54.160450 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-68ff8cb0-697b-4d73-bfcb-3835a9fdb7da admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/740cda33-747f-4a59-9306-820450335cb9 HTTP/1.1" status: 204 len: 168 time: 0.1882253 Sep 18 08:38:54.178322 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-9dcee77e-fab6-4e03-834e-acebcb89fc45 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=a3eab6b7db144f2fa44cec54064e8c06&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1502609 Sep 18 08:38:54.178997 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dcee77e-fab6-4e03-834e-acebcb89fc45 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c023f66e-a666-4efe-8ef5-e7f1d3b7bf5e,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:54.181438 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 55656) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:54.183487 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1859d588-daef-4bec-8ae6-91454fcc5c95 req-4206afa2-2425-407c-93e8-5231f8a93a65 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0489597 Sep 18 08:38:54.184454 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68ff8cb0-697b-4d73-bfcb-3835a9fdb7da admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=740cda33-747f-4a59-9306-820450335cb9,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:54.245950 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0d214c58-68b8-4c3f-8ce3-274dafbfa7ad admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:54.269712 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0d214c58-68b8-4c3f-8ce3-274dafbfa7ad admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:54.323162 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31946d94-9510-411f-a097-8ca141c52692 req-7eb15189-d291-4163-9279-d6e46ee0c716 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:54.325020 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-31946d94-9510-411f-a097-8ca141c52692 req-7eb15189-d291-4163-9279-d6e46ee0c716 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 944 time: 0.0544360 Sep 18 08:38:54.329714 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0d214c58-68b8-4c3f-8ce3-274dafbfa7ad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:54.332377 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0d214c58-68b8-4c3f-8ce3-274dafbfa7ad admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:54.333549 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-0d214c58-68b8-4c3f-8ce3-274dafbfa7ad admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/c023f66e-a666-4efe-8ef5-e7f1d3b7bf5e HTTP/1.1" status: 204 len: 168 time: 0.1466584 Sep 18 08:38:54.357518 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d214c58-68b8-4c3f-8ce3-274dafbfa7ad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c023f66e-a666-4efe-8ef5-e7f1d3b7bf5e,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:54.374006 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-31946d94-9510-411f-a097-8ca141c52692 req-563032c0-02a8-4694-8c56-c69613fa250d tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421937 Sep 18 08:38:54.515627 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 55666) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:54.528961 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-9b66bcdf-e597-479a-a843-49333706564e admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:54.623359 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-9b66bcdf-e597-479a-a843-49333706564e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:54.627955 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-9b66bcdf-e597-479a-a843-49333706564e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:54.680583 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-9b66bcdf-e597-479a-a843-49333706564e admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=e65fcc11731848fca1079d6040a120e1&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1637456 Sep 18 08:38:54.681644 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b66bcdf-e597-479a-a843-49333706564e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6195425a-da87-4e12-8ef0-82383cdb8e88,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:54.683622 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 55680) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:54.732323 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4248ac92-ce7b-4560-9f83-de05a7069a99', 'tag': '2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:38:54.734594 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bc321185-8be1-4d99-8708-4f90babf2ac1" -d '{"events": [{"name": "network-changed", "server_uuid": "4248ac92-ce7b-4560-9f83-de05a7069a99", "tag": "2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:38:54.751624 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0be4450b-951e-457d-84c3-00526dd350b0 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:54.774004 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0be4450b-951e-457d-84c3-00526dd350b0 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:54.856057 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:54.867666 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d1dc041-25d0-4fd0-8f89-9ff85e53e480 req-7ace9d1d-1f76-4f09-9c81-2449d1fed74c tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:54.869302 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5d1dc041-25d0-4fd0-8f89-9ff85e53e480 req-7ace9d1d-1f76-4f09-9c81-2449d1fed74c tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 943 time: 0.0695522 Sep 18 08:38:54.870425 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0be4450b-951e-457d-84c3-00526dd350b0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:54.872889 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0be4450b-951e-457d-84c3-00526dd350b0 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:54.873960 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-0be4450b-951e-457d-84c3-00526dd350b0 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/6195425a-da87-4e12-8ef0-82383cdb8e88 HTTP/1.1" status: 204 len: 168 time: 0.1882915 Sep 18 08:38:54.875418 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:38:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bf8b0df3-e0d2-42fa-a738-963a7327b62c x-openstack-request-id: req-bf8b0df3-e0d2-42fa-a738-963a7327b62c {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:38:54.875697 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4248ac92-ce7b-4560-9f83-de05a7069a99", "tag": "2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:38:54.875939 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-bf8b0df3-e0d2-42fa-a738-963a7327b62c {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:38:54.876305 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4248ac92-ce7b-4560-9f83-de05a7069a99', 'tag': '2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1', 'status': 'completed', 'code': 200} Sep 18 08:38:54.898516 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0be4450b-951e-457d-84c3-00526dd350b0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6195425a-da87-4e12-8ef0-82383cdb8e88,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:54.922090 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5d1dc041-25d0-4fd0-8f89-9ff85e53e480 req-4f184fa4-83e5-4d9f-833e-9ec8f9872e22 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427666 Sep 18 08:38:55.031108 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02f11084-545d-481f-bccb-547b9c9791cd req-104d44c0-229c-4155-a3b5-827980a1d633 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:55.032673 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-02f11084-545d-481f-bccb-547b9c9791cd req-104d44c0-229c-4155-a3b5-827980a1d633 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0541217 Sep 18 08:38:55.072365 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-02f11084-545d-481f-bccb-547b9c9791cd req-b87ee451-292e-454c-a3f7-d2202c8568a6 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0336134 Sep 18 08:38:55.308032 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aca88469-77d4-4e9a-9b9c-04638a97646d req-6bf8913b-5d99-486c-805e-e463cb5c0e3e tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:55.309676 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-aca88469-77d4-4e9a-9b9c-04638a97646d req-6bf8913b-5d99-486c-805e-e463cb5c0e3e tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 944 time: 0.0493186 Sep 18 08:38:55.354226 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-aca88469-77d4-4e9a-9b9c-04638a97646d req-24d81232-e79f-4bb2-b382-58e831a2ba2e tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0385878 Sep 18 08:38:55.502797 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e23a176-7b5b-4728-aa02-771b2adde4f6 req-99634959-102f-4980-aafd-8cad86832d88 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:55.504245 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8e23a176-7b5b-4728-aa02-771b2adde4f6 req-99634959-102f-4980-aafd-8cad86832d88 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 944 time: 0.0579264 Sep 18 08:38:55.543790 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8e23a176-7b5b-4728-aa02-771b2adde4f6 req-e1db60d7-ced6-452d-97a5-379d3cb0b0f5 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0331900 Sep 18 08:38:55.647056 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 55738) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:55.811808 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-ad9c8fb4-1e26-496d-b3ac-6222501effef admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-674115417-network', 'tenant_id': 'fb9519a4056a4e2ebbe5200ff83d0a1e'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:55.836048 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ad9c8fb4-1e26-496d-b3ac-6222501effef admin admin] Made reservation on behalf of fb9519a4056a4e2ebbe5200ff83d0a1e for: {'network': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:38:55.838472 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ad9c8fb4-1e26-496d-b3ac-6222501effef admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for network, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:55.847823 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ad9c8fb4-1e26-496d-b3ac-6222501effef admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:55.940963 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ad9c8fb4-1e26-496d-b3ac-6222501effef admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:55.947156 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ad9c8fb4-1e26-496d-b3ac-6222501effef admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:55.959281 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ad9c8fb4-1e26-496d-b3ac-6222501effef admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 213} {{(pid=94347) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 18 08:38:55.970630 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ad9c8fb4-1e26-496d-b3ac-6222501effef admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:55.971141 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.db.segments_db [None req-ad9c8fb4-1e26-496d-b3ac-6222501effef admin admin] Added segment 4f8dffb0-f8d4-41b5-beed-53bcf370cb42 of type vlan for network 5e2d06a6-7f04-4134-8004-d5639986c75e Sep 18 08:38:56.064008 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad9c8fb4-1e26-496d-b3ac-6222501effef admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=23af377c-f928-4574-b242-a5ed197d2bf9,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:56.073614 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ad9c8fb4-1e26-496d-b3ac-6222501effef admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732885226527'] for network, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:56.109492 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8c104db-da69-4585-93a3-b3f02e238d51 req-fd16b6c5-c13f-4461-b6ec-60f5874e0666 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:56.110990 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e8c104db-da69-4585-93a3-b3f02e238d51 req-fd16b6c5-c13f-4461-b6ec-60f5874e0666 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 943 time: 0.1028335 Sep 18 08:38:56.127982 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ad9c8fb4-1e26-496d-b3ac-6222501effef admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for network, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:56.129000 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad9c8fb4-1e26-496d-b3ac-6222501effef admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:56.129749 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ad9c8fb4-1e26-496d-b3ac-6222501effef admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:56.190922 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-ad9c8fb4-1e26-496d-b3ac-6222501effef admin admin] 10.222.0.35 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.5421934 Sep 18 08:38:56.193946 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 55778) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:56.199981 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-6ffac6b5-92e3-4119-b034-cdeb922d1cc1 admin admin] Request body: {'subnet': {'network_id': '5e2d06a6-7f04-4134-8004-d5639986c75e', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-674115417-subnet', 'tenant_id': 'fb9519a4056a4e2ebbe5200ff83d0a1e', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:38:56.222801 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6ffac6b5-92e3-4119-b034-cdeb922d1cc1 admin admin] Made reservation on behalf of fb9519a4056a4e2ebbe5200ff83d0a1e for: {'subnet': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:38:56.225504 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6ffac6b5-92e3-4119-b034-cdeb922d1cc1 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14198618'] for subnet, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:56.240850 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e8c104db-da69-4585-93a3-b3f02e238d51 req-ddd5b635-5e14-4f9b-ab8c-fa2eed27f587 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1215439 Sep 18 08:38:56.242791 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad9c8fb4-1e26-496d-b3ac-6222501effef admin admin] Pushing event updated for resources: {'Network': ['ID=5e2d06a6-7f04-4134-8004-d5639986c75e,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:56.261691 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Network 5e2d06a6-7f04-4134-8004-d5639986c75e details requested by agent ovs-agent-dv-cinder-804470-6-iscsi with host dv-cinder-804470-6-iscsi {{(pid=94348) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 18 08:38:56.264521 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da354c8-959c-4309-a2e0-7d7e156d5288 req-8e37ee75-bf06-4318-a6ab-da7a35198677 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:56.266114 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4da354c8-959c-4309-a2e0-7d7e156d5288 req-8e37ee75-bf06-4318-a6ab-da7a35198677 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.1072385 Sep 18 08:38:56.337878 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4da354c8-959c-4309-a2e0-7d7e156d5288 req-904b03ea-0fe7-404b-ba3a-6ad66ca65a0a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0559134 Sep 18 08:38:56.421516 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6ffac6b5-92e3-4119-b034-cdeb922d1cc1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-14290078', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14198644'] for subnet, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:56.479073 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ffac6b5-92e3-4119-b034-cdeb922d1cc1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=10680649-3557-49d0-9377-0d9cdb4efe69,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:56.479723 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f07a9b9-77e5-456e-b5b3-fa9663e530e0 req-2e50214c-cee8-4679-9833-e3968a38d1df tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:56.481319 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8f07a9b9-77e5-456e-b5b3-fa9663e530e0 req-2e50214c-cee8-4679-9833-e3968a38d1df tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 944 time: 0.0490723 Sep 18 08:38:56.501294 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ffac6b5-92e3-4119-b034-cdeb922d1cc1 admin admin] Checking segment: {'id': '4f8dffb0-f8d4-41b5-beed-53bcf370cb42', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 213, 'network_id': '5e2d06a6-7f04-4134-8004-d5639986c75e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94346) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:38:56.501521 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6ffac6b5-92e3-4119-b034-cdeb922d1cc1 admin admin] Network hostable DHCP agents. Network: 5e2d06a6-7f04-4134-8004-d5639986c75e, hostable agents: ['6aaa6222-6d04-44a7-b807-bfc2cbd3e99f'], hosted agents: [] {{(pid=94346) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 18 08:38:56.518637 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6ffac6b5-92e3-4119-b034-cdeb922d1cc1 admin admin] Network 5e2d06a6-7f04-4134-8004-d5639986c75e is scheduled to be hosted by DHCP agent 6aaa6222-6d04-44a7-b807-bfc2cbd3e99f with binding_index 1 {{(pid=94346) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 18 08:38:56.521813 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8f07a9b9-77e5-456e-b5b3-fa9663e530e0 req-f518099c-18e7-4c03-95a6-c2b85db649dc tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0343752 Sep 18 08:38:56.534053 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-6ffac6b5-92e3-4119-b034-cdeb922d1cc1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804470-6-iscsi, 5e2d06a6-7f04-4134-8004-d5639986c75e) {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:38:56.539524 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ffac6b5-92e3-4119-b034-cdeb922d1cc1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:56.540338 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6ffac6b5-92e3-4119-b034-cdeb922d1cc1 admin admin] Notify callbacks [] for subnet, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:56.545756 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cbf86f92-ede1-4455-9260-94f54ee7cfaa None None] Network 5e2d06a6-7f04-4134-8004-d5639986c75e requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:38:56.556595 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-6ffac6b5-92e3-4119-b034-cdeb922d1cc1 admin admin] 10.222.0.35 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3605037 Sep 18 08:38:56.601976 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 55796) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:56.672732 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2135df1e-4d08-49b8-bc4c-329ff9117e1e req-00140db5-9f86-4b9e-9184-d1c6f5d57470 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:56.674953 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2135df1e-4d08-49b8-bc4c-329ff9117e1e req-00140db5-9f86-4b9e-9184-d1c6f5d57470 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 944 time: 0.0554688 Sep 18 08:38:56.695398 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0a4bc04b-ed6e-4ee4-b0f1-ef1548845f7a None None] Network 5e2d06a6-7f04-4134-8004-d5639986c75e requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:38:56.719821 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2135df1e-4d08-49b8-bc4c-329ff9117e1e req-8dcf22a3-23df-4489-a158-f939d599b082 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0376804 Sep 18 08:38:56.749554 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-33126f11-9d86-4cd5-82b4-f6a839a85aae admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:56.868256 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-33126f11-9d86-4cd5-82b4-f6a839a85aae admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:56.874400 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-33126f11-9d86-4cd5-82b4-f6a839a85aae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:56.906892 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33126f11-9d86-4cd5-82b4-f6a839a85aae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=efff7c5a-8e88-4a74-a4fd-292c3ec17ae9,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:56.930716 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-33126f11-9d86-4cd5-82b4-f6a839a85aae admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=fab392b962ce4702b5271013b1156d69&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3276482 Sep 18 08:38:56.933443 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 55808) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:56.989165 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-f16aa78a-0cdd-414b-8c09-51f1640d7bae admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:57.028558 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-f16aa78a-0cdd-414b-8c09-51f1640d7bae admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:57.079720 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-f16aa78a-0cdd-414b-8c09-51f1640d7bae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:57.082221 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-f16aa78a-0cdd-414b-8c09-51f1640d7bae admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:57.086229 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-f16aa78a-0cdd-414b-8c09-51f1640d7bae admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/efff7c5a-8e88-4a74-a4fd-292c3ec17ae9 HTTP/1.1" status: 204 len: 168 time: 0.1514580 Sep 18 08:38:57.095812 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f16aa78a-0cdd-414b-8c09-51f1640d7bae admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=efff7c5a-8e88-4a74-a4fd-292c3ec17ae9,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:57.356257 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ef766d8-0a8b-4280-a0cf-25b1a8f9ddc6 req-5ef2580d-23e3-47e4-a943-2a54e344cfed tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:57.357868 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7ef766d8-0a8b-4280-a0cf-25b1a8f9ddc6 req-5ef2580d-23e3-47e4-a943-2a54e344cfed tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 943 time: 0.0494103 Sep 18 08:38:57.357985 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 55824) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:57.371237 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-e05809f1-3acd-46d4-a76a-e3efc998912c admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:57.401407 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7ef766d8-0a8b-4280-a0cf-25b1a8f9ddc6 req-9b074b21-5a47-4a4b-acef-0924e46afe56 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0365644 Sep 18 08:38:57.459792 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b73f3f05-3a85-49f1-8b05-998b7c292f71 req-5c02d1e8-e44d-4928-8a9d-5bea9b10b596 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:57.461913 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b73f3f05-3a85-49f1-8b05-998b7c292f71 req-5c02d1e8-e44d-4928-8a9d-5bea9b10b596 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0525138 Sep 18 08:38:57.463079 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-e05809f1-3acd-46d4-a76a-e3efc998912c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:57.467215 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-e05809f1-3acd-46d4-a76a-e3efc998912c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:57.501801 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b73f3f05-3a85-49f1-8b05-998b7c292f71 req-b804fb35-f0c2-471b-8394-40544ed8f52c tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0331817 Sep 18 08:38:57.507336 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e05809f1-3acd-46d4-a76a-e3efc998912c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c858cec-ac52-4074-a5cc-75db442cb8d5,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:57.515593 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-e05809f1-3acd-46d4-a76a-e3efc998912c admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=c38faa13ad8443229f0fcc0b637d9b4a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1538424 Sep 18 08:38:57.516393 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 55828) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:38:57.564307 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-5f66a5c2-29fd-4708-91a9-71d972c2edae admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:57.584929 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-5f66a5c2-29fd-4708-91a9-71d972c2edae admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:57.634040 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-5f66a5c2-29fd-4708-91a9-71d972c2edae admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:57.636731 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-5f66a5c2-29fd-4708-91a9-71d972c2edae admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:57.637425 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ddf3508-05cb-4db3-b8f7-ccd35d0d2ac1 req-7528da73-766e-41ce-a7d4-50ca4a684ec7 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:57.637935 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-5f66a5c2-29fd-4708-91a9-71d972c2edae admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/0c858cec-ac52-4074-a5cc-75db442cb8d5 HTTP/1.1" status: 204 len: 168 time: 0.1206403 Sep 18 08:38:57.638898 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1ddf3508-05cb-4db3-b8f7-ccd35d0d2ac1 req-7528da73-766e-41ce-a7d4-50ca4a684ec7 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 944 time: 0.0515685 Sep 18 08:38:57.645845 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f66a5c2-29fd-4708-91a9-71d972c2edae admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c858cec-ac52-4074-a5cc-75db442cb8d5,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:57.839668 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 324203bb-e8cc-4392-974c-20b4f2896cc6 details requested by agent hyperv_hv-cinder-80447 with host hv-cinder-80447 {{(pid=94348) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 18 08:38:57.892928 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1ddf3508-05cb-4db3-b8f7-ccd35d0d2ac1 req-de7aba53-d37e-4c36-a162-7ad1620b996c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2461636 Sep 18 08:38:57.912862 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d9d0618-0f4b-4621-aad0-8487e72a294e req-26127592-3b21-4440-a349-b9df4ee032c2 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:57.912862 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8d9d0618-0f4b-4621-aad0-8487e72a294e req-26127592-3b21-4440-a349-b9df4ee032c2 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 944 time: 0.0677588 Sep 18 08:38:57.970133 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 324203bb-e8cc-4392-974c-20b4f2896cc6, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=324203bb-e8cc-4392-974c-20b4f2896cc6,segment=NetworkSegment(892b5fda-4f2b-4e3a-af39-7d4f8d89394b),segment_id=892b5fda-4f2b-4e3a-af39-7d4f8d89394b)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:38:57.981799 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Returning: {'device': '324203bb-e8cc-4392-974c-20b4f2896cc6', 'network_id': '2c7737b5-792d-4a8d-bacc-cd5c180b7fc0', 'port_id': '324203bb-e8cc-4392-974c-20b4f2896cc6', 'mac_address': 'fa:16:3e:54:93:5c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 218, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9ed653e4-68a0-4108-b090-7571bdc067bc', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94348) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 18 08:38:58.012784 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8d9d0618-0f4b-4621-aad0-8487e72a294e req-3c560c84-a758-470d-905f-5686ad3bbf9f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0860333 Sep 18 08:38:58.016019 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc321185-8be1-4d99-8708-4f90babf2ac1 req-8b8f6537-0230-44b4-a75a-d129e7d3d052 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:58.017758 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bc321185-8be1-4d99-8708-4f90babf2ac1 req-8b8f6537-0230-44b4-a75a-d129e7d3d052 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0700a96e9b3f48e8b6bcdd75b820b813&device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 1097 time: 0.1058211 Sep 18 08:38:58.019760 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c578f1b-32c1-42d8-8a25-6ccc9c841a10 req-ef0d1881-3f95-4d5a-a101-17f5afe5f8b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:58.023428 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5c578f1b-32c1-42d8-8a25-6ccc9c841a10 req-ef0d1881-3f95-4d5a-a101-17f5afe5f8b1 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=f439efa4eed0456ab2a914377e490fad&device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 1096 time: 0.1095107 Sep 18 08:38:58.044208 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:58.065124 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 324203bb-e8cc-4392-974c-20b4f2896cc6 {{(pid=94348) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:38:58.089489 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 324203bb-e8cc-4392-974c-20b4f2896cc6, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=324203bb-e8cc-4392-974c-20b4f2896cc6,segment=NetworkSegment(892b5fda-4f2b-4e3a-af39-7d4f8d89394b),segment_id=892b5fda-4f2b-4e3a-af39-7d4f8d89394b)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:38:58.093967 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:58.094611 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 9a4f8ce9-f706-4c25-b3f4-05f2173cf516 details requested by agent hyperv_hv-cinder-80447 with host hv-cinder-80447 {{(pid=94348) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 18 08:38:58.169490 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=324203bb-e8cc-4392-974c-20b4f2896cc6,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:58.256074 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 9a4f8ce9-f706-4c25-b3f4-05f2173cf516, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=9a4f8ce9-f706-4c25-b3f4-05f2173cf516,segment=NetworkSegment(d1432479-9c27-42c4-87db-6905e7868675),segment_id=d1432479-9c27-42c4-87db-6905e7868675)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:38:58.263204 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc321185-8be1-4d99-8708-4f90babf2ac1 req-705eec54-d00d-4a81-92b9-dd5754153d9a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:58.264718 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bc321185-8be1-4d99-8708-4f90babf2ac1 req-705eec54-d00d-4a81-92b9-dd5754153d9a service neutron] 10.222.0.13 "GET /v2.0/networks?tenant_id=0700a96e9b3f48e8b6bcdd75b820b813&shared=False HTTP/1.1" status: 200 len: 917 time: 0.2232187 Sep 18 08:38:58.267358 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c578f1b-32c1-42d8-8a25-6ccc9c841a10 req-77b9cd6c-b2ee-4c68-a930-2195dcb4bc6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:58.268693 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5c578f1b-32c1-42d8-8a25-6ccc9c841a10 req-77b9cd6c-b2ee-4c68-a930-2195dcb4bc6c service neutron] 10.222.0.13 "GET /v2.0/networks?id=fdcbc66e-323e-4b44-be97-566949f4f2ef HTTP/1.1" status: 200 len: 919 time: 0.2184591 Sep 18 08:38:58.269084 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Returning: {'device': '9a4f8ce9-f706-4c25-b3f4-05f2173cf516', 'network_id': 'fe2753d3-7f3b-4739-adbf-6643a840c73e', 'port_id': '9a4f8ce9-f706-4c25-b3f4-05f2173cf516', 'mac_address': 'fa:16:3e:9c:53:bd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 233, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b96e08ba-91b8-4c1f-bd27-4a1270ccbde2', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94348) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 18 08:38:58.308978 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:58.329809 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5c578f1b-32c1-42d8-8a25-6ccc9c841a10 req-d9bf31eb-9925-4d5f-a071-826e10e4b700 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b03411eb-66ff-4691-88c8-2c570d78c323 HTTP/1.1" status: 200 len: 217 time: 0.0509839 Sep 18 08:38:58.330839 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9a4f8ce9-f706-4c25-b3f4-05f2173cf516 {{(pid=94348) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:38:58.357504 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 9a4f8ce9-f706-4c25-b3f4-05f2173cf516, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=9a4f8ce9-f706-4c25-b3f4-05f2173cf516,segment=NetworkSegment(d1432479-9c27-42c4-87db-6905e7868675),segment_id=d1432479-9c27-42c4-87db-6905e7868675)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:38:58.362520 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:38:58.412910 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=9a4f8ce9-f706-4c25-b3f4-05f2173cf516,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:38:58.421357 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c578f1b-32c1-42d8-8a25-6ccc9c841a10 req-849a2296-73c3-44fa-b902-4859acbe052d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:58.422845 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5c578f1b-32c1-42d8-8a25-6ccc9c841a10 req-849a2296-73c3-44fa-b902-4859acbe052d service neutron] 10.222.0.13 "GET /v2.0/subnets?id=e5dc6eef-e778-41a2-a708-c7810ade97db HTTP/1.1" status: 200 len: 858 time: 0.0862734 Sep 18 08:38:58.446402 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc321185-8be1-4d99-8708-4f90babf2ac1 req-bac19b69-f339-4bea-9821-01e43ecefb95 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:58.447900 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bc321185-8be1-4d99-8708-4f90babf2ac1 req-bac19b69-f339-4bea-9821-01e43ecefb95 service neutron] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1702380 Sep 18 08:38:58.462636 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5c578f1b-32c1-42d8-8a25-6ccc9c841a10 req-ec535819-34ef-4e1a-b9b5-6e4cea37642f service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fdcbc66e-323e-4b44-be97-566949f4f2ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0286238 Sep 18 08:38:58.649806 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c4d8dd5-7d2b-476b-b624-e126e3c269d7 req-68f6193b-f721-4923-88ea-cf847329d039 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:58.651278 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8c4d8dd5-7d2b-476b-b624-e126e3c269d7 req-68f6193b-f721-4923-88ea-cf847329d039 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 944 time: 0.1599195 Sep 18 08:38:58.662270 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-9a1cabf6-2272-4da2-9f60-8060a26b4c59 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:58.663764 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-9a1cabf6-2272-4da2-9f60-8060a26b4c59 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0700a96e9b3f48e8b6bcdd75b820b813&device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 1097 time: 0.1432407 Sep 18 08:38:58.666393 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5c578f1b-32c1-42d8-8a25-6ccc9c841a10 req-ca19dd5d-bcb7-49ca-bce4-968e57a99241 service neutron] 10.222.0.13 "GET /v2.0/networks/fdcbc66e-323e-4b44-be97-566949f4f2ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1955748 Sep 18 08:38:58.687520 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e241b08-f410-421e-83f3-fb045f2db2f1 req-4724f946-d158-4394-a1b2-90b0555ea5c7 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:58.688974 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9e241b08-f410-421e-83f3-fb045f2db2f1 req-4724f946-d158-4394-a1b2-90b0555ea5c7 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.1096516 Sep 18 08:38:58.769883 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8c4d8dd5-7d2b-476b-b624-e126e3c269d7 req-a779f2cc-33a3-4bc8-aadb-a66fc5778f2d tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1105943 Sep 18 08:38:58.771061 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-9ccd1da9-48d7-40ae-8f26-0ef769e7417f service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 HTTP/1.1" status: 200 len: 217 time: 0.0724659 Sep 18 08:38:58.852777 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9e241b08-f410-421e-83f3-fb045f2db2f1 req-cf36935a-4d6a-4941-a1ac-a8e0c66112a3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1563432 Sep 18 08:38:58.878086 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-58005748-182f-4589-9d8e-02d6065d92ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:58.878086 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-58005748-182f-4589-9d8e-02d6065d92ff service neutron] 10.222.0.13 "GET /v2.0/subnets?id=acdeb8a1-5de9-425f-ae0a-890d310246e9 HTTP/1.1" status: 200 len: 855 time: 0.0917013 Sep 18 08:38:58.901552 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5c578f1b-32c1-42d8-8a25-6ccc9c841a10 req-3f5e3492-84ac-400a-854d-819e9e6a5c7e service neutron] 10.222.0.13 "GET /v2.0/networks/fdcbc66e-323e-4b44-be97-566949f4f2ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1879311 Sep 18 08:38:58.939174 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-858e0f40-c665-4c11-8ebf-226693f584c6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:58.940733 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-858e0f40-c665-4c11-8ebf-226693f584c6 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=f430397d-03a8-4da2-bd1d-25890a3a0727&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0571578 Sep 18 08:38:59.065581 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4776a50-e000-4808-9245-386d8018c690 req-3beadcfa-38ab-4b27-99f6-490de46e6183 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:59.067173 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c4776a50-e000-4808-9245-386d8018c690 req-3beadcfa-38ab-4b27-99f6-490de46e6183 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 944 time: 0.0966637 Sep 18 08:38:59.085683 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-3830b31d-b550-4506-bdad-5e0eb18db2b2 service neutron] 10.222.0.13 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1334956 Sep 18 08:38:59.197013 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c4776a50-e000-4808-9245-386d8018c690 req-18673a8e-e5f5-469e-840c-6771690027ae tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1229842 Sep 18 08:38:59.224056 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8780a8d-f7d8-4229-b213-db56d6f81350 req-383d8682-08ff-41be-bcb2-1901eaf3318a tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:59.231623 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a8780a8d-f7d8-4229-b213-db56d6f81350 req-383d8682-08ff-41be-bcb2-1901eaf3318a tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 945 time: 0.1270854 Sep 18 08:38:59.254392 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8b00bc1-6d62-492b-89c1-0aba04fb48da req-3a4e0f77-19b0-42dd-9867-57749ca9f239 service neutron] 10.222.0.13 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1594489 Sep 18 08:38:59.283151 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a8780a8d-f7d8-4229-b213-db56d6f81350 req-6fd5ff6d-bd18-4616-a63a-9518c61b346d tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0494666 Sep 18 08:38:59.373796 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['324203bb-e8cc-4392-974c-20b4f2896cc6'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:38:59.422570 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['9a4f8ce9-f706-4c25-b3f4-05f2173cf516'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:38:59.692462 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-0507b593-e502-4ac0-a1dc-7e2cc8b0b6dc tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:38:59.697697 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-0507b593-e502-4ac0-a1dc-7e2cc8b0b6dc tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/networks?id=5e2d06a6-7f04-4134-8004-d5639986c75e HTTP/1.1" status: 200 len: 808 time: 0.1331687 Sep 18 08:38:59.712306 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-d8832429-f757-42bf-b1fb-a3e287ec2b8b tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/quotas/fb9519a4056a4e2ebbe5200ff83d0a1e HTTP/1.1" status: 200 len: 375 time: 0.0108526 Sep 18 08:38:59.747788 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-56c000ee-aa89-4403-8b24-635e9225f6cc tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?tenant_id=fb9519a4056a4e2ebbe5200ff83d0a1e&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0297284 Sep 18 08:38:59.835898 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-e77c26bc-92c9-4aec-8f1b-df9e73b7f758 service neutron] 10.222.0.35 "GET /v2.0/networks/5e2d06a6-7f04-4134-8004-d5639986c75e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0810661 Sep 18 08:39:00.113005 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c65219ab-26bf-42e0-95eb-4d2b50c6e198 req-23d64541-331c-4ad3-8200-0ec8c0bcb5bf tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:00.114512 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c65219ab-26bf-42e0-95eb-4d2b50c6e198 req-23d64541-331c-4ad3-8200-0ec8c0bcb5bf tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 944 time: 0.2761729 Sep 18 08:39:00.148878 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-f38d86ff-5a66-4c7d-9fdb-9a77c1188e7a service neutron] 10.222.0.35 "GET /v2.0/networks/5e2d06a6-7f04-4134-8004-d5639986c75e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3021202 Sep 18 08:39:00.166052 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c65219ab-26bf-42e0-95eb-4d2b50c6e198 req-71264612-b9d5-45f6-bf22-ed23193ffd76 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438187 Sep 18 08:39:00.272297 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4343324e-71da-4ad4-a44f-aa3c1b399715 req-90004320-f94d-497d-ba4c-fe3b820e2b9e tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:00.273994 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4343324e-71da-4ad4-a44f-aa3c1b399715 req-90004320-f94d-497d-ba4c-fe3b820e2b9e tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0521142 Sep 18 08:39:00.350910 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4343324e-71da-4ad4-a44f-aa3c1b399715 req-fe7759aa-a05d-4039-9b21-ca06b61b8a2e tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0641835 Sep 18 08:39:00.361776 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2259895-a727-47ff-a2e4-235c98992603 req-582b1830-a464-4daa-8d48-c746d8d12d4c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:00.363148 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a2259895-a727-47ff-a2e4-235c98992603 req-582b1830-a464-4daa-8d48-c746d8d12d4c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 944 time: 0.0702505 Sep 18 08:39:00.407019 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a2259895-a727-47ff-a2e4-235c98992603 req-c8aa1dcf-c7f5-47e6-ace5-649946a25b53 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0328345 Sep 18 08:39:00.430235 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 59d1e8a2-e4aa-44e5-8014-91de86026543 details requested by agent hyperv_hv-cinder-80447 with host hv-cinder-80447 {{(pid=94348) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 18 08:39:00.435727 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-36550a9c-f0f4-473c-893f-05700f4b4905 req-6b0bd26d-0387-402d-bc94-621c0cf2b880 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 210 time: 0.0277228 Sep 18 08:39:00.518370 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8f1178c-15c5-40f9-b678-1cf8e9d08e6a req-7ce8f270-5954-4b0f-97b6-ea155be2a88e tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:00.519848 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e8f1178c-15c5-40f9-b678-1cf8e9d08e6a req-7ce8f270-5954-4b0f-97b6-ea155be2a88e tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 945 time: 0.0529804 Sep 18 08:39:00.531718 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 59d1e8a2-e4aa-44e5-8014-91de86026543, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=59d1e8a2-e4aa-44e5-8014-91de86026543,segment=NetworkSegment(cb92e74f-7545-44c8-a2d3-634d116af362),segment_id=cb92e74f-7545-44c8-a2d3-634d116af362)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:39:00.544554 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Returning: {'device': '59d1e8a2-e4aa-44e5-8014-91de86026543', 'network_id': 'fdcbc66e-323e-4b44-be97-566949f4f2ef', 'port_id': '59d1e8a2-e4aa-44e5-8014-91de86026543', 'mac_address': 'fa:16:3e:eb:5f:fd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 204, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e5dc6eef-e778-41a2-a708-c7810ade97db', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94348) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 18 08:39:00.566897 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e8f1178c-15c5-40f9-b678-1cf8e9d08e6a req-c5fe4c4a-f1a7-4c56-8557-86a4bd0f619c tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0381305 Sep 18 08:39:00.588802 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:00.602261 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 59d1e8a2-e4aa-44e5-8014-91de86026543 {{(pid=94348) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:39:00.622565 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 59d1e8a2-e4aa-44e5-8014-91de86026543, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=59d1e8a2-e4aa-44e5-8014-91de86026543,segment=NetworkSegment(cb92e74f-7545-44c8-a2d3-634d116af362),segment_id=cb92e74f-7545-44c8-a2d3-634d116af362)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:39:00.626472 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:00.675892 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=59d1e8a2-e4aa-44e5-8014-91de86026543,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:01.281129 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aefecdc2-11ad-48b4-9946-2a341e88da8c req-3e8e027b-52ce-4855-a082-23382bac3039 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:01.282621 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-aefecdc2-11ad-48b4-9946-2a341e88da8c req-3e8e027b-52ce-4855-a082-23382bac3039 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 944 time: 0.0507712 Sep 18 08:39:01.319261 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-aefecdc2-11ad-48b4-9946-2a341e88da8c req-1574dea8-5864-4b92-94d8-0b7307355b8f tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0308254 Sep 18 08:39:01.465976 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3229a0d7-b89a-4639-a741-5e2a21a484f9 req-023eb94a-44cc-4862-b1e1-76f52573652a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:01.467410 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3229a0d7-b89a-4639-a741-5e2a21a484f9 req-023eb94a-44cc-4862-b1e1-76f52573652a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0481939 Sep 18 08:39:01.533900 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3229a0d7-b89a-4639-a741-5e2a21a484f9 req-9f5a92d9-142b-4d6f-9703-a264724dec70 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0600429 Sep 18 08:39:01.542114 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46eca876-fb3d-48e2-8afa-025e4bd25bec req-68d80bc1-48e7-4999-a605-5b32e1d1f3d8 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:01.543542 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-46eca876-fb3d-48e2-8afa-025e4bd25bec req-68d80bc1-48e7-4999-a605-5b32e1d1f3d8 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 945 time: 0.0715497 Sep 18 08:39:01.584318 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-46eca876-fb3d-48e2-8afa-025e4bd25bec req-5367715c-7c1c-45a0-8fd7-f067c48c6c09 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0349507 Sep 18 08:39:01.619647 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5b946db1-839c-4fef-aec5-f8d9b165624e req-ad13c15f-958e-4ade-b19b-51f18515b3a9 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 210 time: 0.0263438 Sep 18 08:39:01.686014 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5515a8d-7a53-46fd-b359-b68fe99b1fbb req-e0a8f1ae-ecc5-4185-bff3-6e7fc0f455f3 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:01.687473 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c5515a8d-7a53-46fd-b359-b68fe99b1fbb req-e0a8f1ae-ecc5-4185-bff3-6e7fc0f455f3 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 945 time: 0.0469167 Sep 18 08:39:01.723352 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c5515a8d-7a53-46fd-b359-b68fe99b1fbb req-ea015f7a-7c93-4745-b974-413dce041051 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0300105 Sep 18 08:39:02.427816 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b086a181-d8f3-406d-a47d-2d63a02b5960 req-e2c8f269-b2cd-48ce-9105-ab73f5117492 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:02.429280 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b086a181-d8f3-406d-a47d-2d63a02b5960 req-e2c8f269-b2cd-48ce-9105-ab73f5117492 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 944 time: 0.0461130 Sep 18 08:39:02.466358 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b086a181-d8f3-406d-a47d-2d63a02b5960 req-f77d3911-7cb8-4fff-846a-d054dd16bae4 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0312831 Sep 18 08:39:02.652780 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59cb4434-7582-4026-852b-e34d9a37128b req-50224f70-48fb-4c02-a9e5-d2e2cac424a3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:02.654278 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-59cb4434-7582-4026-852b-e34d9a37128b req-50224f70-48fb-4c02-a9e5-d2e2cac424a3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0508499 Sep 18 08:39:02.715045 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-59cb4434-7582-4026-852b-e34d9a37128b req-4e1ce91a-845e-4fbc-b83f-99a1320cbb5c tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0520220 Sep 18 08:39:02.723386 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccd8774c-3f82-4430-bb53-1956116bba84 req-9eca7b14-068e-49b1-870d-00362a595dce tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:02.724802 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ccd8774c-3f82-4430-bb53-1956116bba84 req-9eca7b14-068e-49b1-870d-00362a595dce tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 945 time: 0.0696731 Sep 18 08:39:02.763925 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ccd8774c-3f82-4430-bb53-1956116bba84 req-b9c3649c-8083-4a1d-8cd8-8976ebcc95e8 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0332110 Sep 18 08:39:02.799488 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4f5a38b1-0bc9-4b48-8419-b974deeee73c req-5bfc28bd-d54e-4d3e-8cdf-75570a5942f5 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 210 time: 0.0274439 Sep 18 08:39:02.877763 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d04385d8-7557-4c10-838d-de1d6c5c59f3 req-9b025c94-2a77-4d96-bff8-5f9b7df47e4b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:02.879149 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d04385d8-7557-4c10-838d-de1d6c5c59f3 req-9b025c94-2a77-4d96-bff8-5f9b7df47e4b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 945 time: 0.0502541 Sep 18 08:39:02.915318 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d04385d8-7557-4c10-838d-de1d6c5c59f3 req-a7ba9a99-c15d-414d-8b48-285773587ff7 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0296164 Sep 18 08:39:03.580541 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9f4d4ba-aadc-43b9-8600-f9600fd5686a req-b09a16a4-0885-4183-bc25-db67bfbdf1b3 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:03.582064 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e9f4d4ba-aadc-43b9-8600-f9600fd5686a req-b09a16a4-0885-4183-bc25-db67bfbdf1b3 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 944 time: 0.0466945 Sep 18 08:39:03.619023 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e9f4d4ba-aadc-43b9-8600-f9600fd5686a req-de8248f9-3db7-4c3f-b7ca-fb31b75291ac tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0306048 Sep 18 08:39:03.829703 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-787c2efe-5ab0-4242-b54b-ad04b28e66fb req-b7292331-0547-40c5-8c9b-24c51e6488b1 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:03.831209 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-787c2efe-5ab0-4242-b54b-ad04b28e66fb req-b7292331-0547-40c5-8c9b-24c51e6488b1 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0486064 Sep 18 08:39:03.895321 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-787c2efe-5ab0-4242-b54b-ad04b28e66fb req-b36f6c2a-d581-4574-8b34-2a5554acf990 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0536008 Sep 18 08:39:03.907962 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-468513fe-05b9-42b4-943c-e58c7d67d55f req-ea5ba812-6dee-4ccb-8c28-8a33c1b34f5b tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:03.909441 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-468513fe-05b9-42b4-943c-e58c7d67d55f req-ea5ba812-6dee-4ccb-8c28-8a33c1b34f5b tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 945 time: 0.0764425 Sep 18 08:39:03.946966 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-468513fe-05b9-42b4-943c-e58c7d67d55f req-a5729511-036d-496d-a3cb-9d9ab0f93538 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0312858 Sep 18 08:39:03.983752 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-766e354a-0f71-4294-b1f3-d240e80a6d98 req-74587a12-2613-472a-bed3-5aa888feff58 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 210 time: 0.0266151 Sep 18 08:39:04.048111 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6abccdf-53ae-404b-b7d8-9a9bb012fbd7 req-c8474450-a00e-4421-afc6-e0a9f233ca50 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:04.049566 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e6abccdf-53ae-404b-b7d8-9a9bb012fbd7 req-c8474450-a00e-4421-afc6-e0a9f233ca50 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 945 time: 0.0470791 Sep 18 08:39:04.086398 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e6abccdf-53ae-404b-b7d8-9a9bb012fbd7 req-0b0c187e-1bc7-48da-aaca-e6dd11e951fd tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0309899 Sep 18 08:39:04.731335 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2d8700b-6556-462c-812a-67e9dfdd61b6 req-09cf8412-8f75-4b84-9094-1e27f7e038aa tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:04.732963 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b2d8700b-6556-462c-812a-67e9dfdd61b6 req-09cf8412-8f75-4b84-9094-1e27f7e038aa tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 944 time: 0.0502245 Sep 18 08:39:04.770366 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b2d8700b-6556-462c-812a-67e9dfdd61b6 req-09997e3f-a31c-488e-8c39-3b32bd62565f tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0307400 Sep 18 08:39:05.012169 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a36b8041-e652-402f-95a7-033b017c9dea req-45d6e0c8-64b8-4c3d-ba38-de33134f4fa7 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:05.014112 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a36b8041-e652-402f-95a7-033b017c9dea req-45d6e0c8-64b8-4c3d-ba38-de33134f4fa7 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0494955 Sep 18 08:39:05.075352 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a36b8041-e652-402f-95a7-033b017c9dea req-2b10ed18-6f73-45c8-8067-f959176a7f1e tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0494471 Sep 18 08:39:05.086826 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-747b0644-d008-448f-9e33-533425096f53 req-063a448c-b141-4b0f-af20-2384aa746f7b tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:05.088253 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-747b0644-d008-448f-9e33-533425096f53 req-063a448c-b141-4b0f-af20-2384aa746f7b tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 945 time: 0.0709350 Sep 18 08:39:05.132544 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-747b0644-d008-448f-9e33-533425096f53 req-8431b44c-98c2-4f88-9301-49c97cc17cf9 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0343897 Sep 18 08:39:05.157893 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dee143f9-66a3-49bc-a57b-494bebfa70a3 req-2c745636-d3e2-4ab6-804e-b0f8f301e82a tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 210 time: 0.0244114 Sep 18 08:39:05.232655 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91216f8b-c46d-4d74-bedb-0f5be7675170 req-3b1f0437-2c85-4a63-b2b2-a8d8be98579e tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:05.234185 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-91216f8b-c46d-4d74-bedb-0f5be7675170 req-3b1f0437-2c85-4a63-b2b2-a8d8be98579e tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 945 time: 0.0472922 Sep 18 08:39:05.269677 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-91216f8b-c46d-4d74-bedb-0f5be7675170 req-ac076835-54f4-439c-83c7-f22a4b9050ac tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0297863 Sep 18 08:39:05.956401 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-513f2779-d1d7-463a-a939-a84945c3b188 req-edd48638-49c5-413b-a432-cc39f2ceb438 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:05.958496 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-513f2779-d1d7-463a-a939-a84945c3b188 req-edd48638-49c5-413b-a432-cc39f2ceb438 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 944 time: 0.1236708 Sep 18 08:39:06.008540 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-18be1b77-c46c-47d9-b364-6a20647f5f25 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:06.009752 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-18be1b77-c46c-47d9-b364-6a20647f5f25 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.13 "GET /v2.0/networks?id=5e2d06a6-7f04-4134-8004-d5639986c75e HTTP/1.1" status: 200 len: 808 time: 0.1629047 Sep 18 08:39:06.026342 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-513f2779-d1d7-463a-a939-a84945c3b188 req-6642cd22-a839-47b3-9fa2-3f6a6af369ec tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0584950 Sep 18 08:39:06.190450 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24da7233-752f-407a-8d0d-8fd9ee3cee3d req-67b47dd4-2967-4087-8dbd-b35449e83a21 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:06.191923 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-24da7233-752f-407a-8d0d-8fd9ee3cee3d req-67b47dd4-2967-4087-8dbd-b35449e83a21 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0484204 Sep 18 08:39:06.260707 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-24da7233-752f-407a-8d0d-8fd9ee3cee3d req-7f8eb138-4244-4c00-9191-22d8bf4db500 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0619049 Sep 18 08:39:06.271199 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01a23d27-c3a2-4671-af97-fe707482172a req-83a62d04-11ab-46c9-84cf-9500c07eccec tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:06.272663 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-01a23d27-c3a2-4671-af97-fe707482172a req-83a62d04-11ab-46c9-84cf-9500c07eccec tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 945 time: 0.0750279 Sep 18 08:39:06.312632 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-01a23d27-c3a2-4671-af97-fe707482172a req-f60d9731-e825-40f6-a176-d3ab8d4c121e tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0336671 Sep 18 08:39:06.343742 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c3401a74-574d-401d-b397-d80e4ed3ad9c req-96e0cc92-716a-40eb-9dfa-6a5da42e516d tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 210 time: 0.0252140 Sep 18 08:39:06.412115 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b636a47-2138-4994-a714-d77809984c59 req-f2653323-6cbc-4f9a-bc8d-5cb99c5bfc02 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:06.413990 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2b636a47-2138-4994-a714-d77809984c59 req-f2653323-6cbc-4f9a-bc8d-5cb99c5bfc02 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 945 time: 0.0461338 Sep 18 08:39:06.450088 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2b636a47-2138-4994-a714-d77809984c59 req-c410cbc0-cee3-4ffc-850a-246ac1978a1e tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0303690 Sep 18 08:39:07.139935 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bfa4af2-30bb-4056-ae3e-d05801a4d5c6 req-e47e0b92-d234-442c-98f6-715cb8d8a8c4 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:07.141332 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9bfa4af2-30bb-4056-ae3e-d05801a4d5c6 req-e47e0b92-d234-442c-98f6-715cb8d8a8c4 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 944 time: 0.0498686 Sep 18 08:39:07.177852 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9bfa4af2-30bb-4056-ae3e-d05801a4d5c6 req-447723d3-9f41-4cd4-a7c7-469dc6e2cf6d tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0307219 Sep 18 08:39:07.376430 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37891488-bb9c-47bb-ab1e-f0c21264eace req-ce4a5746-1d48-4796-b75e-07825153e558 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:07.378104 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-37891488-bb9c-47bb-ab1e-f0c21264eace req-ce4a5746-1d48-4796-b75e-07825153e558 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0497270 Sep 18 08:39:07.440897 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-37891488-bb9c-47bb-ab1e-f0c21264eace req-fe021b75-1bdc-478b-b5b8-3bf142f63067 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0537686 Sep 18 08:39:07.448694 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59be1f7c-bd56-4276-9e83-b92b4be84ef6 req-d3a5e6b3-280f-486b-ad90-6e8533924c37 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:07.450164 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-59be1f7c-bd56-4276-9e83-b92b4be84ef6 req-d3a5e6b3-280f-486b-ad90-6e8533924c37 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 945 time: 0.0711927 Sep 18 08:39:07.520491 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-59be1f7c-bd56-4276-9e83-b92b4be84ef6 req-299700af-2a83-47ab-bdbf-9a3bd2c916d2 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0642111 Sep 18 08:39:07.535500 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7e2d16d0-f81c-4622-b84a-b371f8f02495 req-ad3cf0b8-d0b9-4244-a4f3-72b4dde9b0de tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 210 time: 0.0363915 Sep 18 08:39:07.619469 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05a890e6-d34f-4274-adac-34589298222a req-245a6d29-0aae-447d-b89e-3442d399f99c tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:07.620908 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-05a890e6-d34f-4274-adac-34589298222a req-245a6d29-0aae-447d-b89e-3442d399f99c tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 945 time: 0.0465806 Sep 18 08:39:07.656582 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-05a890e6-d34f-4274-adac-34589298222a req-c77dc54e-537b-42ac-98d8-ccc6e6ec1b0d tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0299261 Sep 18 08:39:08.286183 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6ca2737-a997-457a-bc6f-2d05d21e95b6 req-f91813ca-3af2-41c5-ac85-0e39073dc5ca tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:08.287633 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b6ca2737-a997-457a-bc6f-2d05d21e95b6 req-f91813ca-3af2-41c5-ac85-0e39073dc5ca tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 944 time: 0.0469048 Sep 18 08:39:08.325232 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b6ca2737-a997-457a-bc6f-2d05d21e95b6 req-d24c954f-6906-4e65-a982-508c5662be6f tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0317159 Sep 18 08:39:08.480979 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-ce5f39c4-af96-424c-8c87-c1a9500430bd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Request body: {'port': {'device_id': '8e21db7d-ad7c-4e54-ae13-5a36ab9e244e', 'network_id': '5e2d06a6-7f04-4134-8004-d5639986c75e', 'admin_state_up': True, 'tenant_id': 'fb9519a4056a4e2ebbe5200ff83d0a1e'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:39:08.615493 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cff37cb9-ea9a-4bcc-9648-560fad72fadf req-d5e8015a-6e64-429a-afe1-d020ec3ee4fe tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:08.617573 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cff37cb9-ea9a-4bcc-9648-560fad72fadf req-d5e8015a-6e64-429a-afe1-d020ec3ee4fe tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.1043446 Sep 18 08:39:08.678609 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-ce5f39c4-af96-424c-8c87-c1a9500430bd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Made reservation on behalf of fb9519a4056a4e2ebbe5200ff83d0a1e for: {'port': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:39:08.682015 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-ce5f39c4-af96-424c-8c87-c1a9500430bd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:08.702735 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15e990a6-68ec-425a-a439-66e912e9ea1e req-d417a8f1-c4d0-439b-96c2-b56ce0b7cd0c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:08.704212 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-15e990a6-68ec-425a-a439-66e912e9ea1e req-d417a8f1-c4d0-439b-96c2-b56ce0b7cd0c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 945 time: 0.1178024 Sep 18 08:39:08.708645 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cff37cb9-ea9a-4bcc-9648-560fad72fadf req-83fa0342-4f83-4a9b-bff2-56dfffb6cb74 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0738747 Sep 18 08:39:08.804180 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6343c35c-3162-417d-b030-c1b5b3a9a9ca req-fdc01eee-afdb-45fa-bce2-5d1e6e7c0ce0 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 210 time: 0.0377834 Sep 18 08:39:08.806977 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-15e990a6-68ec-425a-a439-66e912e9ea1e req-93af9a4c-f663-4506-868e-3b2df39a6809 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0958831 Sep 18 08:39:08.898324 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_common [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-ce5f39c4-af96-424c-8c87-c1a9500430bd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Allocated IP 172.20.0.9 (5e2d06a6-7f04-4134-8004-d5639986c75e/10680649-3557-49d0-9377-0d9cdb4efe69/63cfc18e-94f6-437f-86ac-093dde6268e8) {{(pid=94347) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:39:08.923969 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87bf9261-17ca-4ca2-ae21-a41c223e46ea req-0b990fd1-f959-4e73-8f5e-2b8008a75628 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:08.925499 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-87bf9261-17ca-4ca2-ae21-a41c223e46ea req-0b990fd1-f959-4e73-8f5e-2b8008a75628 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 945 time: 0.0671093 Sep 18 08:39:08.998960 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-87bf9261-17ca-4ca2-ae21-a41c223e46ea req-b6aadb17-556a-4910-bff6-42268e57eced tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0617783 Sep 18 08:39:09.092061 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-ce5f39c4-af96-424c-8c87-c1a9500430bd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Notify callbacks [] for port, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:09.124913 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-ce5f39c4-af96-424c-8c87-c1a9500430bd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:09.166578 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-ce5f39c4-af96-424c-8c87-c1a9500430bd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Network 5e2d06a6-7f04-4134-8004-d5639986c75e is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:39:09.169615 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-ce5f39c4-af96-424c-8c87-c1a9500430bd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:39:09.175070 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-ce5f39c4-af96-424c-8c87-c1a9500430bd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Received port after_create {{(pid=94347) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:39:09.181192 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce5f39c4-af96-424c-8c87-c1a9500430bd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Pushing event updated for resources: {'Port': ['ID=63cfc18e-94f6-437f-86ac-093dde6268e8,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:09.208845 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce5f39c4-af96-424c-8c87-c1a9500430bd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:09.209187 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce5f39c4-af96-424c-8c87-c1a9500430bd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:09.209549 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce5f39c4-af96-424c-8c87-c1a9500430bd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:09.210509 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce5f39c4-af96-424c-8c87-c1a9500430bd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:09.210837 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce5f39c4-af96-424c-8c87-c1a9500430bd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:09.211163 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce5f39c4-af96-424c-8c87-c1a9500430bd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:09.211485 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce5f39c4-af96-424c-8c87-c1a9500430bd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:09.211804 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce5f39c4-af96-424c-8c87-c1a9500430bd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:09.212123 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce5f39c4-af96-424c-8c87-c1a9500430bd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:09.212440 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce5f39c4-af96-424c-8c87-c1a9500430bd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:09.212756 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce5f39c4-af96-424c-8c87-c1a9500430bd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:09.213070 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce5f39c4-af96-424c-8c87-c1a9500430bd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:09.234657 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-ce5f39c4-af96-424c-8c87-c1a9500430bd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:09.235270 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-ce5f39c4-af96-424c-8c87-c1a9500430bd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:09.248751 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-ce5f39c4-af96-424c-8c87-c1a9500430bd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7718875 Sep 18 08:39:09.436599 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd585f7f-7df5-4ac7-82fe-55b59966192b req-0d7b6efc-b705-4c7e-9a00-780d8220fa6a tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:09.438072 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fd585f7f-7df5-4ac7-82fe-55b59966192b req-0d7b6efc-b705-4c7e-9a00-780d8220fa6a tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 944 time: 0.0496571 Sep 18 08:39:09.474854 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fd585f7f-7df5-4ac7-82fe-55b59966192b req-df783f54-63c7-4ccd-be18-16f3db831b3e tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0308809 Sep 18 08:39:09.822482 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30375af4-d8b1-4c8c-8a6c-f033fcf38698 req-8d992e55-a726-4777-9ef5-0d840ff25062 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:09.823927 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-30375af4-d8b1-4c8c-8a6c-f033fcf38698 req-8d992e55-a726-4777-9ef5-0d840ff25062 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0463226 Sep 18 08:39:09.861539 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-30375af4-d8b1-4c8c-8a6c-f033fcf38698 req-2e5885d0-9e3d-4edb-9af9-0696e5741808 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0318801 Sep 18 08:39:09.920294 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9aa49a5d-cd93-466f-83d9-0467402221c7 req-f47453c5-0ad6-44f8-9463-62745987e563 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:09.921831 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9aa49a5d-cd93-466f-83d9-0467402221c7 req-f47453c5-0ad6-44f8-9463-62745987e563 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 945 time: 0.0467689 Sep 18 08:39:09.968918 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-c882e80e-cdd1-4d02-b17e-d99b8309d14a service neutron] Request body: {'port': {'device_id': '8e21db7d-ad7c-4e54-ae13-5a36ab9e244e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80447'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:39:09.985782 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device b03411eb-66ff-4691-88c8-2c570d78c323 details requested by agent hyperv_hv-cinder-80447 with host hv-cinder-80447 {{(pid=94348) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 18 08:39:10.014917 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9aa49a5d-cd93-466f-83d9-0467402221c7 req-6099ff36-6ff9-459d-8f4d-8e34178dbb1d tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0873508 Sep 18 08:39:10.015079 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 324203bb-e8cc-4392-974c-20b4f2896cc6 up at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:39:10.050938 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9008475c-4860-4386-9621-c5f83dfd470e req-87d4218f-0c71-47da-8352-b7143c4a7911 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:10.052452 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9008475c-4860-4386-9621-c5f83dfd470e req-87d4218f-0c71-47da-8352-b7143c4a7911 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 931 time: 0.1265917 Sep 18 08:39:10.057744 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-c882e80e-cdd1-4d02-b17e-d99b8309d14a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:10.128428 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port b03411eb-66ff-4691-88c8-2c570d78c323, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=b03411eb-66ff-4691-88c8-2c570d78c323,segment=NetworkSegment(cb92e74f-7545-44c8-a2d3-634d116af362),segment_id=cb92e74f-7545-44c8-a2d3-634d116af362)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:39:10.140074 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning for port 324203bb-e8cc-4392-974c-20b4f2896cc6 completed by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 18 08:39:10.144592 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Returning: {'device': 'b03411eb-66ff-4691-88c8-2c570d78c323', 'network_id': 'fdcbc66e-323e-4b44-be97-566949f4f2ef', 'port_id': 'b03411eb-66ff-4691-88c8-2c570d78c323', 'mac_address': 'fa:16:3e:39:66:c2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 204, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e5dc6eef-e778-41a2-a708-c7810ade97db', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94348) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 18 08:39:10.148506 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning complete for port 324203bb-e8cc-4392-974c-20b4f2896cc6 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:39:10.148886 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:10.159331 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9008475c-4860-4386-9621-c5f83dfd470e req-ace75c11-25e9-4f74-b1fa-58ddccec9f3d tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0994172 Sep 18 08:39:10.181945 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5871f66e-9118-4b0a-984c-9a359a64ec96 req-bc771863-487c-4490-8bee-7ca0849255dd tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:10.183665 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5871f66e-9118-4b0a-984c-9a359a64ec96 req-bc771863-487c-4490-8bee-7ca0849255dd tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 945 time: 0.1030078 Sep 18 08:39:10.223665 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:10.242048 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b03411eb-66ff-4691-88c8-2c570d78c323 {{(pid=94348) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:39:10.277008 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5871f66e-9118-4b0a-984c-9a359a64ec96 req-eaed3d69-89ed-4a5b-8267-57ba609d87ea tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0502341 Sep 18 08:39:10.280377 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port b03411eb-66ff-4691-88c8-2c570d78c323, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=b03411eb-66ff-4691-88c8-2c570d78c323,segment=NetworkSegment(cb92e74f-7545-44c8-a2d3-634d116af362),segment_id=cb92e74f-7545-44c8-a2d3-634d116af362)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:39:10.288467 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:10.320149 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:10.355746 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6cd27eb8-8447-40a0-9229-d59ec6008eeb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '324203bb-e8cc-4392-974c-20b4f2896cc6'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:39:10.414830 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-c882e80e-cdd1-4d02-b17e-d99b8309d14a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 63cfc18e-94f6-437f-86ac-093dde6268e8 {{(pid=94347) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:39:10.424921 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-c882e80e-cdd1-4d02-b17e-d99b8309d14a service neutron] Notify callbacks [] for port, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:10.435912 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 324203bb-e8cc-4392-974c-20b4f2896cc6, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=324203bb-e8cc-4392-974c-20b4f2896cc6,segment=NetworkSegment(892b5fda-4f2b-4e3a-af39-7d4f8d89394b),segment_id=892b5fda-4f2b-4e3a-af39-7d4f8d89394b)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:39:10.437322 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=b03411eb-66ff-4691-88c8-2c570d78c323,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:10.443076 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.provisioning_blocks [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-c882e80e-cdd1-4d02-b17e-d99b8309d14a service neutron] Transition to ACTIVE for port object 63cfc18e-94f6-437f-86ac-093dde6268e8 will not be triggered until provisioned by entity L2. {{(pid=94347) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 18 08:39:10.447128 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:10.447496 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:10.447841 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:10.448184 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:10.448523 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:10.448860 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:10.449193 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:10.449661 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:10.450077 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-c882e80e-cdd1-4d02-b17e-d99b8309d14a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:10.450201 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:10.450605 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:10.450943 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:10.451265 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:10.456229 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:10.457028 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 9a4f8ce9-f706-4c25-b3f4-05f2173cf516 up at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:39:10.508512 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c882e80e-cdd1-4d02-b17e-d99b8309d14a service neutron] Pushing event updated for resources: {'Port': ['ID=63cfc18e-94f6-437f-86ac-093dde6268e8,revision_number=2']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:10.556217 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-74e40840-fe7d-4d3a-9557-2bb4e27f99e3" -d '{"events": [{"server_uuid": "6cd27eb8-8447-40a0-9229-d59ec6008eeb", "name": "network-vif-plugged", "status": "completed", "tag": "324203bb-e8cc-4392-974c-20b4f2896cc6"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:39:10.568490 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=324203bb-e8cc-4392-974c-20b4f2896cc6,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:10.580616 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning for port 9a4f8ce9-f706-4c25-b3f4-05f2173cf516 completed by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 18 08:39:10.585008 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning complete for port 9a4f8ce9-f706-4c25-b3f4-05f2173cf516 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:39:10.585489 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:10.612809 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-c882e80e-cdd1-4d02-b17e-d99b8309d14a service neutron] Attempting to bind port 63cfc18e-94f6-437f-86ac-093dde6268e8 on host hv-cinder-80447 for vnic_type normal with profile {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:39:10.613148 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-c882e80e-cdd1-4d02-b17e-d99b8309d14a service neutron] Attempting to bind port 63cfc18e-94f6-437f-86ac-093dde6268e8 by drivers openvswitch,hyperv on host hv-cinder-80447 at level 0 using segments [{'id': '4f8dffb0-f8d4-41b5-beed-53bcf370cb42', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 213, 'network_id': '5e2d06a6-7f04-4134-8004-d5639986c75e'}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:39:10.613502 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-c882e80e-cdd1-4d02-b17e-d99b8309d14a service neutron] Attempting to bind port 63cfc18e-94f6-437f-86ac-093dde6268e8 on network 5e2d06a6-7f04-4134-8004-d5639986c75e {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:39:10.620407 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-c882e80e-cdd1-4d02-b17e-d99b8309d14a service neutron] Port 63cfc18e-94f6-437f-86ac-093dde6268e8 on network 5e2d06a6-7f04-4134-8004-d5639986c75e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80447 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 18 08:39:10.620728 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-c882e80e-cdd1-4d02-b17e-d99b8309d14a service neutron] Attempting to bind port 63cfc18e-94f6-437f-86ac-093dde6268e8 on network 5e2d06a6-7f04-4134-8004-d5639986c75e {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:39:10.631224 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05ba62d8-99e8-40c3-a59b-a056c7780043 req-33494619-2aa3-41e2-9d1f-83b843f4b25d tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:10.632596 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-05ba62d8-99e8-40c3-a59b-a056c7780043 req-33494619-2aa3-41e2-9d1f-83b843f4b25d tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 945 time: 0.0749016 Sep 18 08:39:10.635391 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-c882e80e-cdd1-4d02-b17e-d99b8309d14a service neutron] Checking agent: {'id': '8d51fdc4-974b-4200-9c3f-5dddea60a869', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80447', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'started_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 38, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:39:10.635731 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-c882e80e-cdd1-4d02-b17e-d99b8309d14a service neutron] Checking segment: {'id': '4f8dffb0-f8d4-41b5-beed-53bcf370cb42', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 213, 'network_id': '5e2d06a6-7f04-4134-8004-d5639986c75e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94347) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:39:10.636115 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-c882e80e-cdd1-4d02-b17e-d99b8309d14a service neutron] Bound using segment: {'id': '4f8dffb0-f8d4-41b5-beed-53bcf370cb42', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 213, 'network_id': '5e2d06a6-7f04-4134-8004-d5639986c75e'} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:39:10.636541 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-c882e80e-cdd1-4d02-b17e-d99b8309d14a service neutron] Bound port: 63cfc18e-94f6-437f-86ac-093dde6268e8, host: hv-cinder-80447, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4f8dffb0-f8d4-41b5-beed-53bcf370cb42', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 213, 'network_id': '5e2d06a6-7f04-4134-8004-d5639986c75e'}}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:39:10.636898 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-c882e80e-cdd1-4d02-b17e-d99b8309d14a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:10.669060 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:39:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4628a783-07e4-4019-a66a-9b9dfe446be9 x-openstack-request-id: req-4628a783-07e4-4019-a66a-9b9dfe446be9 {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:39:10.669463 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6cd27eb8-8447-40a0-9229-d59ec6008eeb", "name": "network-vif-plugged", "status": "completed", "tag": "324203bb-e8cc-4392-974c-20b4f2896cc6", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:39:10.669785 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-4628a783-07e4-4019-a66a-9b9dfe446be9 {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:39:10.670257 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6cd27eb8-8447-40a0-9229-d59ec6008eeb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '324203bb-e8cc-4392-974c-20b4f2896cc6', 'code': 200} Sep 18 08:39:10.672451 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:10.704206 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 9a4f8ce9-f706-4c25-b3f4-05f2173cf516, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=9a4f8ce9-f706-4c25-b3f4-05f2173cf516,segment=NetworkSegment(d1432479-9c27-42c4-87db-6905e7868675),segment_id=d1432479-9c27-42c4-87db-6905e7868675)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:39:10.708011 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:10.712609 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-05ba62d8-99e8-40c3-a59b-a056c7780043 req-4fcf1fd4-b41b-41a0-9101-340d45b8fe8a tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0670326 Sep 18 08:39:10.735227 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-c882e80e-cdd1-4d02-b17e-d99b8309d14a service neutron] For port 63cfc18e-94f6-437f-86ac-093dde6268e8, host hv-cinder-80447, cleared binding levels {{(pid=94347) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:39:10.735227 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-c882e80e-cdd1-4d02-b17e-d99b8309d14a service neutron] For port 63cfc18e-94f6-437f-86ac-093dde6268e8, host hv-cinder-80447, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=63cfc18e-94f6-437f-86ac-093dde6268e8,segment=NetworkSegment(4f8dffb0-f8d4-41b5-beed-53bcf370cb42),segment_id=4f8dffb0-f8d4-41b5-beed-53bcf370cb42)] {{(pid=94347) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:39:10.740189 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-c882e80e-cdd1-4d02-b17e-d99b8309d14a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:10.745755 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['59d1e8a2-e4aa-44e5-8014-91de86026543'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:39:10.778893 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-c882e80e-cdd1-4d02-b17e-d99b8309d14a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:10.779840 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-c882e80e-cdd1-4d02-b17e-d99b8309d14a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:10.781608 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-c882e80e-cdd1-4d02-b17e-d99b8309d14a service neutron] 10.222.0.13 "PUT /v2.0/ports/63cfc18e-94f6-437f-86ac-093dde6268e8 HTTP/1.1" status: 200 len: 1093 time: 0.8185682 Sep 18 08:39:10.782175 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8e21db7d-ad7c-4e54-ae13-5a36ab9e244e', 'tag': '63cfc18e-94f6-437f-86ac-093dde6268e8'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:39:10.785251 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1baf0b16-4101-4e29-8890-0bebb7a01503" -d '{"events": [{"name": "network-changed", "server_uuid": "8e21db7d-ad7c-4e54-ae13-5a36ab9e244e", "tag": "63cfc18e-94f6-437f-86ac-093dde6268e8"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:39:10.790493 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=9a4f8ce9-f706-4c25-b3f4-05f2173cf516,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:10.827740 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:39:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d6ec6a19-cfaf-4fc5-bdb1-085a3d39b5bc x-openstack-request-id: req-d6ec6a19-cfaf-4fc5-bdb1-085a3d39b5bc {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:39:10.829363 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8e21db7d-ad7c-4e54-ae13-5a36ab9e244e", "tag": "63cfc18e-94f6-437f-86ac-093dde6268e8", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:39:10.829933 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-d6ec6a19-cfaf-4fc5-bdb1-085a3d39b5bc {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:39:10.830333 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8e21db7d-ad7c-4e54-ae13-5a36ab9e244e', 'tag': '63cfc18e-94f6-437f-86ac-093dde6268e8', 'status': 'completed', 'code': 200} Sep 18 08:39:10.835463 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c882e80e-cdd1-4d02-b17e-d99b8309d14a service neutron] Pushing event updated for resources: {'Port': ['ID=63cfc18e-94f6-437f-86ac-093dde6268e8,revision_number=3']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:11.013852 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1baf0b16-4101-4e29-8890-0bebb7a01503 req-d4ad2066-9da7-48b5-b2fa-5bb9a1403023 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:11.015376 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1baf0b16-4101-4e29-8890-0bebb7a01503 req-d4ad2066-9da7-48b5-b2fa-5bb9a1403023 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=fb9519a4056a4e2ebbe5200ff83d0a1e&device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 1096 time: 0.1262944 Sep 18 08:39:11.049323 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ec2c432-7eda-4071-b011-121faf3c5195 req-b1f2bb83-1fe0-4fb6-9c0a-647e3a8be664 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:11.050782 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0ec2c432-7eda-4071-b011-121faf3c5195 req-b1f2bb83-1fe0-4fb6-9c0a-647e3a8be664 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.1055307 Sep 18 08:39:11.053870 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8209aaf5-e504-4d07-bcd1-ac0ad6ee9845 req-43d1e0fe-46c6-42cf-a193-d2a5425523ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:11.055276 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8209aaf5-e504-4d07-bcd1-ac0ad6ee9845 req-43d1e0fe-46c6-42cf-a193-d2a5425523ed service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 1098 time: 0.1403296 Sep 18 08:39:11.111659 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-8209aaf5-e504-4d07-bcd1-ac0ad6ee9845 req-82adf57e-52ff-4d15-8923-d3e9aa601aeb service neutron] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:11.338707 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['b03411eb-66ff-4691-88c8-2c570d78c323'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:39:11.386361 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0ec2c432-7eda-4071-b011-121faf3c5195 req-3825b35e-daf2-4954-8231-4628b6f77671 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3200634 Sep 18 08:39:11.418372 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1baf0b16-4101-4e29-8890-0bebb7a01503 req-c1be625e-0d9b-41ef-bff0-d815be39d540 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:11.419930 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1baf0b16-4101-4e29-8890-0bebb7a01503 req-c1be625e-0d9b-41ef-bff0-d815be39d540 service neutron] 10.222.0.13 "GET /v2.0/networks?tenant_id=fb9519a4056a4e2ebbe5200ff83d0a1e&shared=False HTTP/1.1" status: 200 len: 909 time: 0.3878860 Sep 18 08:39:11.430906 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdeee3b6-c6c0-418f-b53a-0d57a902eaea req-d3ce8d26-7733-4ea1-b8cf-7fa41cba88ed tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:11.432399 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cdeee3b6-c6c0-418f-b53a-0d57a902eaea req-d3ce8d26-7733-4ea1-b8cf-7fa41cba88ed tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 945 time: 0.3468413 Sep 18 08:39:11.576444 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cdeee3b6-c6c0-418f-b53a-0d57a902eaea req-45619418-82c6-4dae-b7b8-d2d28ea4d77c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1334424 Sep 18 08:39:11.606440 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7be309a4-4bc1-4d15-8bff-09a98631a3af req-d66a4806-5eb9-41af-b522-2b65db590aab tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:11.607936 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7be309a4-4bc1-4d15-8bff-09a98631a3af req-d66a4806-5eb9-41af-b522-2b65db590aab tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 943 time: 0.1524241 Sep 18 08:39:11.669745 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1baf0b16-4101-4e29-8890-0bebb7a01503 req-3401af69-ba26-494a-81d1-91e3af4667c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:11.671072 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1baf0b16-4101-4e29-8890-0bebb7a01503 req-3401af69-ba26-494a-81d1-91e3af4667c3 service neutron] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2378092 Sep 18 08:39:11.697802 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-8209aaf5-e504-4d07-bcd1-ac0ad6ee9845 req-82adf57e-52ff-4d15-8923-d3e9aa601aeb service neutron] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:11.705105 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-8209aaf5-e504-4d07-bcd1-ac0ad6ee9845 req-82adf57e-52ff-4d15-8923-d3e9aa601aeb service neutron] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:11.714992 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7be309a4-4bc1-4d15-8bff-09a98631a3af req-232dfffb-6130-42cf-af7f-75eafb6f96b1 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1003504 Sep 18 08:39:11.747185 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8209aaf5-e504-4d07-bcd1-ac0ad6ee9845 req-82adf57e-52ff-4d15-8923-d3e9aa601aeb service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6821218 Sep 18 08:39:11.754292 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82adf57e-52ff-4d15-8923-d3e9aa601aeb service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=b0be28a7-fd9a-48de-aa46-daafe7912b0a,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:11.765665 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5841a0bb-55b6-4c90-a4df-b92f8ebabaae req-0c6e589e-98cc-48b1-858e-3bc51a460814 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:11.767160 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5841a0bb-55b6-4c90-a4df-b92f8ebabaae req-0c6e589e-98cc-48b1-858e-3bc51a460814 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 946 time: 0.1262882 Sep 18 08:39:11.827650 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5841a0bb-55b6-4c90-a4df-b92f8ebabaae req-05b7d664-13ea-46e8-bcf1-bc4c232756f2 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0543618 Sep 18 08:39:11.846218 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5758a481-6129-44a4-a648-96f38630a540 req-a4b58bd9-c9fa-4ea1-b260-c4a9e6722009 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:11.847674 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5758a481-6129-44a4-a648-96f38630a540 req-a4b58bd9-c9fa-4ea1-b260-c4a9e6722009 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 945 time: 0.0609465 Sep 18 08:39:11.885450 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5758a481-6129-44a4-a648-96f38630a540 req-3ca3255a-e839-48ea-a896-a3507dd7575d tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0318377 Sep 18 08:39:12.512920 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73d92528-b188-4c07-8e98-f65d4a52aeaa req-3576d704-03cf-47a4-9327-78bb881d79e4 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:12.514453 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-73d92528-b188-4c07-8e98-f65d4a52aeaa req-3576d704-03cf-47a4-9327-78bb881d79e4 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0516584 Sep 18 08:39:12.551343 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-73d92528-b188-4c07-8e98-f65d4a52aeaa req-13f0548d-5e7b-455a-ac45-fe68bf066b16 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0309384 Sep 18 08:39:12.671916 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c2476c0-3321-4eb3-a42d-df9f52eeb4f8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9a4f8ce9-f706-4c25-b3f4-05f2173cf516'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:39:12.674366 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-14a55699-8499-4112-9802-a5fb250e70e2" -d '{"events": [{"server_uuid": "1c2476c0-3321-4eb3-a42d-df9f52eeb4f8", "name": "network-vif-plugged", "status": "completed", "tag": "9a4f8ce9-f706-4c25-b3f4-05f2173cf516"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:39:12.687606 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc938f51-0336-49ad-9667-da8350e7ba58 req-d2940f7f-e815-49d0-8ed4-d3f011ef514a tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:12.689104 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dc938f51-0336-49ad-9667-da8350e7ba58 req-d2940f7f-e815-49d0-8ed4-d3f011ef514a tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 945 time: 0.0480175 Sep 18 08:39:12.708395 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:39:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f7da8462-1507-45ca-b1b9-38a004c859d1 x-openstack-request-id: req-f7da8462-1507-45ca-b1b9-38a004c859d1 {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:39:12.708685 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1c2476c0-3321-4eb3-a42d-df9f52eeb4f8", "name": "network-vif-plugged", "status": "completed", "tag": "9a4f8ce9-f706-4c25-b3f4-05f2173cf516", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:39:12.709195 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-f7da8462-1507-45ca-b1b9-38a004c859d1 {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:39:12.710102 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c2476c0-3321-4eb3-a42d-df9f52eeb4f8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9a4f8ce9-f706-4c25-b3f4-05f2173cf516', 'code': 200} Sep 18 08:39:12.727063 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dc938f51-0336-49ad-9667-da8350e7ba58 req-0af4ecdd-bcee-46b1-ae73-ff4f6ddd6cc7 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0321503 Sep 18 08:39:12.844613 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06b874b7-dc7e-420a-8c14-56db4a72b00f req-6bb45d2c-5a96-4022-8504-f34bc445037f tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:12.846082 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-06b874b7-dc7e-420a-8c14-56db4a72b00f req-6bb45d2c-5a96-4022-8504-f34bc445037f tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 943 time: 0.0470202 Sep 18 08:39:12.883151 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-06b874b7-dc7e-420a-8c14-56db4a72b00f req-deb0acf0-33c1-47dd-934d-510086327a0f tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0312335 Sep 18 08:39:12.942344 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f823f535-a0e0-45f2-ac72-66cc70907976 req-acda360b-5c92-4b1b-b2b8-9f9b76905718 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:12.944390 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f823f535-a0e0-45f2-ac72-66cc70907976 req-acda360b-5c92-4b1b-b2b8-9f9b76905718 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 946 time: 0.0508053 Sep 18 08:39:13.007986 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f823f535-a0e0-45f2-ac72-66cc70907976 req-e95f3950-a698-4f1b-986c-3c9007f9cd7a tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0575163 Sep 18 08:39:13.028421 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a9822d7-5079-4f18-a17f-879493ed2859 req-81e894dd-6811-4816-bbea-92afc014a9f6 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:13.028421 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5a9822d7-5079-4f18-a17f-879493ed2859 req-81e894dd-6811-4816-bbea-92afc014a9f6 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 945 time: 0.0729597 Sep 18 08:39:13.064306 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5a9822d7-5079-4f18-a17f-879493ed2859 req-04f481e2-307b-4740-afb4-1f716048070e tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0356681 Sep 18 08:39:13.663749 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f3e0cb5-d25d-4e66-b9ae-d6c2eaa9fee3 req-43432cec-20ff-4dc0-9eea-cc70043b6406 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:13.665246 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7f3e0cb5-d25d-4e66-b9ae-d6c2eaa9fee3 req-43432cec-20ff-4dc0-9eea-cc70043b6406 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0465257 Sep 18 08:39:13.701804 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7f3e0cb5-d25d-4e66-b9ae-d6c2eaa9fee3 req-9cefdafd-d2dd-4e50-a246-dc1735a34428 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0306811 Sep 18 08:39:13.839802 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9114c607-fec6-42d9-9b77-753470a513f8 req-42f8ee79-a203-4b72-a164-ad1590f705b9 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:13.841283 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9114c607-fec6-42d9-9b77-753470a513f8 req-42f8ee79-a203-4b72-a164-ad1590f705b9 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 945 time: 0.0498946 Sep 18 08:39:13.877035 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9114c607-fec6-42d9-9b77-753470a513f8 req-e7139b1f-16c6-4565-8b5a-572a57fd5253 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0297995 Sep 18 08:39:13.992386 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c4f77a1-6ad7-48ff-9259-4fdb1c0e1483 req-540ea11f-84f2-4c6d-a169-7de2b1c1fc98 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:13.993872 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1c4f77a1-6ad7-48ff-9259-4fdb1c0e1483 req-540ea11f-84f2-4c6d-a169-7de2b1c1fc98 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 943 time: 0.0471227 Sep 18 08:39:14.030978 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1c4f77a1-6ad7-48ff-9259-4fdb1c0e1483 req-e6eb1f86-fd21-40ac-94c3-4f9a8a9d2ed7 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0312893 Sep 18 08:39:14.120118 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd53f97c-227c-433f-a3f3-750865896b67 req-3bc42dc2-db21-45f0-95d2-09eb4f15bdd6 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:14.121637 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fd53f97c-227c-433f-a3f3-750865896b67 req-3bc42dc2-db21-45f0-95d2-09eb4f15bdd6 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 946 time: 0.0470109 Sep 18 08:39:14.184351 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fd53f97c-227c-433f-a3f3-750865896b67 req-f9058957-b8b5-499e-b9bf-5661b05066c5 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0567389 Sep 18 08:39:14.202406 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35cea246-4e90-4407-b81e-54548a95c6bf req-c931bb4d-8a02-42e0-8ba7-69c57ce86792 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:14.203869 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-35cea246-4e90-4407-b81e-54548a95c6bf req-c931bb4d-8a02-42e0-8ba7-69c57ce86792 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 945 time: 0.0690978 Sep 18 08:39:14.240166 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-35cea246-4e90-4407-b81e-54548a95c6bf req-a900dbdc-bb39-4716-8608-13ef087fdd61 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0302289 Sep 18 08:39:14.814993 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3d5673a-5d22-44a2-9888-130e5dd1b3cd req-ad1e298b-22a8-4d38-abcd-f613f3b11142 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:14.816470 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d3d5673a-5d22-44a2-9888-130e5dd1b3cd req-ad1e298b-22a8-4d38-abcd-f613f3b11142 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0470381 Sep 18 08:39:14.852870 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d3d5673a-5d22-44a2-9888-130e5dd1b3cd req-e38c518d-2116-4d10-9273-ae12e67dd739 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0305543 Sep 18 08:39:14.986044 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61e450a9-d70d-4815-9983-5c810c5cbd41 req-499d294d-0e4c-4f39-8828-ad9dd67e1be1 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:14.987395 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-61e450a9-d70d-4815-9983-5c810c5cbd41 req-499d294d-0e4c-4f39-8828-ad9dd67e1be1 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 945 time: 0.0466619 Sep 18 08:39:15.027156 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-61e450a9-d70d-4815-9983-5c810c5cbd41 req-a398943b-af29-4345-b6e4-24b5705b3d94 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0339305 Sep 18 08:39:15.142650 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-582173c7-9b91-4472-95b3-85a1208402a9 req-fb697d39-85cd-4240-a65a-7f8e816ceae3 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:15.144088 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-582173c7-9b91-4472-95b3-85a1208402a9 req-fb697d39-85cd-4240-a65a-7f8e816ceae3 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 943 time: 0.0460064 Sep 18 08:39:15.179824 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-582173c7-9b91-4472-95b3-85a1208402a9 req-95718108-2980-47d3-87bc-bf9230fc5e63 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0293813 Sep 18 08:39:15.294736 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b199ca53-b13c-4e26-b413-b3315b346fee req-b54578a2-0a66-4b90-a280-0216ae5304c4 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:15.296220 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b199ca53-b13c-4e26-b413-b3315b346fee req-b54578a2-0a66-4b90-a280-0216ae5304c4 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 946 time: 0.0477455 Sep 18 08:39:15.363078 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b199ca53-b13c-4e26-b413-b3315b346fee req-c73aa1f8-b280-4d0b-ad55-0a66d3fab277 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0609770 Sep 18 08:39:15.374893 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c2de425-076a-4964-94a0-d35fe16b56d2 req-328b0a1f-f7fc-495b-99b4-1f224adbb9b7 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:15.376334 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3c2de425-076a-4964-94a0-d35fe16b56d2 req-328b0a1f-f7fc-495b-99b4-1f224adbb9b7 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 945 time: 0.0685792 Sep 18 08:39:15.414286 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3c2de425-076a-4964-94a0-d35fe16b56d2 req-9a8f347e-b692-4bc8-abbb-6b623d53f20b tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0314929 Sep 18 08:39:15.965446 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a946cbcb-c97f-486b-9b4c-f86e58c9c7f1 req-5c9a14f5-2f87-4a9e-a2d5-fcbf2451b3f6 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:15.966919 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a946cbcb-c97f-486b-9b4c-f86e58c9c7f1 req-5c9a14f5-2f87-4a9e-a2d5-fcbf2451b3f6 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0469806 Sep 18 08:39:16.009281 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a946cbcb-c97f-486b-9b4c-f86e58c9c7f1 req-e74f05f8-c1d2-4269-94c9-e8586b4cdf0f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0363414 Sep 18 08:39:16.011653 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 details requested by agent hyperv_hv-cinder-80447 with host hv-cinder-80447 {{(pid=94348) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 18 08:39:16.110235 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:39:16.121942 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Returning: {'device': '2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'port_id': '2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1', 'mac_address': 'fa:16:3e:de:30:b5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 214, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94348) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 18 08:39:16.138434 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46013311-ad5d-4e16-9607-32a78186d565 req-00798366-e59c-46d0-b572-8da16585c7b4 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:16.139888 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-46013311-ad5d-4e16-9607-32a78186d565 req-00798366-e59c-46d0-b572-8da16585c7b4 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 945 time: 0.0477855 Sep 18 08:39:16.157389 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:16.170097 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 {{(pid=94348) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:39:16.176757 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-46013311-ad5d-4e16-9607-32a78186d565 req-070527c0-9c8a-4135-aa55-d57f45a62049 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0308702 Sep 18 08:39:16.189556 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:39:16.194742 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:16.244281 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:16.294141 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a1d38ef-4cbe-41b5-8c31-00fe9f308927 req-95a1e77f-345a-4e37-9b01-e51c088a834a tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:16.295605 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8a1d38ef-4cbe-41b5-8c31-00fe9f308927 req-95a1e77f-345a-4e37-9b01-e51c088a834a tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 943 time: 0.0506828 Sep 18 08:39:16.331189 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8a1d38ef-4cbe-41b5-8c31-00fe9f308927 req-0ba55c5e-1d1f-4b97-9f35-9aefebf38079 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0296316 Sep 18 08:39:16.476265 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e52a4d85-3d3f-4185-9d09-96a338695cc3 req-8ce76041-a31a-4c22-a450-552cbcfe4a82 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:16.477803 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e52a4d85-3d3f-4185-9d09-96a338695cc3 req-8ce76041-a31a-4c22-a450-552cbcfe4a82 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 946 time: 0.0491734 Sep 18 08:39:16.541220 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e52a4d85-3d3f-4185-9d09-96a338695cc3 req-ecc7e674-759e-4101-8a2f-9482707ec701 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0542605 Sep 18 08:39:16.549805 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cdf2acb-dd25-4bbe-998a-e45cd7a1d378 req-a67641f2-41d5-4c13-b873-f6899b699b4c tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:16.551260 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5cdf2acb-dd25-4bbe-998a-e45cd7a1d378 req-a67641f2-41d5-4c13-b873-f6899b699b4c tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 945 time: 0.0725782 Sep 18 08:39:16.588742 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5cdf2acb-dd25-4bbe-998a-e45cd7a1d378 req-26df7ce6-e981-4a25-a13f-ab09f0902217 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0315032 Sep 18 08:39:16.952149 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-9bac1def-3bd7-45ce-b569-4ba46754de6f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:16.953570 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-9bac1def-3bd7-45ce-b569-4ba46754de6f service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=fb9519a4056a4e2ebbe5200ff83d0a1e&device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 1096 time: 0.0423701 Sep 18 08:39:17.012538 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-18e264cf-b395-4396-850b-d1fba200b392 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=63cfc18e-94f6-437f-86ac-093dde6268e8 HTTP/1.1" status: 200 len: 217 time: 0.0356994 Sep 18 08:39:17.150165 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-7eb5a3a7-8cdb-43da-b1d9-196deb12941c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:17.151696 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-7eb5a3a7-8cdb-43da-b1d9-196deb12941c service neutron] 10.222.0.13 "GET /v2.0/subnets?id=10680649-3557-49d0-9377-0d9cdb4efe69 HTTP/1.1" status: 200 len: 848 time: 0.1001096 Sep 18 08:39:17.156726 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b81aacd-84c8-45d5-bf52-c8f1f1b68ff9 req-cf5d2412-419c-4844-b07e-b42ab9b8ec64 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:17.158141 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0b81aacd-84c8-45d5-bf52-c8f1f1b68ff9 req-cf5d2412-419c-4844-b07e-b42ab9b8ec64 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 1099 time: 0.1263630 Sep 18 08:39:17.169664 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bec6877-6707-46a0-98cb-5366989f89db req-83fa40a2-7572-4f62-a0d7-4d6618cc4161 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:17.171098 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9bec6877-6707-46a0-98cb-5366989f89db req-83fa40a2-7572-4f62-a0d7-4d6618cc4161 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 945 time: 0.0758731 Sep 18 08:39:17.214381 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-f6a65ac9-6c59-4c6f-a44a-4e9789d69710 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=5e2d06a6-7f04-4134-8004-d5639986c75e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0423098 Sep 18 08:39:17.256921 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0b81aacd-84c8-45d5-bf52-c8f1f1b68ff9 req-7b2150c8-f64a-4c56-9ec8-1f64d0f713f5 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0832939 Sep 18 08:39:17.310764 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9bec6877-6707-46a0-98cb-5366989f89db req-44df81ad-fb21-4c85-8f3e-e33112c6f0c9 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1234224 Sep 18 08:39:17.346331 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:39:17.361339 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c516c12-7102-42b0-b3e3-c7bc4e51aab6 req-e5eb1f91-2083-4e30-ac22-6850e8703d3e tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:17.362833 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8c516c12-7102-42b0-b3e3-c7bc4e51aab6 req-e5eb1f91-2083-4e30-ac22-6850e8703d3e tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 945 time: 0.1088085 Sep 18 08:39:17.401149 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-ff7bd159-81f6-4c4a-9674-0c7b90e6b1d1 service neutron] 10.222.0.13 "GET /v2.0/networks/5e2d06a6-7f04-4134-8004-d5639986c75e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1699281 Sep 18 08:39:17.429047 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8c516c12-7102-42b0-b3e3-c7bc4e51aab6 req-ae9f2496-b68a-4571-91a5-437c514e7a9a tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0522721 Sep 18 08:39:17.493596 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c66a8ca5-d5fa-4d9e-a87a-b76f6f173c35 req-44307759-80de-4976-b419-f897d87ad393 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:17.493715 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c66a8ca5-d5fa-4d9e-a87a-b76f6f173c35 req-44307759-80de-4976-b419-f897d87ad393 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 943 time: 0.0636365 Sep 18 08:39:17.534451 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c66a8ca5-d5fa-4d9e-a87a-b76f6f173c35 req-28dd829b-e8cb-4694-9a16-e7fcd3a94a21 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0327456 Sep 18 08:39:17.659429 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9c68a3a-7326-4019-8843-f6bdd58bc805 req-bcff7631-e71e-405f-bd33-0b562c4a6ffa tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:17.661330 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a9c68a3a-7326-4019-8843-f6bdd58bc805 req-bcff7631-e71e-405f-bd33-0b562c4a6ffa tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 946 time: 0.0532129 Sep 18 08:39:17.759993 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0ccd130-8073-460e-9c10-157d5cdbca1a req-8e0be627-91b1-48c8-9cdd-14910324aec8 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:17.761554 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f0ccd130-8073-460e-9c10-157d5cdbca1a req-8e0be627-91b1-48c8-9cdd-14910324aec8 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 945 time: 0.0993011 Sep 18 08:39:17.766253 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a9c68a3a-7326-4019-8843-f6bdd58bc805 req-1d5da641-0046-4a94-9e09-3ff90e0397d2 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0942080 Sep 18 08:39:17.861336 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f0ccd130-8073-460e-9c10-157d5cdbca1a req-21a561f5-6b27-4640-8178-8f03ee44970e tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0913160 Sep 18 08:39:17.877343 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4717a933-cfa8-467e-929d-c31b99fa8ec1 req-0a69b1ca-7a05-4113-8041-6ddf353c9e5a service neutron] 10.222.0.13 "GET /v2.0/networks/5e2d06a6-7f04-4134-8004-d5639986c75e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1642358 Sep 18 08:39:17.972680 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 56278) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:18.031557 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 59d1e8a2-e4aa-44e5-8014-91de86026543 up at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:39:18.084002 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning for port 59d1e8a2-e4aa-44e5-8014-91de86026543 completed by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 18 08:39:18.085327 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-20fefb37-9fb6-4032-b99a-3734053fdc53 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:18.088155 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning complete for port 59d1e8a2-e4aa-44e5-8014-91de86026543 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:39:18.088526 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:18.164934 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:18.178779 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-20fefb37-9fb6-4032-b99a-3734053fdc53 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:18.182463 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-20fefb37-9fb6-4032-b99a-3734053fdc53 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:18.191011 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a8fb23c6-6606-497f-820d-0643e56a39d1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '59d1e8a2-e4aa-44e5-8014-91de86026543'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:39:18.193495 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ab298917-67f6-4089-8b40-45e9c74d28c5" -d '{"events": [{"server_uuid": "a8fb23c6-6606-497f-820d-0643e56a39d1", "name": "network-vif-plugged", "status": "completed", "tag": "59d1e8a2-e4aa-44e5-8014-91de86026543"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:39:18.206920 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 59d1e8a2-e4aa-44e5-8014-91de86026543, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=59d1e8a2-e4aa-44e5-8014-91de86026543,segment=NetworkSegment(cb92e74f-7545-44c8-a2d3-634d116af362),segment_id=cb92e74f-7545-44c8-a2d3-634d116af362)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:39:18.212667 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:18.213950 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device b03411eb-66ff-4691-88c8-2c570d78c323 up at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:39:18.224407 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-20fefb37-9fb6-4032-b99a-3734053fdc53 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=80f5792a1d4546b39a99bdbdf9fb154d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2501874 Sep 18 08:39:18.225060 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20fefb37-9fb6-4032-b99a-3734053fdc53 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1dec2f14-62f2-4bbe-ae9d-bd7468bfeee9,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:18.227200 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 56284) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:18.241931 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:39:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fd1ed314-dd5a-4eff-8a8d-1c30f73c744c x-openstack-request-id: req-fd1ed314-dd5a-4eff-8a8d-1c30f73c744c {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:39:18.242231 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a8fb23c6-6606-497f-820d-0643e56a39d1", "name": "network-vif-plugged", "status": "completed", "tag": "59d1e8a2-e4aa-44e5-8014-91de86026543", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:39:18.242484 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-fd1ed314-dd5a-4eff-8a8d-1c30f73c744c {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:39:18.242867 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a8fb23c6-6606-497f-820d-0643e56a39d1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '59d1e8a2-e4aa-44e5-8014-91de86026543', 'code': 200} Sep 18 08:39:18.278765 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-12a82ff4-332d-4b3a-a8c0-ac92ebfd981e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:18.300225 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-12a82ff4-332d-4b3a-a8c0-ac92ebfd981e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:18.300543 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=59d1e8a2-e4aa-44e5-8014-91de86026543,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:18.315205 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning for port b03411eb-66ff-4691-88c8-2c570d78c323 completed by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 18 08:39:18.319039 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning complete for port b03411eb-66ff-4691-88c8-2c570d78c323 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:39:18.319418 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:18.349340 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-12a82ff4-332d-4b3a-a8c0-ac92ebfd981e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:18.353231 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-12a82ff4-332d-4b3a-a8c0-ac92ebfd981e admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:18.357517 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-12a82ff4-332d-4b3a-a8c0-ac92ebfd981e admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/1dec2f14-62f2-4bbe-ae9d-bd7468bfeee9 HTTP/1.1" status: 204 len: 168 time: 0.1285176 Sep 18 08:39:18.366476 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12a82ff4-332d-4b3a-a8c0-ac92ebfd981e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1dec2f14-62f2-4bbe-ae9d-bd7468bfeee9,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:18.374643 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12a82ff4-332d-4b3a-a8c0-ac92ebfd981e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:18.375004 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12a82ff4-332d-4b3a-a8c0-ac92ebfd981e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:18.375446 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12a82ff4-332d-4b3a-a8c0-ac92ebfd981e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:18.375779 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12a82ff4-332d-4b3a-a8c0-ac92ebfd981e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:18.376351 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12a82ff4-332d-4b3a-a8c0-ac92ebfd981e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:18.376699 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12a82ff4-332d-4b3a-a8c0-ac92ebfd981e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:18.377254 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12a82ff4-332d-4b3a-a8c0-ac92ebfd981e admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:18.377962 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12a82ff4-332d-4b3a-a8c0-ac92ebfd981e admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:18.378821 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12a82ff4-332d-4b3a-a8c0-ac92ebfd981e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:18.379428 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12a82ff4-332d-4b3a-a8c0-ac92ebfd981e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:18.380062 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12a82ff4-332d-4b3a-a8c0-ac92ebfd981e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:18.380565 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-12a82ff4-332d-4b3a-a8c0-ac92ebfd981e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:18.429146 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:18.472653 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port b03411eb-66ff-4691-88c8-2c570d78c323, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=b03411eb-66ff-4691-88c8-2c570d78c323,segment=NetworkSegment(cb92e74f-7545-44c8-a2d3-634d116af362),segment_id=cb92e74f-7545-44c8-a2d3-634d116af362)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:39:18.478053 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:18.502570 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c842a20-f45f-47a3-8b5e-274cedaa7639 req-820840e4-3bf8-485c-b4f0-b66590edfebc tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:18.504464 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5c842a20-f45f-47a3-8b5e-274cedaa7639 req-820840e4-3bf8-485c-b4f0-b66590edfebc tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 945 time: 0.0967414 Sep 18 08:39:18.574392 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6543d4a0-740a-418d-874d-fb425ae6a0ba req-fb6df57a-d07a-4d4a-b42d-4a18451be1ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:18.575910 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6543d4a0-740a-418d-874d-fb425ae6a0ba req-fb6df57a-d07a-4d4a-b42d-4a18451be1ab service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 1099 time: 0.1230085 Sep 18 08:39:18.576346 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=b03411eb-66ff-4691-88c8-2c570d78c323,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:18.628032 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e8b6c5e-009a-4c4e-b77d-6b9e46257e62 req-a262942f-a5af-468e-ae26-0d0fde388ebc tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:18.629807 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7e8b6c5e-009a-4c4e-b77d-6b9e46257e62 req-a262942f-a5af-468e-ae26-0d0fde388ebc tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.1186557 Sep 18 08:39:18.640620 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5c842a20-f45f-47a3-8b5e-274cedaa7639 req-91fd8031-52ab-4310-b50a-ac5a874a18db tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0911238 Sep 18 08:39:18.692657 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6543d4a0-740a-418d-874d-fb425ae6a0ba req-d4b891fa-aeee-4afc-86b6-5864d099cb62 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1014633 Sep 18 08:39:18.706940 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7e8b6c5e-009a-4c4e-b77d-6b9e46257e62 req-ede92412-be23-49d2-9adc-b3f68b7b4c86 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0568888 Sep 18 08:39:18.747411 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 56312) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:18.761044 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-56f254ce-70ba-4391-a605-33620cca4239 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:18.775111 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3335c26-9198-49f9-983a-ff2be9247dca req-ceef2743-f6fa-483a-8d81-f3386a3e6483 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:18.776711 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c3335c26-9198-49f9-983a-ff2be9247dca req-ceef2743-f6fa-483a-8d81-f3386a3e6483 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 943 time: 0.0560727 Sep 18 08:39:18.824990 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c3335c26-9198-49f9-983a-ff2be9247dca req-2c016ad5-01ce-4b8b-ac39-b51f2242643b tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420601 Sep 18 08:39:18.866679 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-56f254ce-70ba-4391-a605-33620cca4239 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:18.871810 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-56f254ce-70ba-4391-a605-33620cca4239 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:18.902734 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5f2b671-2a55-4dc7-a56a-08a565a44ab9 req-24055f94-8434-4ddc-8f1c-d2931261b793 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:18.904283 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d5f2b671-2a55-4dc7-a56a-08a565a44ab9 req-24055f94-8434-4ddc-8f1c-d2931261b793 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 946 time: 0.0531342 Sep 18 08:39:18.920430 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-56f254ce-70ba-4391-a605-33620cca4239 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=febca79608d54b56aa95c3c3deb665fd&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1719108 Sep 18 08:39:18.925510 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 56324) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:18.926192 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56f254ce-70ba-4391-a605-33620cca4239 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2fff08d3-2e7c-4264-bc77-fd56c10d6980,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:18.963089 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d5f2b671-2a55-4dc7-a56a-08a565a44ab9 req-70690896-0479-4287-a07d-d65ebe60b740 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0494895 Sep 18 08:39:18.988945 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-902b5253-62d1-44c9-911e-f4d7cf59e59d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:19.014197 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-902b5253-62d1-44c9-911e-f4d7cf59e59d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:19.021106 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f91e4eab-88e7-4398-9787-ca0e421402bb req-1d1ff2e6-9677-4547-bddc-6df1daa729f1 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:19.023210 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f91e4eab-88e7-4398-9787-ca0e421402bb req-1d1ff2e6-9677-4547-bddc-6df1daa729f1 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 945 time: 0.0558279 Sep 18 08:39:19.064005 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f91e4eab-88e7-4398-9787-ca0e421402bb req-6becdf48-af0e-4b43-bdd8-4ddd4bc9370d tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0344803 Sep 18 08:39:19.068340 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-902b5253-62d1-44c9-911e-f4d7cf59e59d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:19.071953 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-902b5253-62d1-44c9-911e-f4d7cf59e59d admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:19.073121 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-902b5253-62d1-44c9-911e-f4d7cf59e59d admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/2fff08d3-2e7c-4264-bc77-fd56c10d6980 HTTP/1.1" status: 204 len: 168 time: 0.1436083 Sep 18 08:39:19.081849 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-902b5253-62d1-44c9-911e-f4d7cf59e59d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2fff08d3-2e7c-4264-bc77-fd56c10d6980,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:19.592948 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-01f4dbb8-8b01-4955-afa1-7425197caaf0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:19.709294 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:39:19.766374 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b44088-e788-4e99-a5e5-1df163229880 req-4481ab18-dc67-40a0-8af1-9871c47c9717 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:19.767897 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-31b44088-e788-4e99-a5e5-1df163229880 req-4481ab18-dc67-40a0-8af1-9871c47c9717 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 945 time: 0.0519271 Sep 18 08:39:19.835666 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-31b44088-e788-4e99-a5e5-1df163229880 req-de7afd30-a65d-48fd-979f-3c7d34d907ee tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0592823 Sep 18 08:39:19.848028 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e3dbade-140b-44cb-8b08-fea278e8dd1c req-7a0dca4b-9810-4553-87d5-6d4742514355 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:19.849745 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5e3dbade-140b-44cb-8b08-fea278e8dd1c req-7a0dca4b-9810-4553-87d5-6d4742514355 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.0716677 Sep 18 08:39:19.879998 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:19.903657 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5e3dbade-140b-44cb-8b08-fea278e8dd1c req-d3082686-a0b1-4da8-b71a-c00ece19a2ef tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470777 Sep 18 08:39:19.989866 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1cb287b-c95d-44b7-be45-e4f88ee94745 req-22ee80b7-1866-4fe5-8cc3-a641895f589e tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:19.992448 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a1cb287b-c95d-44b7-be45-e4f88ee94745 req-22ee80b7-1866-4fe5-8cc3-a641895f589e tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 943 time: 0.0647144 Sep 18 08:39:20.040245 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 up at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:39:20.097125 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a1cb287b-c95d-44b7-be45-e4f88ee94745 req-34f0d330-f7b3-4e16-9ba2-ea78c0551e9c tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0817196 Sep 18 08:39:20.120659 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning for port 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 completed by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 18 08:39:20.125639 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning complete for port 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:39:20.125978 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:20.144532 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-499c8979-183c-4ae5-b46a-45a63b289f84 req-25da31dd-745f-417e-9632-8afe4757efe7 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:20.153106 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-499c8979-183c-4ae5-b46a-45a63b289f84 req-25da31dd-745f-417e-9632-8afe4757efe7 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 946 time: 0.0912130 Sep 18 08:39:20.224549 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:20.246588 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f8a97551-ea2e-41f9-9a70-491f3e39e166', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b03411eb-66ff-4691-88c8-2c570d78c323'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:39:20.249575 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-39896754-9931-41a6-9447-abf4e6eaa0d3" -d '{"events": [{"server_uuid": "f8a97551-ea2e-41f9-9a70-491f3e39e166", "name": "network-vif-plugged", "status": "completed", "tag": "b03411eb-66ff-4691-88c8-2c570d78c323"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:39:20.264173 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-499c8979-183c-4ae5-b46a-45a63b289f84 req-3dae609a-6501-401a-8dcc-b83867d7d4ea tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1038394 Sep 18 08:39:20.318288 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:39:20.324878 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:39:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-18f2037e-d639-4016-813b-ffeec5b61015 x-openstack-request-id: req-18f2037e-d639-4016-813b-ffeec5b61015 {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:39:20.325153 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f8a97551-ea2e-41f9-9a70-491f3e39e166", "name": "network-vif-plugged", "status": "completed", "tag": "b03411eb-66ff-4691-88c8-2c570d78c323", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:39:20.325463 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-18f2037e-d639-4016-813b-ffeec5b61015 {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:39:20.325856 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f8a97551-ea2e-41f9-9a70-491f3e39e166', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b03411eb-66ff-4691-88c8-2c570d78c323', 'code': 200} Sep 18 08:39:20.327826 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:20.370480 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be82b7cc-a357-4b43-887b-95b703b1724e req-82a88e84-4174-4a97-8075-3a6b610e22c5 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:20.379036 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-be82b7cc-a357-4b43-887b-95b703b1724e req-82a88e84-4174-4a97-8075-3a6b610e22c5 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 945 time: 0.1719015 Sep 18 08:39:20.447366 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:20.473650 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-be82b7cc-a357-4b43-887b-95b703b1724e req-360da312-a4b5-463e-b692-5839e7509038 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0866361 Sep 18 08:39:20.575301 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 56394) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:20.686740 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-00a6f287-ec42-47a3-ad8b-eff706e7aa02 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:20.741380 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03a37d20-b289-415b-ac16-8f63770c46bc req-174059d3-86a7-4f9a-ba1c-3494b2cf5c41 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:20.743373 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-03a37d20-b289-415b-ac16-8f63770c46bc req-174059d3-86a7-4f9a-ba1c-3494b2cf5c41 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 1098 time: 0.0448904 Sep 18 08:39:20.795821 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-00a6f287-ec42-47a3-ad8b-eff706e7aa02 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:20.800797 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-03a37d20-b289-415b-ac16-8f63770c46bc req-6dbd5800-435d-4b7f-b0c3-be494ad5cfc9 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0374532 Sep 18 08:39:20.806480 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-00a6f287-ec42-47a3-ad8b-eff706e7aa02 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:20.847540 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-00a6f287-ec42-47a3-ad8b-eff706e7aa02 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=ade093818dc7433a9f371fa4839687e8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2709219 Sep 18 08:39:20.850111 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00a6f287-ec42-47a3-ad8b-eff706e7aa02 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aae055ca-2b1f-4e7d-a903-8c8e123fbb27,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:20.850946 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 56402) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:20.899675 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-18afd63a-c1f1-4aaf-a3f4-8545a62a7e24 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:20.920481 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-18afd63a-c1f1-4aaf-a3f4-8545a62a7e24 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:21.021951 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59999489-bf57-44f2-99bf-01ffe19b6768 req-45869e75-749d-4162-9c65-c7f47bcd93b1 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:21.023425 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-59999489-bf57-44f2-99bf-01ffe19b6768 req-45869e75-749d-4162-9c65-c7f47bcd93b1 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0969386 Sep 18 08:39:21.044232 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96aa0d05-e2dd-4c6f-92ed-af79706a2326 req-56dc3db6-591e-44fe-a724-4c62682cb476 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:21.045685 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-96aa0d05-e2dd-4c6f-92ed-af79706a2326 req-56dc3db6-591e-44fe-a724-4c62682cb476 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.0699720 Sep 18 08:39:21.058223 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-18afd63a-c1f1-4aaf-a3f4-8545a62a7e24 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:21.060689 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-18afd63a-c1f1-4aaf-a3f4-8545a62a7e24 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:21.061769 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-18afd63a-c1f1-4aaf-a3f4-8545a62a7e24 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/aae055ca-2b1f-4e7d-a903-8c8e123fbb27 HTTP/1.1" status: 204 len: 168 time: 0.2098391 Sep 18 08:39:21.084947 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18afd63a-c1f1-4aaf-a3f4-8545a62a7e24 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aae055ca-2b1f-4e7d-a903-8c8e123fbb27,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:21.110130 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-59999489-bf57-44f2-99bf-01ffe19b6768 req-bb883bde-1e11-42f9-9379-5a13237b422c tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0791469 Sep 18 08:39:21.114992 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-96aa0d05-e2dd-4c6f-92ed-af79706a2326 req-14f1fa8d-80b8-4895-9320-8444f3ba42b8 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0607953 Sep 18 08:39:21.221949 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4743938e-0839-4137-8bf6-fac310c9d6f3 req-493c7d8d-b591-42cf-96cb-6b2ced2b06a3 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:21.223561 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4743938e-0839-4137-8bf6-fac310c9d6f3 req-493c7d8d-b591-42cf-96cb-6b2ced2b06a3 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 943 time: 0.0522661 Sep 18 08:39:21.270161 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4743938e-0839-4137-8bf6-fac310c9d6f3 req-977184e6-b15a-4149-bf59-20441cc0fbbe tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404379 Sep 18 08:39:21.354042 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 56420) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:21.367106 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3ac80248-c3ee-4e4f-96f7-1a1c72950a63 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:21.390363 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1168d8d-0b4d-4a2f-b366-a3888560c327 req-5c9c3888-3fc1-4fb1-9503-dda1e45b70a3 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:21.392031 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c1168d8d-0b4d-4a2f-b366-a3888560c327 req-5c9c3888-3fc1-4fb1-9503-dda1e45b70a3 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 946 time: 0.0542414 Sep 18 08:39:21.461743 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c1168d8d-0b4d-4a2f-b366-a3888560c327 req-cf986ecd-f38a-408a-8e4b-12f7643d8e7a tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0618758 Sep 18 08:39:21.501489 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3ac80248-c3ee-4e4f-96f7-1a1c72950a63 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:21.508471 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3ac80248-c3ee-4e4f-96f7-1a1c72950a63 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:21.509131 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-891edc0a-626a-4363-97d7-8877baaf8a25 req-f54a1a62-138c-4787-9773-c4dc5a2866e2 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:21.517808 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-891edc0a-626a-4363-97d7-8877baaf8a25 req-f54a1a62-138c-4787-9773-c4dc5a2866e2 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.1016748 Sep 18 08:39:21.562949 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-3ac80248-c3ee-4e4f-96f7-1a1c72950a63 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=3976d75444ad473c93c801e4b602ae9e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2078135 Sep 18 08:39:21.565462 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 56434) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:21.573722 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-891edc0a-626a-4363-97d7-8877baaf8a25 req-702ebac6-68ad-47cf-8f23-ced23c580b1f tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0506094 Sep 18 08:39:21.575227 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ac80248-c3ee-4e4f-96f7-1a1c72950a63 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b5f7879d-70ba-4f29-ade9-3d0aade2636b,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:21.584120 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebfe092a-8f89-49c8-9aa3-93c28c09a861 req-f7111d22-e565-4166-8837-111233768461 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:21.586771 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ebfe092a-8f89-49c8-9aa3-93c28c09a861 req-f7111d22-e565-4166-8837-111233768461 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=f439efa4eed0456ab2a914377e490fad&device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 1099 time: 0.1240766 Sep 18 08:39:21.622517 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-63ea04bf-623f-41bf-bdf1-e2cd6958d873 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:21.649305 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-63ea04bf-623f-41bf-bdf1-e2cd6958d873 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:21.696928 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebfe092a-8f89-49c8-9aa3-93c28c09a861 req-ea270d7f-00b2-46b6-8020-80e30ff1a425 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:21.699372 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ebfe092a-8f89-49c8-9aa3-93c28c09a861 req-ea270d7f-00b2-46b6-8020-80e30ff1a425 service neutron] 10.222.0.13 "GET /v2.0/networks?id=fdcbc66e-323e-4b44-be97-566949f4f2ef HTTP/1.1" status: 200 len: 919 time: 0.1022282 Sep 18 08:39:21.705471 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-63ea04bf-623f-41bf-bdf1-e2cd6958d873 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:21.708388 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-63ea04bf-623f-41bf-bdf1-e2cd6958d873 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:21.710217 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-63ea04bf-623f-41bf-bdf1-e2cd6958d873 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/b5f7879d-70ba-4f29-ade9-3d0aade2636b HTTP/1.1" status: 204 len: 168 time: 0.1431429 Sep 18 08:39:21.723422 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63ea04bf-623f-41bf-bdf1-e2cd6958d873 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b5f7879d-70ba-4f29-ade9-3d0aade2636b,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:21.749905 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ebfe092a-8f89-49c8-9aa3-93c28c09a861 req-282104a7-577b-4035-9b9a-6e02596758d2 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=59d1e8a2-e4aa-44e5-8014-91de86026543 HTTP/1.1" status: 200 len: 217 time: 0.0417991 Sep 18 08:39:21.813848 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebfe092a-8f89-49c8-9aa3-93c28c09a861 req-38ee1c2c-6afc-487a-b8c7-e1c3922cc1e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:21.816544 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ebfe092a-8f89-49c8-9aa3-93c28c09a861 req-38ee1c2c-6afc-487a-b8c7-e1c3922cc1e8 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=e5dc6eef-e778-41a2-a708-c7810ade97db HTTP/1.1" status: 200 len: 858 time: 0.0558288 Sep 18 08:39:21.878219 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ebfe092a-8f89-49c8-9aa3-93c28c09a861 req-9d83a728-3a74-41e8-919c-ef39ae37036f service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fdcbc66e-323e-4b44-be97-566949f4f2ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0461569 Sep 18 08:39:22.098876 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ebfe092a-8f89-49c8-9aa3-93c28c09a861 req-2ddb27e2-9a18-452a-8e91-9e41d4de8290 service neutron] 10.222.0.13 "GET /v2.0/networks/fdcbc66e-323e-4b44-be97-566949f4f2ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1925430 Sep 18 08:39:22.244875 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ebfe092a-8f89-49c8-9aa3-93c28c09a861 req-c5bc3b49-1ce8-4f75-97d7-0b4d33723d0f service neutron] 10.222.0.13 "GET /v2.0/networks/fdcbc66e-323e-4b44-be97-566949f4f2ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1428776 Sep 18 08:39:22.273939 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-871aa39a-e0e7-4568-9bf6-bc730417fda3 req-65079b98-9b23-484f-814c-e5fc609bee75 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:22.283202 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-871aa39a-e0e7-4568-9bf6-bc730417fda3 req-65079b98-9b23-484f-814c-e5fc609bee75 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0701644 Sep 18 08:39:22.327147 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-871aa39a-e0e7-4568-9bf6-bc730417fda3 req-4b94a37b-23e9-4eda-aaed-9d1d7685e3f1 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430889 Sep 18 08:39:22.330681 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4248ac92-ce7b-4560-9f83-de05a7069a99', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:39:22.343093 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d83398d4-bc03-4720-b97c-f8dbe7ee3ac9" -d '{"events": [{"server_uuid": "4248ac92-ce7b-4560-9f83-de05a7069a99", "name": "network-vif-plugged", "status": "completed", "tag": "2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:39:22.400189 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-525eb407-d3f7-4906-8c91-2a259a4704e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:22.543388 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4da3a0b-d381-484c-96b0-5db7468a0300 req-fc824bd0-3e5f-4004-ade2-678da1565748 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:22.552939 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c4da3a0b-d381-484c-96b0-5db7468a0300 req-fc824bd0-3e5f-4004-ade2-678da1565748 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 943 time: 0.1074603 Sep 18 08:39:22.591109 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c4da3a0b-d381-484c-96b0-5db7468a0300 req-39406e04-30f8-4dea-9d7f-6785d1ca3e0d tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0361784 Sep 18 08:39:22.669167 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:39:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0bee3ac1-4b2c-433e-ae60-dca776758637 x-openstack-request-id: req-0bee3ac1-4b2c-433e-ae60-dca776758637 {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:39:22.669483 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4248ac92-ce7b-4560-9f83-de05a7069a99", "name": "network-vif-plugged", "status": "completed", "tag": "2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:39:22.671067 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-0bee3ac1-4b2c-433e-ae60-dca776758637 {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:39:22.671480 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4248ac92-ce7b-4560-9f83-de05a7069a99', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1', 'code': 200} Sep 18 08:39:22.786099 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa5adb39-a857-4a28-8320-a64da4d05178 req-059f84f3-b553-476c-8604-27262b570796 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:22.788127 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fa5adb39-a857-4a28-8320-a64da4d05178 req-059f84f3-b553-476c-8604-27262b570796 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.0521297 Sep 18 08:39:22.831520 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fa5adb39-a857-4a28-8320-a64da4d05178 req-9da66fb8-b849-4c03-b01c-7a307999d71d tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0325043 Sep 18 08:39:23.177654 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:23.203813 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2248a92-31ba-44f2-96d7-499e63755086 req-899fc555-21c8-4816-a988-f9d90b141acf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:23.205440 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e2248a92-31ba-44f2-96d7-499e63755086 req-899fc555-21c8-4816-a988-f9d90b141acf service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 1099 time: 0.0432634 Sep 18 08:39:23.260857 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e2248a92-31ba-44f2-96d7-499e63755086 req-18a85d5b-e065-42e8-8d29-c92211ce53a1 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0469668 Sep 18 08:39:23.323851 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:23.472002 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68b237ac-bb8d-4a41-83d2-500ee11f5603 req-8a6d47c6-7abe-4168-a1ee-ca0a7ae31c6f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:23.473448 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-68b237ac-bb8d-4a41-83d2-500ee11f5603 req-8a6d47c6-7abe-4168-a1ee-ca0a7ae31c6f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0514948 Sep 18 08:39:23.517748 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-68b237ac-bb8d-4a41-83d2-500ee11f5603 req-e2d47059-7969-40f4-9e7c-f42b2ca067e6 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0377870 Sep 18 08:39:23.724362 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c873bee-b09a-46db-935d-a6e556d51434 req-ec4c0e3d-241d-4e7a-b640-8a7e4859aefe tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:23.726455 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3c873bee-b09a-46db-935d-a6e556d51434 req-ec4c0e3d-241d-4e7a-b640-8a7e4859aefe tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 943 time: 0.0489573 Sep 18 08:39:23.750985 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 56558) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:23.767903 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3c873bee-b09a-46db-935d-a6e556d51434 req-d416d766-e3d5-4b8c-81c8-9e5cdcadddaf tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0354927 Sep 18 08:39:23.866769 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dc18d957-59a0-4cbf-9d2f-3c001b663378 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:23.951311 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd8cd9d2-0bc1-4493-b6e9-3c7c8b2bc1c0 req-31a8522b-812d-4f69-9ddc-e6ac25aed4a1 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:23.952931 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bd8cd9d2-0bc1-4493-b6e9-3c7c8b2bc1c0 req-31a8522b-812d-4f69-9ddc-e6ac25aed4a1 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.0513165 Sep 18 08:39:23.956249 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dc18d957-59a0-4cbf-9d2f-3c001b663378 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:23.960238 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dc18d957-59a0-4cbf-9d2f-3c001b663378 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:23.992355 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bd8cd9d2-0bc1-4493-b6e9-3c7c8b2bc1c0 req-d0f98072-0254-473d-8053-b65a04f07a91 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0332334 Sep 18 08:39:23.999592 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-dc18d957-59a0-4cbf-9d2f-3c001b663378 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=8d762644b74b4844a4287bb64ac40a70&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2444236 Sep 18 08:39:23.999592 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc18d957-59a0-4cbf-9d2f-3c001b663378 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=035bf010-6c03-4335-a2f4-69cc0d5f1e43,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:24.000402 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 56566) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:24.049628 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-42731eac-6409-43df-a1b8-f1f5d243be03 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:24.069487 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 63cfc18e-94f6-437f-86ac-093dde6268e8 details requested by agent hyperv_hv-cinder-80447 with host hv-cinder-80447 {{(pid=94348) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 18 08:39:24.071985 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-42731eac-6409-43df-a1b8-f1f5d243be03 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:24.117554 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-42731eac-6409-43df-a1b8-f1f5d243be03 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:24.120153 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-42731eac-6409-43df-a1b8-f1f5d243be03 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:24.121354 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-42731eac-6409-43df-a1b8-f1f5d243be03 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/035bf010-6c03-4335-a2f4-69cc0d5f1e43 HTTP/1.1" status: 204 len: 168 time: 0.1200075 Sep 18 08:39:24.128974 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42731eac-6409-43df-a1b8-f1f5d243be03 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=035bf010-6c03-4335-a2f4-69cc0d5f1e43,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:24.172212 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 63cfc18e-94f6-437f-86ac-093dde6268e8, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=63cfc18e-94f6-437f-86ac-093dde6268e8,segment=NetworkSegment(4f8dffb0-f8d4-41b5-beed-53bcf370cb42),segment_id=4f8dffb0-f8d4-41b5-beed-53bcf370cb42)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:39:24.183666 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Returning: {'device': '63cfc18e-94f6-437f-86ac-093dde6268e8', 'network_id': '5e2d06a6-7f04-4134-8004-d5639986c75e', 'port_id': '63cfc18e-94f6-437f-86ac-093dde6268e8', 'mac_address': 'fa:16:3e:93:a1:9c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 213, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '10680649-3557-49d0-9377-0d9cdb4efe69', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94348) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 18 08:39:24.232450 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:24.245891 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 63cfc18e-94f6-437f-86ac-093dde6268e8 {{(pid=94348) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:39:24.271391 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 63cfc18e-94f6-437f-86ac-093dde6268e8, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=63cfc18e-94f6-437f-86ac-093dde6268e8,segment=NetworkSegment(4f8dffb0-f8d4-41b5-beed-53bcf370cb42),segment_id=4f8dffb0-f8d4-41b5-beed-53bcf370cb42)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:39:24.276581 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:24.331318 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=63cfc18e-94f6-437f-86ac-093dde6268e8,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:24.415657 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 56580) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:24.428352 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-487c54f9-a6d4-45dd-a8a7-058afcf9ca6a admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:24.515932 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-487c54f9-a6d4-45dd-a8a7-058afcf9ca6a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:24.519230 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-487c54f9-a6d4-45dd-a8a7-058afcf9ca6a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:24.554903 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-487c54f9-a6d4-45dd-a8a7-058afcf9ca6a admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=acadfebec4294f82b17f05840d749af7&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1381943 Sep 18 08:39:24.556784 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-487c54f9-a6d4-45dd-a8a7-058afcf9ca6a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=134c79f5-a474-458b-9917-a4586e72b1cd,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:24.557601 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 56584) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:24.606113 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-79d5605b-dc00-4905-92d2-36892cbf2267 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:24.626872 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-79d5605b-dc00-4905-92d2-36892cbf2267 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:24.637190 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716235c4-595d-4b56-96dc-13c04fba9f9f req-d3efb2bb-9af6-4290-933b-a2f5b3b96038 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:24.638699 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-716235c4-595d-4b56-96dc-13c04fba9f9f req-d3efb2bb-9af6-4290-933b-a2f5b3b96038 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0478997 Sep 18 08:39:24.671884 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-79d5605b-dc00-4905-92d2-36892cbf2267 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:24.674527 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-79d5605b-dc00-4905-92d2-36892cbf2267 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:24.675878 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-79d5605b-dc00-4905-92d2-36892cbf2267 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/134c79f5-a474-458b-9917-a4586e72b1cd HTTP/1.1" status: 204 len: 168 time: 0.1169655 Sep 18 08:39:24.676759 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-716235c4-595d-4b56-96dc-13c04fba9f9f req-cd9ddcfc-b72c-4e27-a02c-c01a3bb82603 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0316007 Sep 18 08:39:24.686186 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79d5605b-dc00-4905-92d2-36892cbf2267 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=134c79f5-a474-458b-9917-a4586e72b1cd,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:24.872935 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:24.895027 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6364fcb3-f9fa-4820-a2ce-7c1b8ca37251 req-6c4e9865-6491-4b72-bb03-649d9235b429 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:24.896582 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6364fcb3-f9fa-4820-a2ce-7c1b8ca37251 req-6c4e9865-6491-4b72-bb03-649d9235b429 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 944 time: 0.0579045 Sep 18 08:39:24.942751 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6364fcb3-f9fa-4820-a2ce-7c1b8ca37251 req-61226827-2927-427c-b7db-7112a78bb1b9 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0393727 Sep 18 08:39:25.117006 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50e1fc1a-1969-4d38-ab94-cd7fb9498167 req-70e0aa28-8c22-4625-9aaf-a4c3112603d7 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:25.118532 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-50e1fc1a-1969-4d38-ab94-cd7fb9498167 req-70e0aa28-8c22-4625-9aaf-a4c3112603d7 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.0528460 Sep 18 08:39:25.147547 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 56610) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:25.159778 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-50e1fc1a-1969-4d38-ab94-cd7fb9498167 req-4b953c3c-213d-44da-ba17-1c2beb30a8fc tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0352709 Sep 18 08:39:25.259571 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-4a93db00-5c58-4eaf-9402-5d1b295625cb admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:25.347170 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-4a93db00-5c58-4eaf-9402-5d1b295625cb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:25.351745 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-4a93db00-5c58-4eaf-9402-5d1b295625cb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:25.387503 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-4a93db00-5c58-4eaf-9402-5d1b295625cb admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=6415deb5555641aca7d089d65dec2a18&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2383311 Sep 18 08:39:25.390322 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 56622) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:25.392658 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a93db00-5c58-4eaf-9402-5d1b295625cb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cf5f5cc5-0e25-43c3-a882-731625252708,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:25.441853 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7719dd41-25b1-4054-9868-acd085925aca admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:25.462684 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7719dd41-25b1-4054-9868-acd085925aca admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:25.511182 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7719dd41-25b1-4054-9868-acd085925aca admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:25.513850 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7719dd41-25b1-4054-9868-acd085925aca admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:25.515077 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-7719dd41-25b1-4054-9868-acd085925aca admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/cf5f5cc5-0e25-43c3-a882-731625252708 HTTP/1.1" status: 204 len: 168 time: 0.1234527 Sep 18 08:39:25.523674 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7719dd41-25b1-4054-9868-acd085925aca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cf5f5cc5-0e25-43c3-a882-731625252708,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:25.815570 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28c3d85e-574c-40a5-a1db-d09dde2f62a8 req-d0b07956-47a3-411c-9113-17d385714039 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:25.817108 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-28c3d85e-574c-40a5-a1db-d09dde2f62a8 req-d0b07956-47a3-411c-9113-17d385714039 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0490699 Sep 18 08:39:25.859506 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-28c3d85e-574c-40a5-a1db-d09dde2f62a8 req-4adedfe3-329f-4d76-8c47-855f7c53eec8 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0356133 Sep 18 08:39:26.066132 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4aa4ce1-78c4-49a5-b8dd-909fedf4514a req-4687ec38-cdf7-491f-aa21-afe57e9b7cc9 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:26.067721 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d4aa4ce1-78c4-49a5-b8dd-909fedf4514a req-4687ec38-cdf7-491f-aa21-afe57e9b7cc9 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 944 time: 0.0553284 Sep 18 08:39:26.114869 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d4aa4ce1-78c4-49a5-b8dd-909fedf4514a req-29ef43c7-7fd9-4555-b684-cd3ceddb6346 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411291 Sep 18 08:39:26.276017 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f0ed64e-8df7-47a1-b818-754d915367e7 req-726c1f8e-31cf-4810-8a39-f64d6b819325 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:26.277675 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4f0ed64e-8df7-47a1-b818-754d915367e7 req-726c1f8e-31cf-4810-8a39-f64d6b819325 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.0476139 Sep 18 08:39:26.320356 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4f0ed64e-8df7-47a1-b818-754d915367e7 req-4c5514a1-e780-493c-8d0a-6f848d7e1d19 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0365338 Sep 18 08:39:26.981049 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29682878-caca-41e5-a527-40f482b0f303 req-3811e114-690a-4449-9058-2e2c96568188 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:26.982564 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-29682878-caca-41e5-a527-40f482b0f303 req-3811e114-690a-4449-9058-2e2c96568188 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0528395 Sep 18 08:39:27.030182 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-29682878-caca-41e5-a527-40f482b0f303 req-6145345d-15b8-449f-b33f-3018e0f199b2 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413742 Sep 18 08:39:27.228559 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1406edad-acbe-4e36-a105-f4078d97a489 req-635fc683-01ab-43b2-a0b5-36913d00c521 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:27.230100 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1406edad-acbe-4e36-a105-f4078d97a489 req-635fc683-01ab-43b2-a0b5-36913d00c521 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 944 time: 0.0482249 Sep 18 08:39:27.269045 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1406edad-acbe-4e36-a105-f4078d97a489 req-62aac41a-a3a8-4739-b30d-c827d9d68820 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319171 Sep 18 08:39:27.433879 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5088cf25-10ac-4718-9e69-cc46eed20653 req-48d0615d-19b8-4011-bff6-1633ecaf693e tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:27.435356 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5088cf25-10ac-4718-9e69-cc46eed20653 req-48d0615d-19b8-4011-bff6-1633ecaf693e tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.0480413 Sep 18 08:39:27.472422 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5088cf25-10ac-4718-9e69-cc46eed20653 req-f1a7702c-ae31-44e6-afdb-50c086329ead tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0311153 Sep 18 08:39:28.154029 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4032dda9-fab4-43be-b7ee-4c4539f27acc req-b2ff7ad3-d62d-4637-a384-cc69cdfe7b2e tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:28.155386 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4032dda9-fab4-43be-b7ee-4c4539f27acc req-b2ff7ad3-d62d-4637-a384-cc69cdfe7b2e tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0460856 Sep 18 08:39:28.195122 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4032dda9-fab4-43be-b7ee-4c4539f27acc req-ed9bf43e-8bec-4dfe-bebf-c5ce44603f76 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0340466 Sep 18 08:39:28.603401 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-818786dc-9ebd-4090-a95e-b1f9ece2a52f req-e2d9bbb5-8685-42a0-b665-2549cd172e68 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:28.604860 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-818786dc-9ebd-4090-a95e-b1f9ece2a52f req-e2d9bbb5-8685-42a0-b665-2549cd172e68 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 944 time: 0.2696617 Sep 18 08:39:28.617966 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-487a31c1-778b-4b98-ad0c-c4893c0e3877 req-ec34c866-a970-4abb-b476-3225055bbafb tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:28.619391 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-487a31c1-778b-4b98-ad0c-c4893c0e3877 req-ec34c866-a970-4abb-b476-3225055bbafb tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.0651441 Sep 18 08:39:28.675340 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-818786dc-9ebd-4090-a95e-b1f9ece2a52f req-5ca33a58-8e2a-4931-8668-fd7488c71d27 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0549846 Sep 18 08:39:28.680308 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-487a31c1-778b-4b98-ad0c-c4893c0e3877 req-c2219a13-b29d-46db-8519-c327814b38de tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0544078 Sep 18 08:39:29.186421 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['63cfc18e-94f6-437f-86ac-093dde6268e8'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:39:29.312427 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6be371c5-b745-4b76-8554-5f89df447901 req-a85cb7fc-390f-4f9d-aef7-682bcc556baa tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:29.313936 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6be371c5-b745-4b76-8554-5f89df447901 req-a85cb7fc-390f-4f9d-aef7-682bcc556baa tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0465810 Sep 18 08:39:29.350920 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6be371c5-b745-4b76-8554-5f89df447901 req-aae5e458-2c22-476c-9a0a-4faf694e76cd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0304983 Sep 18 08:39:29.829022 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8082fdfc-fb59-46f5-b780-9d5c35ed168e req-46aecaf7-9b5a-4bee-a63e-88d6460230e1 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:29.831532 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8082fdfc-fb59-46f5-b780-9d5c35ed168e req-46aecaf7-9b5a-4bee-a63e-88d6460230e1 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.0858045 Sep 18 08:39:29.850071 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13e1e49f-b2ae-4345-ad0c-536bb9df9838 req-223a8991-778c-4f81-9545-ab75eb3f80c8 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:29.851666 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-13e1e49f-b2ae-4345-ad0c-536bb9df9838 req-223a8991-778c-4f81-9545-ab75eb3f80c8 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 944 time: 0.1041846 Sep 18 08:39:29.915089 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8082fdfc-fb59-46f5-b780-9d5c35ed168e req-106bf79f-91f0-4843-b307-bf6e3393abcb tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0739064 Sep 18 08:39:29.927145 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-13e1e49f-b2ae-4345-ad0c-536bb9df9838 req-131ecec1-96e2-444c-b5e0-3fc80e073a57 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0688729 Sep 18 08:39:30.155448 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-8e35d333-987c-41de-93da-cdc693646560 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/networks?tenant_id=adfddd23e1874cb7bd027bf41e4d64c4&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0278187 Sep 18 08:39:30.336811 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-d3d49997-108f-4a7b-932e-6ad4bf6fe8d1 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:30.338362 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-d3d49997-108f-4a7b-932e-6ad4bf6fe8d1 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1771276 Sep 18 08:39:30.353363 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-90a024ea-4832-4739-a1e6-7861ef673fa4 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/quotas/adfddd23e1874cb7bd027bf41e4d64c4 HTTP/1.1" status: 200 len: 375 time: 0.0090292 Sep 18 08:39:30.382630 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-9fbfa6d3-6d52-4183-8c58-338728895584 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/ports?tenant_id=adfddd23e1874cb7bd027bf41e4d64c4&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0242779 Sep 18 08:39:30.472055 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09267056-d2d0-4eec-b638-1edd5f16fca3 req-fea72356-b3f7-4545-be99-dd1aa28dc573 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:30.473576 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-09267056-d2d0-4eec-b638-1edd5f16fca3 req-fea72356-b3f7-4545-be99-dd1aa28dc573 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0533791 Sep 18 08:39:30.535566 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-09267056-d2d0-4eec-b638-1edd5f16fca3 req-c97edee0-41c2-4f56-b2ed-e64bb94f8650 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0551291 Sep 18 08:39:30.551277 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-29828de4-b962-49ec-b332-9ea660f35f72 req-b4491cc3-6ee6-40dc-b729-d5afe17d63c4 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/ports?device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 210 time: 0.0301738 Sep 18 08:39:30.654461 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88d9776d-fa97-434e-820a-b8129e1c1466 req-7f1ec79d-8058-40c6-9bd5-9493dc71e4b0 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:30.655989 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-88d9776d-fa97-434e-820a-b8129e1c1466 req-7f1ec79d-8058-40c6-9bd5-9493dc71e4b0 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0491202 Sep 18 08:39:30.665550 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 56812) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:30.670042 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-c3b6213b-d147-4830-933d-6fea50e0f5d3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Request body: {'floatingip': {'port_id': '2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:39:30.741828 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c3b6213b-d147-4830-933d-6fea50e0f5d3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for floatingip, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:31.195741 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20d998c3-23b2-49d0-ae38-68d809c7b9d2 req-fe37197d-2737-4792-9af8-70beef1a3192 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:31.197303 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-20d998c3-23b2-49d0-ae38-68d809c7b9d2 req-fe37197d-2737-4792-9af8-70beef1a3192 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 944 time: 0.1966791 Sep 18 08:39:31.231586 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24274770-4761-4133-9bb5-29ef11d30c60 req-28ac090b-d434-4995-881c-6c71de5dd708 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:31.233388 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-24274770-4761-4133-9bb5-29ef11d30c60 req-28ac090b-d434-4995-881c-6c71de5dd708 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.1983697 Sep 18 08:39:31.388290 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-20d998c3-23b2-49d0-ae38-68d809c7b9d2 req-19b6b491-5368-4da8-a542-ec345eeefd96 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1827822 Sep 18 08:39:31.401413 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-24274770-4761-4133-9bb5-29ef11d30c60 req-ccee35ee-d37f-44fc-82e8-a45daba3f7d1 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1575947 Sep 18 08:39:31.792091 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c3b6213b-d147-4830-933d-6fea50e0f5d3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for floatingip, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:31.794192 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ee7e114e-0945-42a5-8e41-f517bc3732ab req-5e7edc27-c636-42c0-9c26-3114fda06767 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/ports?device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 210 time: 0.0545106 Sep 18 08:39:31.795727 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-612ccad5-3124-4a2d-9c91-e8e1ce661bc9 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.13 "GET /v2.0/networks?tenant_id=adfddd23e1874cb7bd027bf41e4d64c4&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0571678 Sep 18 08:39:31.798055 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c3b6213b-d147-4830-933d-6fea50e0f5d3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-784908'] for floatingip, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:31.967754 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.db.l3_db [None req-c3b6213b-d147-4830-933d-6fea50e0f5d3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Floating IP d21371af-2110-4dca-8eb3-a92d09971467 associated. External IP: 172.27.1.138, port: 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1. Sep 18 08:39:32.014756 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-58720bab-5da9-4f32-b18b-0443b5806600 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:32.016182 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-58720bab-5da9-4f32-b18b-0443b5806600 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.1824024 Sep 18 08:39:32.065137 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-b1dd61e1-8e96-48f9-b81f-3be65e73c7fd tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Request body: {'port': {'device_id': '09faa6cc-6619-4eac-8e44-8d07532200d0', 'network_id': '06bf55c3-5a69-4608-ba2d-4599eb57bfe8', 'admin_state_up': True, 'tenant_id': 'adfddd23e1874cb7bd027bf41e4d64c4'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:39:32.226607 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 63cfc18e-94f6-437f-86ac-093dde6268e8 up at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:39:32.268093 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-b1dd61e1-8e96-48f9-b81f-3be65e73c7fd tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Made reservation on behalf of adfddd23e1874cb7bd027bf41e4d64c4 for: {'port': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:39:32.271707 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-b1dd61e1-8e96-48f9-b81f-3be65e73c7fd tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:32.286253 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c3b6213b-d147-4830-933d-6fea50e0f5d3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Router 73ec8685-1119-4d34-a85d-af65c74d9e25 has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94347) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:39:32.287250 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning for port 63cfc18e-94f6-437f-86ac-093dde6268e8 completed by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 18 08:39:32.289538 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-b1dd61e1-8e96-48f9-b81f-3be65e73c7fd tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:32.292634 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning complete for port 63cfc18e-94f6-437f-86ac-093dde6268e8 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:39:32.294030 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:32.396567 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:32.415994 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-b1dd61e1-8e96-48f9-b81f-3be65e73c7fd tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:32.422605 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-b1dd61e1-8e96-48f9-b81f-3be65e73c7fd tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:32.424877 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8e21db7d-ad7c-4e54-ae13-5a36ab9e244e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '63cfc18e-94f6-437f-86ac-093dde6268e8'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:39:32.427200 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-687a3fea-cadb-46dc-8a50-b198993afa09" -d '{"events": [{"server_uuid": "8e21db7d-ad7c-4e54-ae13-5a36ab9e244e", "name": "network-vif-plugged", "status": "completed", "tag": "63cfc18e-94f6-437f-86ac-093dde6268e8"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:39:32.442430 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 63cfc18e-94f6-437f-86ac-093dde6268e8, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=63cfc18e-94f6-437f-86ac-093dde6268e8,segment=NetworkSegment(4f8dffb0-f8d4-41b5-beed-53bcf370cb42),segment_id=4f8dffb0-f8d4-41b5-beed-53bcf370cb42)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:39:32.447347 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:32.504077 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=63cfc18e-94f6-437f-86ac-093dde6268e8,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:32.526124 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1dd61e1-8e96-48f9-b81f-3be65e73c7fd tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Pushing event updated for resources: {'SecurityGroup': ['ID=32504d5c-b702-4d1a-8d76-e0cd4da86123,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:32.622279 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c3b6213b-d147-4830-933d-6fea50e0f5d3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94347) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:39:32.638779 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f41fed4c-0479-44f6-b357-6220d0050842 None None] Sync routers for ids ['73ec8685-1119-4d34-a85d-af65c74d9e25'] in dv-cinder-804470-6-iscsi {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:39:32.648643 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c3b6213b-d147-4830-933d-6fea50e0f5d3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for floatingip, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:32.650672 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f41fed4c-0479-44f6-b357-6220d0050842 None None] Routers {'73ec8685-1119-4d34-a85d-af65c74d9e25'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:39:32.651472 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-f41fed4c-0479-44f6-b357-6220d0050842 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:39:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['73ec8685-1119-4d34-a85d-af65c74d9e25'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:39:32.697064 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96302451-3f5f-4026-a4f4-0d463db9cc16 req-5b472906-47e7-45bf-b3a3-ff4dad046e98 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:32.698904 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-96302451-3f5f-4026-a4f4-0d463db9cc16 req-5b472906-47e7-45bf-b3a3-ff4dad046e98 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.2018883 Sep 18 08:39:32.711515 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12820d83-7018-48a9-9540-68160223eb60 req-f4a39488-8d85-4ff7-8efd-e660464a36f6 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:32.718065 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-12820d83-7018-48a9-9540-68160223eb60 req-f4a39488-8d85-4ff7-8efd-e660464a36f6 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 945 time: 0.1932025 Sep 18 08:39:32.752185 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-c3b6213b-d147-4830-933d-6fea50e0f5d3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "PUT /v2.0/floatingips/d21371af-2110-4dca-8eb3-a92d09971467 HTTP/1.1" status: 200 len: 992 time: 2.0855646 Sep 18 08:39:32.753522 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_common [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-b1dd61e1-8e96-48f9-b81f-3be65e73c7fd tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Allocated IP 192.168.233.213 (06bf55c3-5a69-4608-ba2d-4599eb57bfe8/07aca37f-8673-4f2c-a2b8-6de53e548d8a/27a509fa-10dc-4ef1-bb19-0a80691837ef) {{(pid=94347) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:39:32.762422 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4248ac92-ce7b-4560-9f83-de05a7069a99', 'tag': '2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:39:32.764667 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8676bf46-10ba-482f-943d-ca5fb2582b7f" -d '{"events": [{"name": "network-changed", "server_uuid": "4248ac92-ce7b-4560-9f83-de05a7069a99", "tag": "2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:39:32.772959 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-f41fed4c-0479-44f6-b357-6220d0050842 None None] Set router 73ec8685-1119-4d34-a85d-af65c74d9e25 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:39:32.824603 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-12820d83-7018-48a9-9540-68160223eb60 req-e507c6e2-aeaa-461b-b873-f376afcac53c tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1004148 Sep 18 08:39:32.826073 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-96302451-3f5f-4026-a4f4-0d463db9cc16 req-41867dae-ee1c-4f63-ae80-9aa9efebd8b6 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1030495 Sep 18 08:39:32.895982 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:39:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cc61a542-dbc0-4a8c-bff0-4b11ed9dccfb x-openstack-request-id: req-cc61a542-dbc0-4a8c-bff0-4b11ed9dccfb {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:39:32.896298 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8e21db7d-ad7c-4e54-ae13-5a36ab9e244e", "name": "network-vif-plugged", "status": "completed", "tag": "63cfc18e-94f6-437f-86ac-093dde6268e8", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:39:32.896716 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-cc61a542-dbc0-4a8c-bff0-4b11ed9dccfb {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:39:32.897317 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8e21db7d-ad7c-4e54-ae13-5a36ab9e244e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '63cfc18e-94f6-437f-86ac-093dde6268e8', 'code': 200} Sep 18 08:39:32.927878 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:39:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-99c1b618-3173-4047-8355-14dd47990bdc x-openstack-request-id: req-99c1b618-3173-4047-8355-14dd47990bdc {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:39:32.928313 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4248ac92-ce7b-4560-9f83-de05a7069a99", "tag": "2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:39:32.929094 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-99c1b618-3173-4047-8355-14dd47990bdc {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:39:32.929527 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4248ac92-ce7b-4560-9f83-de05a7069a99', 'tag': '2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1', 'status': 'completed', 'code': 200} Sep 18 08:39:33.039483 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c6b6c402-890c-4723-8bb5-36f5a73d5efd req-f299a468-26c8-489d-8018-85364649275b tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/ports?device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 210 time: 0.0503142 Sep 18 08:39:33.049253 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-b1dd61e1-8e96-48f9-b81f-3be65e73c7fd tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Notify callbacks [] for port, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:33.117643 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8676bf46-10ba-482f-943d-ca5fb2582b7f req-fea9364f-90aa-4449-916b-b818045ab69f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:33.119163 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8676bf46-10ba-482f-943d-ca5fb2582b7f req-fea9364f-90aa-4449-916b-b818045ab69f service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0700a96e9b3f48e8b6bcdd75b820b813&device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 1099 time: 0.0590675 Sep 18 08:39:33.121817 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-b1dd61e1-8e96-48f9-b81f-3be65e73c7fd tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:33.208599 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-b1dd61e1-8e96-48f9-b81f-3be65e73c7fd tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Network 06bf55c3-5a69-4608-ba2d-4599eb57bfe8 is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:39:33.243814 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-b1dd61e1-8e96-48f9-b81f-3be65e73c7fd tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:39:33.246511 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-b1dd61e1-8e96-48f9-b81f-3be65e73c7fd tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Received port after_create {{(pid=94347) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:39:33.259197 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1dd61e1-8e96-48f9-b81f-3be65e73c7fd tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Pushing event updated for resources: {'Port': ['ID=27a509fa-10dc-4ef1-bb19-0a80691837ef,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:33.260792 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 56910) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:33.265410 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-f41fed4c-0479-44f6-b357-6220d0050842 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'name': 'tempest-AttachVolumeShelveTestJSON-230900396-router', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12'}], 'enable_snat': True}, 'gw_port_id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:04Z', 'updated_at': '2021-09-18T08:38:12Z', 'revision_number': 4, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'gw_port': {'id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:ed:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:05Z', 'updated_at': '2021-09-18T08:38:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': 'd21371af-2110-4dca-8eb3-a92d09971467', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'floating_ip_address': '172.27.1.138', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'port_id': '2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 111, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'mac_address': 'fa:16:3e:de:30:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4248ac92-ce7b-4560-9f83-de05a7069a99', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:38:19Z', 'updated_at': '2021-09-18T08:39:31Z', 'revision_number': 1, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '09652b84-a3b3-476f-815f-f0c78f8543ba', 'name': '', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'mac_address': 'fa:16:3e:20:cb:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:10Z', 'updated_at': '2021-09-18T08:38:18Z', 'revision_number': 5, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'subnets': [{'id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:39:33.302668 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f41fed4c-0479-44f6-b357-6220d0050842 None None] Checking router: 73ec8685-1119-4d34-a85d-af65c74d9e25 for host: dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:39:33.314891 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f41fed4c-0479-44f6-b357-6220d0050842 None None] Routers {'73ec8685-1119-4d34-a85d-af65c74d9e25'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:39:33.315606 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-f41fed4c-0479-44f6-b357-6220d0050842 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:39:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['73ec8685-1119-4d34-a85d-af65c74d9e25'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:39:33.351707 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-b1dd61e1-8e96-48f9-b81f-3be65e73c7fd tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:33.352281 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-b1dd61e1-8e96-48f9-b81f-3be65e73c7fd tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:33.365162 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8676bf46-10ba-482f-943d-ca5fb2582b7f req-301d17d8-756b-4138-80ed-268b91c14d0f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:33.367295 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8676bf46-10ba-482f-943d-ca5fb2582b7f req-301d17d8-756b-4138-80ed-268b91c14d0f service neutron] 10.222.0.13 "GET /v2.0/networks?id=f430397d-03a8-4da2-bd1d-25890a3a0727 HTTP/1.1" status: 200 len: 917 time: 0.2157791 Sep 18 08:39:33.371804 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32134aa4-dafd-4c78-a589-081196588b5f req-0fe074da-d086-4445-a517-59f50e3d3750 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:33.373558 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-32134aa4-dafd-4c78-a589-081196588b5f req-0fe074da-d086-4445-a517-59f50e3d3750 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 1098 time: 0.1354241 Sep 18 08:39:33.376193 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-b1dd61e1-8e96-48f9-b81f-3be65e73c7fd tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.3143790 Sep 18 08:39:33.414969 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c04ff1e3-421c-45a0-b981-6599ca98b6c8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:33.457494 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-f41fed4c-0479-44f6-b357-6220d0050842 None None] Set router 73ec8685-1119-4d34-a85d-af65c74d9e25 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:39:33.497761 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-79787914-7f5f-4a80-868b-2ee8a1e33a23 service neutron] Request body: {'port': {'device_id': '09faa6cc-6619-4eac-8e44-8d07532200d0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80447'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:39:33.601647 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c04ff1e3-421c-45a0-b981-6599ca98b6c8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:33.608713 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-b2566a1e-f574-4f4b-829c-aa82841f2594 None None] Provisioning complete for port 27a509fa-10dc-4ef1-bb19-0a80691837ef triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:39:33.609267 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8676bf46-10ba-482f-943d-ca5fb2582b7f req-1992cf7d-d00f-4373-90cd-bfc551e69ff4 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 HTTP/1.1" status: 200 len: 1000 time: 0.2167480 Sep 18 08:39:33.610227 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-b2566a1e-f574-4f4b-829c-aa82841f2594 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:33.610681 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c04ff1e3-421c-45a0-b981-6599ca98b6c8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:33.613121 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-32134aa4-dafd-4c78-a589-081196588b5f req-d3748fbb-3cec-4e23-8c27-fce8bca5e7d6 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1251767 Sep 18 08:39:33.620630 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-79787914-7f5f-4a80-868b-2ee8a1e33a23 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:33.654886 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-b2566a1e-f574-4f4b-829c-aa82841f2594 None None] Port 27a509fa-10dc-4ef1-bb19-0a80691837ef cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:39:33.676957 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c04ff1e3-421c-45a0-b981-6599ca98b6c8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=26f296f9-adb6-4d8c-b35d-86fa0c6cef07,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:33.684589 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-c04ff1e3-421c-45a0-b981-6599ca98b6c8 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=e2d34a504462404989053763c72966f6&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4226816 Sep 18 08:39:33.686932 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 56926) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:33.757338 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-f41fed4c-0479-44f6-b357-6220d0050842 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'name': 'tempest-AttachVolumeShelveTestJSON-230900396-router', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12'}], 'enable_snat': True}, 'gw_port_id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:04Z', 'updated_at': '2021-09-18T08:38:12Z', 'revision_number': 4, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'gw_port': {'id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:ed:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:05Z', 'updated_at': '2021-09-18T08:38:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': 'd21371af-2110-4dca-8eb3-a92d09971467', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'floating_ip_address': '172.27.1.138', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'port_id': '2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 111, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'mac_address': 'fa:16:3e:de:30:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4248ac92-ce7b-4560-9f83-de05a7069a99', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:38:19Z', 'updated_at': '2021-09-18T08:39:31Z', 'revision_number': 1, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '09652b84-a3b3-476f-815f-f0c78f8543ba', 'name': '', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'mac_address': 'fa:16:3e:20:cb:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:10Z', 'updated_at': '2021-09-18T08:38:18Z', 'revision_number': 5, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'subnets': [{'id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:39:33.790850 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f41fed4c-0479-44f6-b357-6220d0050842 None None] The sync data for ids ['73ec8685-1119-4d34-a85d-af65c74d9e25'] in dv-cinder-804470-6-iscsi is: [{'id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'name': 'tempest-AttachVolumeShelveTestJSON-230900396-router', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12'}], 'enable_snat': True}, 'gw_port_id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:04Z', 'updated_at': '2021-09-18T08:38:12Z', 'revision_number': 4, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'gw_port': {'id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:ed:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:05Z', 'updated_at': '2021-09-18T08:38:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': 'd21371af-2110-4dca-8eb3-a92d09971467', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'floating_ip_address': '172.27.1.138', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'port_id': '2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 111, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'mac_address': 'fa:16:3e:de:30:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4248ac92-ce7b-4560-9f83-de05a7069a99', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:38:19Z', 'updated_at': '2021-09-18T08:39:31Z', 'revision_number': 1, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '09652b84-a3b3-476f-815f-f0c78f8543ba', 'name': '', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'mac_address': 'fa:16:3e:20:cb:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:10Z', 'updated_at': '2021-09-18T08:38:18Z', 'revision_number': 5, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'subnets': [{'id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:39:33.860588 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d231cd90-5f25-4f50-8a2d-b039ee8e6b77 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:33.895058 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d231cd90-5f25-4f50-8a2d-b039ee8e6b77 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:34.072740 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f76c450-f74d-4e85-8084-290c76bc9e19 req-cc368d8c-c729-433d-aa84-ea4b50062041 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:34.074323 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4f76c450-f74d-4e85-8084-290c76bc9e19 req-cc368d8c-c729-433d-aa84-ea4b50062041 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 945 time: 0.1682661 Sep 18 08:39:34.092204 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb8ff688-2aab-4e94-8029-ad5732e3e331 req-671607da-a02c-47b8-a89b-a3f5fe44f9c6 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:34.092204 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fb8ff688-2aab-4e94-8029-ad5732e3e331 req-671607da-a02c-47b8-a89b-a3f5fe44f9c6 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.1619647 Sep 18 08:39:34.108507 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-543bc503-9c17-4797-8801-5c9672fee084 None None] New status for floating IP d21371af-2110-4dca-8eb3-a92d09971467: ACTIVE {{(pid=94348) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 18 08:39:34.111410 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d231cd90-5f25-4f50-8a2d-b039ee8e6b77 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:34.113995 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d231cd90-5f25-4f50-8a2d-b039ee8e6b77 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:34.118454 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-d231cd90-5f25-4f50-8a2d-b039ee8e6b77 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/26f296f9-adb6-4d8c-b35d-86fa0c6cef07 HTTP/1.1" status: 204 len: 168 time: 0.4273553 Sep 18 08:39:34.182772 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-79787914-7f5f-4a80-868b-2ee8a1e33a23 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 27a509fa-10dc-4ef1-bb19-0a80691837ef {{(pid=94347) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:39:34.188413 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d231cd90-5f25-4f50-8a2d-b039ee8e6b77 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=26f296f9-adb6-4d8c-b35d-86fa0c6cef07,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:34.201195 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-79787914-7f5f-4a80-868b-2ee8a1e33a23 service neutron] Notify callbacks [] for port, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:34.234136 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8676bf46-10ba-482f-943d-ca5fb2582b7f req-9ba13a39-21a0-4658-a83f-7c115a62d76d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:34.235610 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8676bf46-10ba-482f-943d-ca5fb2582b7f req-9ba13a39-21a0-4658-a83f-7c115a62d76d service neutron] 10.222.0.13 "GET /v2.0/subnets?id=acdeb8a1-5de9-425f-ae0a-890d310246e9 HTTP/1.1" status: 200 len: 855 time: 0.1388791 Sep 18 08:39:34.242136 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4f76c450-f74d-4e85-8084-290c76bc9e19 req-51b0f068-25cd-4e28-928a-ebbb2d4db093 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1494808 Sep 18 08:39:34.245052 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.provisioning_blocks [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-79787914-7f5f-4a80-868b-2ee8a1e33a23 service neutron] Transition to ACTIVE for port object 27a509fa-10dc-4ef1-bb19-0a80691837ef will not be triggered until provisioned by entity L2. {{(pid=94347) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 18 08:39:34.256318 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fb8ff688-2aab-4e94-8029-ad5732e3e331 req-be898f99-7034-42a2-9e9e-f0f61910e54d tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1400816 Sep 18 08:39:34.258552 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-79787914-7f5f-4a80-868b-2ee8a1e33a23 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:34.344905 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79787914-7f5f-4a80-868b-2ee8a1e33a23 service neutron] Pushing event updated for resources: {'Port': ['ID=27a509fa-10dc-4ef1-bb19-0a80691837ef,revision_number=2']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:34.375709 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8676bf46-10ba-482f-943d-ca5fb2582b7f req-4a953966-97a9-474b-a153-8bf36b217d0d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:34.377177 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8676bf46-10ba-482f-943d-ca5fb2582b7f req-4a953966-97a9-474b-a153-8bf36b217d0d service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=f430397d-03a8-4da2-bd1d-25890a3a0727&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1310580 Sep 18 08:39:34.618310 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 56952) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:34.632044 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-76795725-3e2f-40b4-aa82-3338f563bf02 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:34.734483 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-76795725-3e2f-40b4-aa82-3338f563bf02 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:34.739537 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-76795725-3e2f-40b4-aa82-3338f563bf02 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:34.780915 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-76795725-3e2f-40b4-aa82-3338f563bf02 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=5fe750479aac4b46a7c8247d3435c46a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1614478 Sep 18 08:39:34.782068 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76795725-3e2f-40b4-aa82-3338f563bf02 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=741a7818-62a1-475a-8229-68935d62843d,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:34.785330 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 56960) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:34.826820 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df1f4e4-200e-4193-86ce-08304059693c req-e47ac686-8819-446d-a4c8-c443f431d293 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:34.837242 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9df1f4e4-200e-4193-86ce-08304059693c req-e47ac686-8819-446d-a4c8-c443f431d293 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/ports?device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 948 time: 0.4400485 Sep 18 08:39:34.839864 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-79787914-7f5f-4a80-868b-2ee8a1e33a23 service neutron] Attempting to bind port 27a509fa-10dc-4ef1-bb19-0a80691837ef on host hv-cinder-80447 for vnic_type normal with profile {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:39:34.840207 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-79787914-7f5f-4a80-868b-2ee8a1e33a23 service neutron] Attempting to bind port 27a509fa-10dc-4ef1-bb19-0a80691837ef by drivers openvswitch,hyperv on host hv-cinder-80447 at level 0 using segments [{'id': '4771e64b-9ced-4a35-b6b5-805d70815e86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 242, 'network_id': '06bf55c3-5a69-4608-ba2d-4599eb57bfe8'}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:39:34.840543 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-79787914-7f5f-4a80-868b-2ee8a1e33a23 service neutron] Attempting to bind port 27a509fa-10dc-4ef1-bb19-0a80691837ef on network 06bf55c3-5a69-4608-ba2d-4599eb57bfe8 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:39:34.856557 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-06042758-d63e-44f3-baf9-2385b1539509 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:34.860446 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8676bf46-10ba-482f-943d-ca5fb2582b7f req-7a670b8a-627b-45a9-adf3-13fa8d6a6ec6 service neutron] 10.222.0.13 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4670780 Sep 18 08:39:34.860978 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-79787914-7f5f-4a80-868b-2ee8a1e33a23 service neutron] Port 27a509fa-10dc-4ef1-bb19-0a80691837ef on network 06bf55c3-5a69-4608-ba2d-4599eb57bfe8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80447 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 18 08:39:34.861327 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-79787914-7f5f-4a80-868b-2ee8a1e33a23 service neutron] Attempting to bind port 27a509fa-10dc-4ef1-bb19-0a80691837ef on network 06bf55c3-5a69-4608-ba2d-4599eb57bfe8 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:39:34.872312 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-79787914-7f5f-4a80-868b-2ee8a1e33a23 service neutron] Checking agent: {'id': '8d51fdc4-974b-4200-9c3f-5dddea60a869', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80447', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'started_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 39, 20), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:39:34.872580 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-79787914-7f5f-4a80-868b-2ee8a1e33a23 service neutron] Checking segment: {'id': '4771e64b-9ced-4a35-b6b5-805d70815e86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 242, 'network_id': '06bf55c3-5a69-4608-ba2d-4599eb57bfe8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94347) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:39:34.872958 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-79787914-7f5f-4a80-868b-2ee8a1e33a23 service neutron] Bound using segment: {'id': '4771e64b-9ced-4a35-b6b5-805d70815e86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 242, 'network_id': '06bf55c3-5a69-4608-ba2d-4599eb57bfe8'} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:39:34.873416 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-79787914-7f5f-4a80-868b-2ee8a1e33a23 service neutron] Bound port: 27a509fa-10dc-4ef1-bb19-0a80691837ef, host: hv-cinder-80447, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4771e64b-9ced-4a35-b6b5-805d70815e86', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 242, 'network_id': '06bf55c3-5a69-4608-ba2d-4599eb57bfe8'}}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:39:34.873771 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-79787914-7f5f-4a80-868b-2ee8a1e33a23 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:34.881541 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-06042758-d63e-44f3-baf9-2385b1539509 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:34.927504 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-06042758-d63e-44f3-baf9-2385b1539509 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:34.931019 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-06042758-d63e-44f3-baf9-2385b1539509 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:34.932283 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-06042758-d63e-44f3-baf9-2385b1539509 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/741a7818-62a1-475a-8229-68935d62843d HTTP/1.1" status: 204 len: 168 time: 0.1457911 Sep 18 08:39:34.940355 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06042758-d63e-44f3-baf9-2385b1539509 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=741a7818-62a1-475a-8229-68935d62843d,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:34.951909 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9df1f4e4-200e-4193-86ce-08304059693c req-4bef89c8-d099-4705-a43d-6ad2882afc48 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/security-groups?id=32504d5c-b702-4d1a-8d76-e0cd4da86123&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1163952 Sep 18 08:39:35.024759 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-79787914-7f5f-4a80-868b-2ee8a1e33a23 service neutron] For port 27a509fa-10dc-4ef1-bb19-0a80691837ef, host hv-cinder-80447, cleared binding levels {{(pid=94347) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:39:35.029070 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-79787914-7f5f-4a80-868b-2ee8a1e33a23 service neutron] For port 27a509fa-10dc-4ef1-bb19-0a80691837ef, host hv-cinder-80447, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=27a509fa-10dc-4ef1-bb19-0a80691837ef,segment=NetworkSegment(4771e64b-9ced-4a35-b6b5-805d70815e86),segment_id=4771e64b-9ced-4a35-b6b5-805d70815e86)] {{(pid=94347) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:39:35.033798 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8676bf46-10ba-482f-943d-ca5fb2582b7f req-7ba443bb-d79f-411d-a40f-fe3e1267f6b7 service neutron] 10.222.0.13 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1494389 Sep 18 08:39:35.035289 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-79787914-7f5f-4a80-868b-2ee8a1e33a23 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:35.069226 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-79787914-7f5f-4a80-868b-2ee8a1e33a23 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:35.069827 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-79787914-7f5f-4a80-868b-2ee8a1e33a23 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:35.071278 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-79787914-7f5f-4a80-868b-2ee8a1e33a23 service neutron] 10.222.0.13 "PUT /v2.0/ports/27a509fa-10dc-4ef1-bb19-0a80691837ef HTTP/1.1" status: 200 len: 1098 time: 1.5846896 Sep 18 08:39:35.071724 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '09faa6cc-6619-4eac-8e44-8d07532200d0', 'tag': '27a509fa-10dc-4ef1-bb19-0a80691837ef'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:39:35.074074 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2d46bea0-979d-431a-a7da-149d8c387f61" -d '{"events": [{"name": "network-changed", "server_uuid": "09faa6cc-6619-4eac-8e44-8d07532200d0", "tag": "27a509fa-10dc-4ef1-bb19-0a80691837ef"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:39:35.105537 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79787914-7f5f-4a80-868b-2ee8a1e33a23 service neutron] Pushing event updated for resources: {'Port': ['ID=27a509fa-10dc-4ef1-bb19-0a80691837ef,revision_number=3']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:35.136357 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:39:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-333be691-1dd5-48e8-8831-f72f740dde80 x-openstack-request-id: req-333be691-1dd5-48e8-8831-f72f740dde80 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:39:35.136710 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "09faa6cc-6619-4eac-8e44-8d07532200d0", "tag": "27a509fa-10dc-4ef1-bb19-0a80691837ef", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:39:35.137019 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-333be691-1dd5-48e8-8831-f72f740dde80 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:39:35.137514 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '09faa6cc-6619-4eac-8e44-8d07532200d0', 'tag': '27a509fa-10dc-4ef1-bb19-0a80691837ef', 'status': 'completed', 'code': 200} Sep 18 08:39:35.224532 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-e7d7beb6-2708-4471-87d1-8c3473adf5b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:35.226830 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-e7d7beb6-2708-4471-87d1-8c3473adf5b4 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=adfddd23e1874cb7bd027bf41e4d64c4&device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 1101 time: 0.0480571 Sep 18 08:39:35.307207 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-2cb08a7b-8ad8-4382-b781-6cdd0003ef97 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.213&port_id=27a509fa-10dc-4ef1-bb19-0a80691837ef HTTP/1.1" status: 200 len: 217 time: 0.0390024 Sep 18 08:39:35.428283 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-db3b63d5-1819-4c4a-a3d4-8fd8374775fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:35.430363 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-db3b63d5-1819-4c4a-a3d4-8fd8374775fb service neutron] 10.222.0.13 "GET /v2.0/subnets?id=07aca37f-8673-4f2c-a2b8-6de53e548d8a HTTP/1.1" status: 200 len: 843 time: 0.1123016 Sep 18 08:39:35.451796 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfef2af8-661c-41fc-b675-aff84d5b4ff3 req-c71bd1c3-61e4-44dd-9405-b4e9e7de44cc tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:35.453260 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bfef2af8-661c-41fc-b675-aff84d5b4ff3 req-c71bd1c3-61e4-44dd-9405-b4e9e7de44cc tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.0974493 Sep 18 08:39:35.462822 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e62298a-5adc-402e-9ea5-ca231a52e8e6 req-7478cc9d-9dd8-42ed-ac3e-989e6f3e5ce1 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:35.464247 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2e62298a-5adc-402e-9ea5-ca231a52e8e6 req-7478cc9d-9dd8-42ed-ac3e-989e6f3e5ce1 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 945 time: 0.1073744 Sep 18 08:39:35.519419 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bfef2af8-661c-41fc-b675-aff84d5b4ff3 req-9c6295c3-2305-4056-9d79-01216a7ebd1d tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0542259 Sep 18 08:39:35.554951 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2e62298a-5adc-402e-9ea5-ca231a52e8e6 req-6678043a-afca-433b-8229-874454a74947 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0828929 Sep 18 08:39:35.572270 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-99ca3cb0-1bcf-4ecc-a567-53c9756dbaf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:35.573975 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-99ca3cb0-1bcf-4ecc-a567-53c9756dbaf0 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=06bf55c3-5a69-4608-ba2d-4599eb57bfe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0490949 Sep 18 08:39:35.730181 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-72edbc1b-5ee8-41e4-a78a-1e85c02cfad8 service neutron] 10.222.0.13 "GET /v2.0/networks/06bf55c3-5a69-4608-ba2d-4599eb57bfe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0865793 Sep 18 08:39:35.881986 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ceac3bc2-c954-4743-87d2-50f3c752247d req-26d8b172-e67b-4081-92a4-577b732491fe service neutron] 10.222.0.13 "GET /v2.0/networks/06bf55c3-5a69-4608-ba2d-4599eb57bfe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0992699 Sep 18 08:39:36.107302 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d46bea0-979d-431a-a7da-149d8c387f61 req-771c5f7a-dcea-445e-b2a8-b3d8b44006d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:36.108807 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2d46bea0-979d-431a-a7da-149d8c387f61 req-771c5f7a-dcea-445e-b2a8-b3d8b44006d3 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=adfddd23e1874cb7bd027bf41e4d64c4&device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 1101 time: 0.0629921 Sep 18 08:39:36.116273 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff258578-95e7-4899-b6ea-516a73141ebd req-d5d9cb4a-af8c-48b2-a951-ca5caf780843 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:36.118336 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ff258578-95e7-4899-b6ea-516a73141ebd req-d5d9cb4a-af8c-48b2-a951-ca5caf780843 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/ports?device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 948 time: 0.0822327 Sep 18 08:39:36.220001 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ff258578-95e7-4899-b6ea-516a73141ebd req-5f9826de-d523-4ecd-87f4-2d032ed1f2d7 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/security-groups?id=32504d5c-b702-4d1a-8d76-e0cd4da86123&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0889039 Sep 18 08:39:36.245570 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d46bea0-979d-431a-a7da-149d8c387f61 req-623460cc-7d0b-45b1-a2be-77ea82b524bd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:36.247253 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2d46bea0-979d-431a-a7da-149d8c387f61 req-623460cc-7d0b-45b1-a2be-77ea82b524bd service neutron] 10.222.0.13 "GET /v2.0/networks?id=06bf55c3-5a69-4608-ba2d-4599eb57bfe8 HTTP/1.1" status: 200 len: 870 time: 0.1251087 Sep 18 08:39:36.301880 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2d46bea0-979d-431a-a7da-149d8c387f61 req-f9949f3c-cebf-4586-995f-c191eaf029d9 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.213&port_id=27a509fa-10dc-4ef1-bb19-0a80691837ef HTTP/1.1" status: 200 len: 217 time: 0.0344815 Sep 18 08:39:36.370201 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d46bea0-979d-431a-a7da-149d8c387f61 req-64893d34-254f-4022-93c3-88ba1ed279c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:36.371681 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2d46bea0-979d-431a-a7da-149d8c387f61 req-64893d34-254f-4022-93c3-88ba1ed279c5 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=07aca37f-8673-4f2c-a2b8-6de53e548d8a HTTP/1.1" status: 200 len: 843 time: 0.0532651 Sep 18 08:39:36.429080 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d46bea0-979d-431a-a7da-149d8c387f61 req-b3230e1d-1e5c-4d20-a735-6bbfacb4a0ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:36.430835 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2d46bea0-979d-431a-a7da-149d8c387f61 req-b3230e1d-1e5c-4d20-a735-6bbfacb4a0ad service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=06bf55c3-5a69-4608-ba2d-4599eb57bfe8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0452046 Sep 18 08:39:36.532485 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2d46bea0-979d-431a-a7da-149d8c387f61 req-fefe0172-afc3-4462-9fd3-5190e2a5a976 service neutron] 10.222.0.13 "GET /v2.0/networks/06bf55c3-5a69-4608-ba2d-4599eb57bfe8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0882998 Sep 18 08:39:36.540827 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 57036) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:36.708861 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2d46bea0-979d-431a-a7da-149d8c387f61 req-5db7d5d1-6d65-4c9d-a328-4640003bbb60 service neutron] 10.222.0.13 "GET /v2.0/networks/06bf55c3-5a69-4608-ba2d-4599eb57bfe8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1657522 Sep 18 08:39:36.745397 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-59b38c07-ac6c-4bf5-a927-c9037f5de6b8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:36.783524 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbf8ff72-3e63-44ad-a56d-8f99921cd13d req-a9485547-889d-4912-830a-96840089b3d1 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:36.785001 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dbf8ff72-3e63-44ad-a56d-8f99921cd13d req-a9485547-889d-4912-830a-96840089b3d1 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 945 time: 0.1183648 Sep 18 08:39:36.795299 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd0de84f-60ce-4634-a624-821b52be32a4 req-a1dfd778-6d86-49a9-b982-6a869973cfa4 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:36.796713 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dd0de84f-60ce-4634-a624-821b52be32a4 req-a1dfd778-6d86-49a9-b982-6a869973cfa4 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.1289432 Sep 18 08:39:36.817952 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 57056) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:36.879834 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dbf8ff72-3e63-44ad-a56d-8f99921cd13d req-25b0bdd5-7bc3-40ed-84a7-dcc77bdf52cb tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0802467 Sep 18 08:39:36.887669 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dd0de84f-60ce-4634-a624-821b52be32a4 req-5167803d-d2bd-4d23-93d5-472ba362c6b7 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0787270 Sep 18 08:39:36.936169 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-59b38c07-ac6c-4bf5-a927-c9037f5de6b8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:36.945784 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0fd4e92e-9397-49c6-8596-8c1cab622ee1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:36.948999 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-59b38c07-ac6c-4bf5-a927-c9037f5de6b8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:37.006251 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-59b38c07-ac6c-4bf5-a927-c9037f5de6b8 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=dc1a9433ccb64bb4a0156f89e10d5748&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4642448 Sep 18 08:39:37.007866 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59b38c07-ac6c-4bf5-a927-c9037f5de6b8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a6a7406f-900a-45b1-9609-f4b6bb819c28,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:37.010348 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 57064) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:37.054594 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0fd4e92e-9397-49c6-8596-8c1cab622ee1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:37.058933 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0fd4e92e-9397-49c6-8596-8c1cab622ee1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:37.068521 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-49c0ee30-64cc-4bc0-b5dd-5791b55c5e4c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:37.093356 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-49c0ee30-64cc-4bc0-b5dd-5791b55c5e4c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:37.096347 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fd4e92e-9397-49c6-8596-8c1cab622ee1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0f8a8fb6-2167-4d9d-a830-e38aefadd0be,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:37.104264 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-0fd4e92e-9397-49c6-8596-8c1cab622ee1 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=7445219b988b448aa92c40e08679a377&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2852414 Sep 18 08:39:37.104707 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 57066) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:37.172593 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8c138624-2955-4f3a-9c3c-f5b29fba606f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:37.178234 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-49c0ee30-64cc-4bc0-b5dd-5791b55c5e4c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:37.181360 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-49c0ee30-64cc-4bc0-b5dd-5791b55c5e4c admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:37.182483 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-49c0ee30-64cc-4bc0-b5dd-5791b55c5e4c admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/a6a7406f-900a-45b1-9609-f4b6bb819c28 HTTP/1.1" status: 204 len: 168 time: 0.1713164 Sep 18 08:39:37.197629 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49c0ee30-64cc-4bc0-b5dd-5791b55c5e4c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a6a7406f-900a-45b1-9609-f4b6bb819c28,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:37.208228 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8c138624-2955-4f3a-9c3c-f5b29fba606f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:37.274966 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8c138624-2955-4f3a-9c3c-f5b29fba606f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:37.280059 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8c138624-2955-4f3a-9c3c-f5b29fba606f admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:37.281310 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-8c138624-2955-4f3a-9c3c-f5b29fba606f admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/0f8a8fb6-2167-4d9d-a830-e38aefadd0be HTTP/1.1" status: 204 len: 168 time: 0.1755693 Sep 18 08:39:37.321031 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c138624-2955-4f3a-9c3c-f5b29fba606f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0f8a8fb6-2167-4d9d-a830-e38aefadd0be,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:37.371496 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df5eb76e-938f-44a1-8116-f6a99db947dd req-fd2eb42e-184e-4af1-90a9-6b29cb4a3e2c tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:37.373072 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-df5eb76e-938f-44a1-8116-f6a99db947dd req-fd2eb42e-184e-4af1-90a9-6b29cb4a3e2c tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/ports?device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 948 time: 0.0671413 Sep 18 08:39:37.411715 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-df5eb76e-938f-44a1-8116-f6a99db947dd req-48c9ad3a-bc08-4283-a2d7-68eec208cfd4 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/security-groups?id=32504d5c-b702-4d1a-8d76-e0cd4da86123&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0323169 Sep 18 08:39:37.502905 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 57082) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:37.518097 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7033ed3d-f53d-430b-b3df-856d9afbf1a8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:37.615080 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7033ed3d-f53d-430b-b3df-856d9afbf1a8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:37.620503 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7033ed3d-f53d-430b-b3df-856d9afbf1a8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:37.662345 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-7033ed3d-f53d-430b-b3df-856d9afbf1a8 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=4dcf6c664e2b40a182b16efb28b0b2ef&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1583264 Sep 18 08:39:37.664850 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7033ed3d-f53d-430b-b3df-856d9afbf1a8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4af002f9-6f48-428c-8ead-2b1e7cb8a6aa,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:37.665497 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 57088) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:37.722944 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 57092) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:37.737549 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d69625e4-7482-4f72-aeba-0301ed62fc3c admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:37.738999 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8bf7c66a-01a1-452a-91af-a1d379ddfd54 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:37.770285 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8bf7c66a-01a1-452a-91af-a1d379ddfd54 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:37.830331 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8bf7c66a-01a1-452a-91af-a1d379ddfd54 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:37.838898 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8bf7c66a-01a1-452a-91af-a1d379ddfd54 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:37.840371 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-8bf7c66a-01a1-452a-91af-a1d379ddfd54 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/4af002f9-6f48-428c-8ead-2b1e7cb8a6aa HTTP/1.1" status: 204 len: 168 time: 0.1738355 Sep 18 08:39:37.859544 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bf7c66a-01a1-452a-91af-a1d379ddfd54 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4af002f9-6f48-428c-8ead-2b1e7cb8a6aa,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:37.891382 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d69625e4-7482-4f72-aeba-0301ed62fc3c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:37.897863 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d69625e4-7482-4f72-aeba-0301ed62fc3c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:37.951294 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89956653-1896-4d16-8cca-d2866ee74e5d req-e2af7978-8bb3-49f6-9863-c11dd5c9df3b tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:37.952833 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-89956653-1896-4d16-8cca-d2866ee74e5d req-e2af7978-8bb3-49f6-9863-c11dd5c9df3b tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 945 time: 0.1026380 Sep 18 08:39:37.954231 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d69625e4-7482-4f72-aeba-0301ed62fc3c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4b6361d4-ebbd-4f66-a0b0-ee066abdd8d8,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:37.960728 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-d69625e4-7482-4f72-aeba-0301ed62fc3c admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=d499a4e4727c42ccb33190bffc16a0c0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2343035 Sep 18 08:39:37.962912 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 57100) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:38.014477 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-89956653-1896-4d16-8cca-d2866ee74e5d req-aadb3e39-a981-4c68-915b-b3652f0a70d0 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0522346 Sep 18 08:39:38.032419 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0484edc4-aa95-4411-b8fd-e7fe66532f81 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:38.056494 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0484edc4-aa95-4411-b8fd-e7fe66532f81 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:38.067249 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f718558e-a013-43d6-ba08-b0ce555c33c6 req-461165bc-1bee-41a2-abe5-ee9c4cbd30f3 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:38.077145 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f718558e-a013-43d6-ba08-b0ce555c33c6 req-461165bc-1bee-41a2-abe5-ee9c4cbd30f3 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.0793953 Sep 18 08:39:38.112945 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0484edc4-aa95-4411-b8fd-e7fe66532f81 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:38.117165 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0484edc4-aa95-4411-b8fd-e7fe66532f81 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:38.121377 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-0484edc4-aa95-4411-b8fd-e7fe66532f81 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/4b6361d4-ebbd-4f66-a0b0-ee066abdd8d8 HTTP/1.1" status: 204 len: 168 time: 0.1574035 Sep 18 08:39:38.130214 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f718558e-a013-43d6-ba08-b0ce555c33c6 req-45f830b5-d7e8-4229-abf4-dd2c4fff7e21 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0519669 Sep 18 08:39:38.130691 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0484edc4-aa95-4411-b8fd-e7fe66532f81 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4b6361d4-ebbd-4f66-a0b0-ee066abdd8d8,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:38.258725 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 57112) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:38.271883 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-cf485a9d-8217-4750-aad8-30d48de7af8c admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:38.365287 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-cf485a9d-8217-4750-aad8-30d48de7af8c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:38.369833 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-cf485a9d-8217-4750-aad8-30d48de7af8c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:38.407818 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-cf485a9d-8217-4750-aad8-30d48de7af8c admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=775625acc622458eb3753d9bfefa06ad&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1480134 Sep 18 08:39:38.408684 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf485a9d-8217-4750-aad8-30d48de7af8c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=db67f31c-d8a7-4b8c-bdfa-2166aa9a8c88,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:38.410441 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 57118) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:38.487926 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-99ba12ac-6f62-4a35-9b0a-2f1353f2380d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:38.526873 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-99ba12ac-6f62-4a35-9b0a-2f1353f2380d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:38.590309 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3130cd22-0d16-43fc-9f9c-4af31d5aecd7 req-28bf0e09-6058-4177-aa0e-b183727a7257 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:38.591789 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3130cd22-0d16-43fc-9f9c-4af31d5aecd7 req-28bf0e09-6058-4177-aa0e-b183727a7257 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/ports?device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 948 time: 0.0779378 Sep 18 08:39:38.619581 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-99ba12ac-6f62-4a35-9b0a-2f1353f2380d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:38.622229 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-99ba12ac-6f62-4a35-9b0a-2f1353f2380d admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:38.623377 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-99ba12ac-6f62-4a35-9b0a-2f1353f2380d admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/db67f31c-d8a7-4b8c-bdfa-2166aa9a8c88 HTTP/1.1" status: 204 len: 168 time: 0.2117813 Sep 18 08:39:38.642450 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99ba12ac-6f62-4a35-9b0a-2f1353f2380d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=db67f31c-d8a7-4b8c-bdfa-2166aa9a8c88,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:38.648568 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3130cd22-0d16-43fc-9f9c-4af31d5aecd7 req-b23cf3f0-9993-493c-adaf-3df43baadf7b tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/security-groups?id=32504d5c-b702-4d1a-8d76-e0cd4da86123&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0501173 Sep 18 08:39:39.174052 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3db74fa0-77b1-48b0-b79a-b87a4b3f9283 req-33e8fdc1-b128-4175-b27a-a3663da80d36 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:39.175987 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3db74fa0-77b1-48b0-b79a-b87a4b3f9283 req-33e8fdc1-b128-4175-b27a-a3663da80d36 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 945 time: 0.0871439 Sep 18 08:39:39.237490 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3db74fa0-77b1-48b0-b79a-b87a4b3f9283 req-23335b43-c33f-4c08-ac20-ed6308485a68 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0547950 Sep 18 08:39:39.291466 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e605830c-7f98-4cbd-a217-1ec4d3588596 req-8db38480-f9f4-446b-a88c-c14e31d086dd tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:39.293008 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e605830c-7f98-4cbd-a217-1ec4d3588596 req-8db38480-f9f4-446b-a88c-c14e31d086dd tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.0626366 Sep 18 08:39:39.337159 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e605830c-7f98-4cbd-a217-1ec4d3588596 req-38af9493-8409-4e9e-a0f7-a0638881047c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0336328 Sep 18 08:39:39.787122 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09a13223-bc55-48ec-b437-6b13e3d876e2 req-3130a027-8ae1-48e3-a4ef-70fae626cfa8 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:39.789269 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-09a13223-bc55-48ec-b437-6b13e3d876e2 req-3130a027-8ae1-48e3-a4ef-70fae626cfa8 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/ports?device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 948 time: 0.0566902 Sep 18 08:39:39.834264 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-09a13223-bc55-48ec-b437-6b13e3d876e2 req-a8d9d0d2-7ec0-4942-bada-2f04e311d175 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/security-groups?id=32504d5c-b702-4d1a-8d76-e0cd4da86123&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0383475 Sep 18 08:39:40.199255 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5c8f92d-5355-48ab-b911-bd9a52f5ed04 req-73edd43d-9669-4e70-866e-3a10ce52e4af tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:40.201135 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c5c8f92d-5355-48ab-b911-bd9a52f5ed04 req-73edd43d-9669-4e70-866e-3a10ce52e4af tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 945 time: 0.0589924 Sep 18 08:39:40.261729 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c5c8f92d-5355-48ab-b911-bd9a52f5ed04 req-26ea1551-0d77-48fb-b30b-50f6d88e90c4 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0537298 Sep 18 08:39:40.297573 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 27a509fa-10dc-4ef1-bb19-0a80691837ef details requested by agent hyperv_hv-cinder-80447 with host hv-cinder-80447 {{(pid=94348) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 18 08:39:40.398542 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 27a509fa-10dc-4ef1-bb19-0a80691837ef, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=27a509fa-10dc-4ef1-bb19-0a80691837ef,segment=NetworkSegment(4771e64b-9ced-4a35-b6b5-805d70815e86),segment_id=4771e64b-9ced-4a35-b6b5-805d70815e86)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:39:40.400481 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c942e0a7-797b-47d8-9cd9-fea58b3db7bf req-cd64c8bb-7942-4756-a180-b942ee65f732 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:40.402030 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c942e0a7-797b-47d8-9cd9-fea58b3db7bf req-cd64c8bb-7942-4756-a180-b942ee65f732 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 945 time: 0.0614672 Sep 18 08:39:40.410268 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Returning: {'device': '27a509fa-10dc-4ef1-bb19-0a80691837ef', 'network_id': '06bf55c3-5a69-4608-ba2d-4599eb57bfe8', 'port_id': '27a509fa-10dc-4ef1-bb19-0a80691837ef', 'mac_address': 'fa:16:3e:9a:f8:3c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 242, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '07aca37f-8673-4f2c-a2b8-6de53e548d8a', 'ip_address': '192.168.233.213'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94348) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 18 08:39:40.448693 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:40.462128 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 27a509fa-10dc-4ef1-bb19-0a80691837ef {{(pid=94348) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:39:40.474631 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c942e0a7-797b-47d8-9cd9-fea58b3db7bf req-827f71b3-6500-44a4-a953-4c3ee8e62de2 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0663486 Sep 18 08:39:40.485190 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 27a509fa-10dc-4ef1-bb19-0a80691837ef, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=27a509fa-10dc-4ef1-bb19-0a80691837ef,segment=NetworkSegment(4771e64b-9ced-4a35-b6b5-805d70815e86),segment_id=4771e64b-9ced-4a35-b6b5-805d70815e86)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:39:40.489512 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:40.498917 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbb315a6-10b0-4ac9-bfcd-5750fa0f2cd2 req-87340828-f497-48cd-a448-9fcb1d2a0c12 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:40.498917 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dbb315a6-10b0-4ac9-bfcd-5750fa0f2cd2 req-87340828-f497-48cd-a448-9fcb1d2a0c12 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.0760021 Sep 18 08:39:40.533840 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dbb315a6-10b0-4ac9-bfcd-5750fa0f2cd2 req-ae48197d-0577-471d-8c39-68cb2423fdb2 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0357137 Sep 18 08:39:40.549343 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=27a509fa-10dc-4ef1-bb19-0a80691837ef,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:40.717122 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14442bcc-2105-4f58-af8f-1d061b09aec2 req-72575105-cc94-4dd7-80bb-067b47de68cd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:40.718923 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-14442bcc-2105-4f58-af8f-1d061b09aec2 req-72575105-cc94-4dd7-80bb-067b47de68cd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.13 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 945 time: 0.0493755 Sep 18 08:39:40.851477 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-14442bcc-2105-4f58-af8f-1d061b09aec2 req-51528001-2206-4475-8858-f1ca708bd253 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Deleting port 63cfc18e-94f6-437f-86ac-093dde6268e8 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:39:40.852074 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-14442bcc-2105-4f58-af8f-1d061b09aec2 req-51528001-2206-4475-8858-f1ca708bd253 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:40.978192 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-14442bcc-2105-4f58-af8f-1d061b09aec2 req-51528001-2206-4475-8858-f1ca708bd253 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] For port 63cfc18e-94f6-437f-86ac-093dde6268e8, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=63cfc18e-94f6-437f-86ac-093dde6268e8,segment=NetworkSegment(4f8dffb0-f8d4-41b5-beed-53bcf370cb42),segment_id=4f8dffb0-f8d4-41b5-beed-53bcf370cb42)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:39:40.978639 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-14442bcc-2105-4f58-af8f-1d061b09aec2 req-51528001-2206-4475-8858-f1ca708bd253 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:40.988523 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fb0c099-9080-4cc4-b1e9-cffb61a1f0ce req-27ee5f68-a6ba-4dd8-aec9-1a8f88edb158 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:40.990043 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6fb0c099-9080-4cc4-b1e9-cffb61a1f0ce req-27ee5f68-a6ba-4dd8-aec9-1a8f88edb158 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/ports?device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 949 time: 0.0820715 Sep 18 08:39:41.009943 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-14442bcc-2105-4f58-af8f-1d061b09aec2 req-51528001-2206-4475-8858-f1ca708bd253 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Calling delete_port for 63cfc18e-94f6-437f-86ac-093dde6268e8 owned by compute:nova {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:39:41.114844 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6fb0c099-9080-4cc4-b1e9-cffb61a1f0ce req-c5347c0a-23c7-422c-9d11-e3ab59a526d5 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/security-groups?id=32504d5c-b702-4d1a-8d76-e0cd4da86123&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1183805 Sep 18 08:39:41.142309 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['27a509fa-10dc-4ef1-bb19-0a80691837ef'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:39:41.214872 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-14442bcc-2105-4f58-af8f-1d061b09aec2 req-51528001-2206-4475-8858-f1ca708bd253 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:41.245068 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51528001-2206-4475-8858-f1ca708bd253 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Pushing event deleted for resources: {'Port': ['ID=63cfc18e-94f6-437f-86ac-093dde6268e8,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:41.325723 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-14442bcc-2105-4f58-af8f-1d061b09aec2 req-51528001-2206-4475-8858-f1ca708bd253 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] No DVR routers for this DVR port 63cfc18e-94f6-437f-86ac-093dde6268e8 on host hv-cinder-80447 {{(pid=94347) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:39:41.325723 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-14442bcc-2105-4f58-af8f-1d061b09aec2 req-51528001-2206-4475-8858-f1ca708bd253 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:41.325723 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-14442bcc-2105-4f58-af8f-1d061b09aec2 req-51528001-2206-4475-8858-f1ca708bd253 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.13 "DELETE /v2.0/ports/63cfc18e-94f6-437f-86ac-093dde6268e8 HTTP/1.1" status: 204 len: 173 time: 0.5948768 Sep 18 08:39:41.325723 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8e21db7d-ad7c-4e54-ae13-5a36ab9e244e', 'name': 'network-vif-deleted', 'tag': '63cfc18e-94f6-437f-86ac-093dde6268e8'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:39:41.327544 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a2d6c083-13db-4c36-b924-0095dca1ebdf" -d '{"events": [{"server_uuid": "8e21db7d-ad7c-4e54-ae13-5a36ab9e244e", "name": "network-vif-deleted", "tag": "63cfc18e-94f6-437f-86ac-093dde6268e8"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:39:41.399327 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:39:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e2ff3a61-8948-47b7-940a-b8b8d5ff9593 x-openstack-request-id: req-e2ff3a61-8948-47b7-940a-b8b8d5ff9593 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:39:41.399978 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8e21db7d-ad7c-4e54-ae13-5a36ab9e244e", "name": "network-vif-deleted", "tag": "63cfc18e-94f6-437f-86ac-093dde6268e8", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:39:41.400439 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-e2ff3a61-8948-47b7-940a-b8b8d5ff9593 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:39:41.401040 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8e21db7d-ad7c-4e54-ae13-5a36ab9e244e', 'name': 'network-vif-deleted', 'tag': '63cfc18e-94f6-437f-86ac-093dde6268e8', 'status': 'completed', 'code': 200} Sep 18 08:39:41.467543 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-786b1c97-e726-4c3f-82cb-ef346f231316 req-d34ab9ff-5dd6-4326-b617-63776b107400 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:41.469502 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-786b1c97-e726-4c3f-82cb-ef346f231316 req-d34ab9ff-5dd6-4326-b617-63776b107400 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 945 time: 0.0586381 Sep 18 08:39:41.510668 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-786b1c97-e726-4c3f-82cb-ef346f231316 req-94fc2c34-82ce-42a2-b52d-2432dfead957 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0349896 Sep 18 08:39:41.614110 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0619d874-2564-412c-bb03-726576e502a0 req-d33bdd87-ef42-43a4-9d5a-bccc8ae36a10 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8e21db7d-ad7c-4e54-ae13-5a36ab9e244e HTTP/1.1" status: 200 len: 210 time: 0.0259438 Sep 18 08:39:41.679777 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac55987d-d93c-4183-a73f-43c5532c82a4 req-cc27b2b1-813d-4f26-886a-d8158505e042 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:41.681320 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ac55987d-d93c-4183-a73f-43c5532c82a4 req-cc27b2b1-813d-4f26-886a-d8158505e042 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.0585155 Sep 18 08:39:41.723446 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ac55987d-d93c-4183-a73f-43c5532c82a4 req-b75d544a-8c41-4a8b-9b5c-a2f2cda35dba tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0344055 Sep 18 08:39:42.235986 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccb5410a-6e2e-4a2b-be17-2d1b911e6785 req-b39de978-3578-46a5-94b1-ae959082f453 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:42.237521 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ccb5410a-6e2e-4a2b-be17-2d1b911e6785 req-b39de978-3578-46a5-94b1-ae959082f453 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/ports?device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 949 time: 0.0505073 Sep 18 08:39:42.277915 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ccb5410a-6e2e-4a2b-be17-2d1b911e6785 req-d9109d4c-0dd2-4700-8f7c-ca0575aec1ab tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/security-groups?id=32504d5c-b702-4d1a-8d76-e0cd4da86123&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0333736 Sep 18 08:39:42.630889 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54fa9eeb-611c-4e53-bc3b-bc14f00c08cc req-4dbf012e-9dc8-4c87-a68d-40a56ece34fa tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:42.632377 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-54fa9eeb-611c-4e53-bc3b-bc14f00c08cc req-4dbf012e-9dc8-4c87-a68d-40a56ece34fa tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 945 time: 0.0486209 Sep 18 08:39:42.669803 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-54fa9eeb-611c-4e53-bc3b-bc14f00c08cc req-48691c1b-ab85-4286-a485-d4eac39a4fa7 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0314150 Sep 18 08:39:42.900621 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03aa9384-10e1-4b39-a116-329c0f5a208b req-d370f7b8-aa1d-4f52-b837-c3f26098eeff tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:42.902049 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-03aa9384-10e1-4b39-a116-329c0f5a208b req-d370f7b8-aa1d-4f52-b837-c3f26098eeff tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.1076729 Sep 18 08:39:42.956660 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-03aa9384-10e1-4b39-a116-329c0f5a208b req-7a03ecad-586b-4ee8-9971-d4e8ba38c782 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475585 Sep 18 08:39:42.963240 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-dbb913e5-bcfd-44df-b1fb-a0952efe4782 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:42.964643 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-dbb913e5-bcfd-44df-b1fb-a0952efe4782 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/networks?id=5e2d06a6-7f04-4134-8004-d5639986c75e HTTP/1.1" status: 200 len: 808 time: 0.1408114 Sep 18 08:39:42.981178 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-478254ec-dbbe-4565-8dde-072725e6ac3e tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/quotas/fb9519a4056a4e2ebbe5200ff83d0a1e HTTP/1.1" status: 200 len: 375 time: 0.0100558 Sep 18 08:39:43.015644 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-a6cbc847-1049-45c9-9892-d82678e4b456 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?tenant_id=fb9519a4056a4e2ebbe5200ff83d0a1e&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0289786 Sep 18 08:39:43.109439 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-d7be45f9-4b71-49c6-91fa-391cd80f3919 service neutron] 10.222.0.35 "GET /v2.0/networks/5e2d06a6-7f04-4134-8004-d5639986c75e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0867198 Sep 18 08:39:43.202724 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-b9ffe31a-b065-4867-8d06-59177050acc9 service neutron] 10.222.0.35 "GET /v2.0/networks/5e2d06a6-7f04-4134-8004-d5639986c75e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0866988 Sep 18 08:39:43.372928 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-431aad33-283f-4867-8722-2a190ef6bab2 req-bc83aa85-6c98-4fc8-b8d1-7af591bf3c72 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8949a467-d4ed-449f-be4b-3fe465e79fd7 HTTP/1.1" status: 200 len: 210 time: 0.0350196 Sep 18 08:39:43.418501 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-568cbd85-ff3b-4645-ba32-428acccc0263 req-d2656b10-0ae1-418b-8ef3-181c00acd83b tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:43.419954 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-568cbd85-ff3b-4645-ba32-428acccc0263 req-d2656b10-0ae1-418b-8ef3-181c00acd83b tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/ports?device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 949 time: 0.0707750 Sep 18 08:39:43.459251 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-568cbd85-ff3b-4645-ba32-428acccc0263 req-e1af318e-ee48-4421-97a2-83673e184aa3 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/security-groups?id=32504d5c-b702-4d1a-8d76-e0cd4da86123&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0331066 Sep 18 08:39:43.790690 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82259fda-e166-43a1-8db4-feb8dd11a539 req-f1a409e9-0997-4149-9451-8d512f543015 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:43.792212 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-82259fda-e166-43a1-8db4-feb8dd11a539 req-f1a409e9-0997-4149-9451-8d512f543015 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 945 time: 0.0518782 Sep 18 08:39:43.830680 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-82259fda-e166-43a1-8db4-feb8dd11a539 req-e705d082-9ad3-48cd-bc14-0418826146d8 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/security-groups?id=8ec8ef7b-d527-4952-98bf-d882a759da55&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324421 Sep 18 08:39:43.929105 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 57362) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:43.940057 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb05b924-0df4-4102-bf3f-f0e850b3640a req-8d0d01a5-c2f6-41b7-be42-5d3b52550008 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:43.941578 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fb05b924-0df4-4102-bf3f-f0e850b3640a req-8d0d01a5-c2f6-41b7-be42-5d3b52550008 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.13 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 945 time: 0.0543404 Sep 18 08:39:44.068858 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-aa0002f9-3cbb-4848-a3a3-2fc175ddd1a9 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:44.128315 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0de9d91e-60cc-45b4-bdf6-7cde5b44d07b req-139b7335-1d12-4fcb-8461-db258ced0d5c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:44.129943 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0de9d91e-60cc-45b4-bdf6-7cde5b44d07b req-139b7335-1d12-4fcb-8461-db258ced0d5c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.0841663 Sep 18 08:39:44.158924 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-aa0002f9-3cbb-4848-a3a3-2fc175ddd1a9 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:44.164824 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-aa0002f9-3cbb-4848-a3a3-2fc175ddd1a9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:44.212885 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-aa0002f9-3cbb-4848-a3a3-2fc175ddd1a9 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=94139b1e24564eae8b7aae19da2520aa&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2824767 Sep 18 08:39:44.213762 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 57370) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:44.230504 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa0002f9-3cbb-4848-a3a3-2fc175ddd1a9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=939db905-b653-40ab-a3c8-c98fb8eeecf5,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:44.272993 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-23e5cdf8-224c-4b44-922c-b410ba2c18f2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:44.299764 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-23e5cdf8-224c-4b44-922c-b410ba2c18f2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:44.309690 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 27a509fa-10dc-4ef1-bb19-0a80691837ef up at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:39:44.391334 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-23e5cdf8-224c-4b44-922c-b410ba2c18f2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:44.394954 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-23e5cdf8-224c-4b44-922c-b410ba2c18f2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:44.399847 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-23e5cdf8-224c-4b44-922c-b410ba2c18f2 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/939db905-b653-40ab-a3c8-c98fb8eeecf5 HTTP/1.1" status: 204 len: 168 time: 0.1849432 Sep 18 08:39:44.407388 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-fb05b924-0df4-4102-bf3f-f0e850b3640a req-b188c6f6-19b7-4928-adaa-3e78d762dbc4 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Deleting port 324203bb-e8cc-4392-974c-20b4f2896cc6 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:39:44.407968 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-fb05b924-0df4-4102-bf3f-f0e850b3640a req-b188c6f6-19b7-4928-adaa-3e78d762dbc4 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:44.408883 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23e5cdf8-224c-4b44-922c-b410ba2c18f2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=939db905-b653-40ab-a3c8-c98fb8eeecf5,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:44.430183 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning for port 27a509fa-10dc-4ef1-bb19-0a80691837ef completed by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 18 08:39:44.435436 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning complete for port 27a509fa-10dc-4ef1-bb19-0a80691837ef triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:39:44.436322 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:44.461849 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0de9d91e-60cc-45b4-bdf6-7cde5b44d07b req-a35f08c2-9511-42c0-b4f9-ce459254c491 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3248231 Sep 18 08:39:44.599837 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-51d4af07-b70e-4178-bb0f-c1b755d577ac req-36a12610-bcf8-417f-b6de-d6cfbc8950b4 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8949a467-d4ed-449f-be4b-3fe465e79fd7 HTTP/1.1" status: 200 len: 210 time: 0.0732610 Sep 18 08:39:44.651336 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:44.660974 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-fb05b924-0df4-4102-bf3f-f0e850b3640a req-b188c6f6-19b7-4928-adaa-3e78d762dbc4 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] For port 324203bb-e8cc-4392-974c-20b4f2896cc6, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=324203bb-e8cc-4392-974c-20b4f2896cc6,segment=NetworkSegment(892b5fda-4f2b-4e3a-af39-7d4f8d89394b),segment_id=892b5fda-4f2b-4e3a-af39-7d4f8d89394b)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:39:44.661369 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-fb05b924-0df4-4102-bf3f-f0e850b3640a req-b188c6f6-19b7-4928-adaa-3e78d762dbc4 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:44.674820 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-fb05b924-0df4-4102-bf3f-f0e850b3640a req-b188c6f6-19b7-4928-adaa-3e78d762dbc4 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Calling delete_port for 324203bb-e8cc-4392-974c-20b4f2896cc6 owned by compute:nova {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:39:44.687478 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '09faa6cc-6619-4eac-8e44-8d07532200d0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '27a509fa-10dc-4ef1-bb19-0a80691837ef'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:39:44.690592 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f57e5b72-6f3d-4c29-9c38-94d6e0000702" -d '{"events": [{"server_uuid": "09faa6cc-6619-4eac-8e44-8d07532200d0", "name": "network-vif-plugged", "status": "completed", "tag": "27a509fa-10dc-4ef1-bb19-0a80691837ef"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:39:44.705803 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 27a509fa-10dc-4ef1-bb19-0a80691837ef, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=27a509fa-10dc-4ef1-bb19-0a80691837ef,segment=NetworkSegment(4771e64b-9ced-4a35-b6b5-805d70815e86),segment_id=4771e64b-9ced-4a35-b6b5-805d70815e86)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:39:44.711184 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:44.712204 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 63cfc18e-94f6-437f-86ac-093dde6268e8 no longer exists at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:39:44.741575 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22b87abf-52ba-4dbf-9fc5-0af90ecfa042 req-d57a1a34-2138-4a80-a8d4-3b5442d20fc3 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:44.744152 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:39:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-294aad54-35d0-4b46-9595-9e2727b9fa3e x-openstack-request-id: req-294aad54-35d0-4b46-9595-9e2727b9fa3e {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:39:44.744553 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "09faa6cc-6619-4eac-8e44-8d07532200d0", "name": "network-vif-plugged", "status": "completed", "tag": "27a509fa-10dc-4ef1-bb19-0a80691837ef", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:39:44.744902 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-294aad54-35d0-4b46-9595-9e2727b9fa3e {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:39:44.745487 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '09faa6cc-6619-4eac-8e44-8d07532200d0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '27a509fa-10dc-4ef1-bb19-0a80691837ef', 'code': 200} Sep 18 08:39:44.748001 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] No Port match for: 63cfc18e-94f6-437f-86ac-093dde6268e8 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:39:44.748643 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-22b87abf-52ba-4dbf-9fc5-0af90ecfa042 req-d57a1a34-2138-4a80-a8d4-3b5442d20fc3 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/ports?device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 949 time: 0.1872253 Sep 18 08:39:44.749357 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 63cfc18e-94f6-437f-86ac-093dde6268e8 not bound to the agent host hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:39:44.821785 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=27a509fa-10dc-4ef1-bb19-0a80691837ef,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:44.849704 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 57394) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:44.877550 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-89f919ad-8671-4087-857f-684a49c8b636 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:44.883682 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-22b87abf-52ba-4dbf-9fc5-0af90ecfa042 req-6c20b2ff-e97d-4e4b-a8d6-cd0cc0c60ce7 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/security-groups?id=32504d5c-b702-4d1a-8d76-e0cd4da86123&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1279981 Sep 18 08:39:45.007698 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-825f5fd7-4f3d-4b40-8de6-e23fbf46ca1d tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:45.009569 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-825f5fd7-4f3d-4b40-8de6-e23fbf46ca1d tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.13 "GET /v2.0/networks?id=5e2d06a6-7f04-4134-8004-d5639986c75e HTTP/1.1" status: 200 len: 808 time: 0.2046843 Sep 18 08:39:45.010236 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-fb05b924-0df4-4102-bf3f-f0e850b3640a req-b188c6f6-19b7-4928-adaa-3e78d762dbc4 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:45.010362 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-89f919ad-8671-4087-857f-684a49c8b636 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:45.015346 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-89f919ad-8671-4087-857f-684a49c8b636 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:45.044554 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b188c6f6-19b7-4928-adaa-3e78d762dbc4 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Pushing event deleted for resources: {'Port': ['ID=324203bb-e8cc-4392-974c-20b4f2896cc6,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:45.055533 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-89f919ad-8671-4087-857f-684a49c8b636 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8fd1eec0-ddc8-4626-b82f-72bec743c2d2,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:45.076936 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-89f919ad-8671-4087-857f-684a49c8b636 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=efc3c07624e04b3b964a23f6f453023a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2248795 Sep 18 08:39:45.079369 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 57398) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:45.086288 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-fb05b924-0df4-4102-bf3f-f0e850b3640a req-b188c6f6-19b7-4928-adaa-3e78d762dbc4 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] No DVR routers for this DVR port 324203bb-e8cc-4392-974c-20b4f2896cc6 on host hv-cinder-80447 {{(pid=94347) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:39:45.096932 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-fb05b924-0df4-4102-bf3f-f0e850b3640a req-b188c6f6-19b7-4928-adaa-3e78d762dbc4 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:45.098896 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fb05b924-0df4-4102-bf3f-f0e850b3640a req-b188c6f6-19b7-4928-adaa-3e78d762dbc4 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.13 "DELETE /v2.0/ports/324203bb-e8cc-4392-974c-20b4f2896cc6 HTTP/1.1" status: 204 len: 173 time: 1.1255653 Sep 18 08:39:45.099343 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6cd27eb8-8447-40a0-9229-d59ec6008eeb', 'name': 'network-vif-deleted', 'tag': '324203bb-e8cc-4392-974c-20b4f2896cc6'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:39:45.102063 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-64029c90-5506-4c65-bc9b-3198c0b36592" -d '{"events": [{"server_uuid": "6cd27eb8-8447-40a0-9229-d59ec6008eeb", "name": "network-vif-deleted", "tag": "324203bb-e8cc-4392-974c-20b4f2896cc6"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:39:45.119792 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f1451a00-86a9-4f74-a548-318ac6b7b43c req-7b736aa6-134c-45fb-9815-d9152da8471a tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 210 time: 0.0346148 Sep 18 08:39:45.150772 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6f44f9ce-3e16-4f34-80a3-33252a33b601 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:45.167675 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:39:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6cbe35fd-ae8f-4114-bcd1-8ae22e622674 x-openstack-request-id: req-6cbe35fd-ae8f-4114-bcd1-8ae22e622674 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:39:45.168033 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6cd27eb8-8447-40a0-9229-d59ec6008eeb", "name": "network-vif-deleted", "tag": "324203bb-e8cc-4392-974c-20b4f2896cc6", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:39:45.168442 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-6cbe35fd-ae8f-4114-bcd1-8ae22e622674 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:39:45.168836 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6cd27eb8-8447-40a0-9229-d59ec6008eeb', 'name': 'network-vif-deleted', 'tag': '324203bb-e8cc-4392-974c-20b4f2896cc6', 'status': 'completed', 'code': 200} Sep 18 08:39:45.174506 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6f44f9ce-3e16-4f34-80a3-33252a33b601 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:45.221037 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6f44f9ce-3e16-4f34-80a3-33252a33b601 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:45.223612 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6f44f9ce-3e16-4f34-80a3-33252a33b601 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:45.227539 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-6f44f9ce-3e16-4f34-80a3-33252a33b601 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/8fd1eec0-ddc8-4626-b82f-72bec743c2d2 HTTP/1.1" status: 204 len: 168 time: 0.1445000 Sep 18 08:39:45.233171 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f44f9ce-3e16-4f34-80a3-33252a33b601 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8fd1eec0-ddc8-4626-b82f-72bec743c2d2,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:45.550607 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 57410) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:45.563852 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-fae4fc94-e2d7-4145-82f3-6233d92dde7e admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:45.567882 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeaf79db-6bd6-4806-bcfb-d6c13a57f034 req-9341944a-6de3-42da-b3c2-9bdb4ffa9ffb tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:45.569984 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-aeaf79db-6bd6-4806-bcfb-d6c13a57f034 req-9341944a-6de3-42da-b3c2-9bdb4ffa9ffb tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.0485013 Sep 18 08:39:45.609164 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-aeaf79db-6bd6-4806-bcfb-d6c13a57f034 req-6cbb36ea-107b-412e-bcb6-4e35c7c782cb tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0329456 Sep 18 08:39:45.675726 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-fae4fc94-e2d7-4145-82f3-6233d92dde7e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:45.680597 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-fae4fc94-e2d7-4145-82f3-6233d92dde7e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:45.705608 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2ff80936-d267-4ab5-9f35-d1e0c4db7e41 req-24e903da-fb32-421c-8101-10bc9941ca26 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8949a467-d4ed-449f-be4b-3fe465e79fd7 HTTP/1.1" status: 200 len: 210 time: 0.0305896 Sep 18 08:39:45.723485 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-fae4fc94-e2d7-4145-82f3-6233d92dde7e admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=efa8364d6ec24cad9cba1a0cdad28971&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1695130 Sep 18 08:39:45.724032 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 57420) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:45.726029 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fae4fc94-e2d7-4145-82f3-6233d92dde7e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3b3e7637-a8bc-4d4b-82f6-8723e2b836ba,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:45.774214 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ccf1855c-1bc7-43a3-bfb4-3c357e69b469 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:45.793741 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ccf1855c-1bc7-43a3-bfb4-3c357e69b469 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:45.839738 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ccf1855c-1bc7-43a3-bfb4-3c357e69b469 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:45.842272 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ccf1855c-1bc7-43a3-bfb4-3c357e69b469 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:45.843452 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-ccf1855c-1bc7-43a3-bfb4-3c357e69b469 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/3b3e7637-a8bc-4d4b-82f6-8723e2b836ba HTTP/1.1" status: 204 len: 168 time: 0.1185224 Sep 18 08:39:45.851975 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccf1855c-1bc7-43a3-bfb4-3c357e69b469 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b3e7637-a8bc-4d4b-82f6-8723e2b836ba,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:45.996404 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff46750f-9c3f-47ff-a054-fc9607541b7b req-13716a8c-ec59-49bc-840e-ba56e27fb8c5 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:45.998851 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ff46750f-9c3f-47ff-a054-fc9607541b7b req-13716a8c-ec59-49bc-840e-ba56e27fb8c5 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/ports?device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 950 time: 0.0534894 Sep 18 08:39:46.041979 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ff46750f-9c3f-47ff-a054-fc9607541b7b req-34cc3c72-03d8-49bb-8329-9ae08aecc0f0 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/security-groups?id=32504d5c-b702-4d1a-8d76-e0cd4da86123&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0355296 Sep 18 08:39:46.218188 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-baae16db-4da2-4d5f-9d8d-4166a4ced9fd req-1f16a861-bc02-4250-9552-54acea746879 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 210 time: 0.0262470 Sep 18 08:39:46.732854 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb456de2-13ec-4011-847a-b4a08deff4f4 req-68a0671d-c543-4601-be8b-17270f6fd8eb tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:46.734560 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bb456de2-13ec-4011-847a-b4a08deff4f4 req-68a0671d-c543-4601-be8b-17270f6fd8eb tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.0527723 Sep 18 08:39:46.775438 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bb456de2-13ec-4011-847a-b4a08deff4f4 req-77809f92-6cbf-449c-945d-107d82528f19 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0341504 Sep 18 08:39:46.860364 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d6e2964f-c3a6-4984-a495-133e8961ca0b req-431b4416-c36b-4678-aa9c-3981ad9f7ab0 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8949a467-d4ed-449f-be4b-3fe465e79fd7 HTTP/1.1" status: 200 len: 210 time: 0.0258248 Sep 18 08:39:46.874826 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 57464) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:46.976305 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c150033d-6e50-4f72-90c2-2480516a4d7d admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:47.060900 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c150033d-6e50-4f72-90c2-2480516a4d7d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:47.064584 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c150033d-6e50-4f72-90c2-2480516a4d7d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:47.102495 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-c150033d-6e50-4f72-90c2-2480516a4d7d admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=1912a68ddc5b4415b11a743dcb84981c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2264888 Sep 18 08:39:47.103363 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c150033d-6e50-4f72-90c2-2480516a4d7d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=be786f5e-25ac-4a0d-a7bd-94bad14b1bcf,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:47.105137 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 57470) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:47.188668 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e97c2e1-5713-4e30-ac78-e4b858e6dee5 req-a4d0c0a4-5504-450e-acdb-3a514b292900 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:47.190178 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5e97c2e1-5713-4e30-ac78-e4b858e6dee5 req-a4d0c0a4-5504-450e-acdb-3a514b292900 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/ports?device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 950 time: 0.0819232 Sep 18 08:39:47.192939 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-71500ed8-bf6e-4632-9df7-ea1f93af7f89 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:47.226818 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-71500ed8-bf6e-4632-9df7-ea1f93af7f89 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:47.259463 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5e97c2e1-5713-4e30-ac78-e4b858e6dee5 req-62908082-eef5-4bdf-b40a-50dfb1cd6ad6 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/security-groups?id=32504d5c-b702-4d1a-8d76-e0cd4da86123&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0622089 Sep 18 08:39:47.290349 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-71500ed8-bf6e-4632-9df7-ea1f93af7f89 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:47.292947 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-71500ed8-bf6e-4632-9df7-ea1f93af7f89 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:47.294160 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-71500ed8-bf6e-4632-9df7-ea1f93af7f89 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/be786f5e-25ac-4a0d-a7bd-94bad14b1bcf HTTP/1.1" status: 204 len: 168 time: 0.1872706 Sep 18 08:39:47.302291 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71500ed8-bf6e-4632-9df7-ea1f93af7f89 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=be786f5e-25ac-4a0d-a7bd-94bad14b1bcf,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:47.341829 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a032e86b-5c62-4732-93f8-ca0da01b51ac req-c92f2524-871e-45d2-8cde-45398f38d950 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 210 time: 0.0283415 Sep 18 08:39:47.896135 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b6f798c-c764-4e50-a7ca-5d1c8fb8f246 req-24fcc8ed-5b6b-4b68-ac07-1908417c6939 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:47.897761 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3b6f798c-c764-4e50-a7ca-5d1c8fb8f246 req-24fcc8ed-5b6b-4b68-ac07-1908417c6939 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.0531540 Sep 18 08:39:47.904168 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 57504) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:47.942228 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3b6f798c-c764-4e50-a7ca-5d1c8fb8f246 req-66bd69f1-2379-4cba-8841-a39348f6cd72 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0323474 Sep 18 08:39:48.010472 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-ddfd763d-e1d5-4ebb-8601-97e2f1965232 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-734449530-network', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:39:48.032364 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e369e60f-0a00-492f-9b03-cb0a6ab34012 req-a3e5a089-812d-4a91-9ee0-233b61c9e545 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8949a467-d4ed-449f-be4b-3fe465e79fd7 HTTP/1.1" status: 200 len: 210 time: 0.0362310 Sep 18 08:39:48.050806 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ddfd763d-e1d5-4ebb-8601-97e2f1965232 admin admin] Made reservation on behalf of 467aba0ce03e40a6927a5c05223dd512 for: {'network': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:39:48.053375 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ddfd763d-e1d5-4ebb-8601-97e2f1965232 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for network, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:48.064431 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ddfd763d-e1d5-4ebb-8601-97e2f1965232 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:48.155532 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ddfd763d-e1d5-4ebb-8601-97e2f1965232 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:48.158946 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ddfd763d-e1d5-4ebb-8601-97e2f1965232 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:48.181815 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ddfd763d-e1d5-4ebb-8601-97e2f1965232 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 244} {{(pid=94347) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 18 08:39:48.190168 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddfd763d-e1d5-4ebb-8601-97e2f1965232 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=834c9d2a-6a0b-468c-9d3e-0ea7294a2f55,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:48.196492 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ddfd763d-e1d5-4ebb-8601-97e2f1965232 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:48.196849 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.db.segments_db [None req-ddfd763d-e1d5-4ebb-8601-97e2f1965232 admin admin] Added segment 6dfc82da-1689-40bb-a749-6245f29bfd89 of type vlan for network c81b2232-3aba-4f15-b8f1-a71826c8c1ca Sep 18 08:39:48.235568 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ddfd763d-e1d5-4ebb-8601-97e2f1965232 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732885226527'] for network, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:48.258905 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ddfd763d-e1d5-4ebb-8601-97e2f1965232 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for network, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:48.259923 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ddfd763d-e1d5-4ebb-8601-97e2f1965232 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:48.260515 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ddfd763d-e1d5-4ebb-8601-97e2f1965232 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:48.293074 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-ddfd763d-e1d5-4ebb-8601-97e2f1965232 admin admin] 10.222.0.35 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.3878632 Sep 18 08:39:48.296070 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 57510) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:48.301035 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-44cddaa8-d228-45e1-ab4c-322a4a399c04 admin admin] Request body: {'subnet': {'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-734449530-subnet', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'ip_version': 4}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:39:48.320073 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddfd763d-e1d5-4ebb-8601-97e2f1965232 admin admin] Pushing event updated for resources: {'Network': ['ID=c81b2232-3aba-4f15-b8f1-a71826c8c1ca,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:48.323775 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-44cddaa8-d228-45e1-ab4c-322a4a399c04 admin admin] Made reservation on behalf of 467aba0ce03e40a6927a5c05223dd512 for: {'subnet': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:39:48.326193 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-44cddaa8-d228-45e1-ab4c-322a4a399c04 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14198618'] for subnet, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:48.334067 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Network c81b2232-3aba-4f15-b8f1-a71826c8c1ca details requested by agent ovs-agent-dv-cinder-804470-6-iscsi with host dv-cinder-804470-6-iscsi {{(pid=94348) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 18 08:39:48.389456 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58206987-3326-4ecf-b4f3-f675409ebbe0 req-31e048b7-78c2-4581-a0a7-1256efb6f109 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:48.391010 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-58206987-3326-4ecf-b4f3-f675409ebbe0 req-31e048b7-78c2-4581-a0a7-1256efb6f109 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/ports?device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 950 time: 0.0526853 Sep 18 08:39:48.435801 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-58206987-3326-4ecf-b4f3-f675409ebbe0 req-a250f78b-7ece-4887-b933-3d76eba9a5cd tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/security-groups?id=32504d5c-b702-4d1a-8d76-e0cd4da86123&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0328639 Sep 18 08:39:48.493874 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-44cddaa8-d228-45e1-ab4c-322a4a399c04 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-14290078', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14198644'] for subnet, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:48.519403 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cbcf0110-0bfd-4073-8260-10e353ce8c58 req-a7ad043e-7c30-43d5-8d48-3c39a4d1c564 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 210 time: 0.0274808 Sep 18 08:39:48.544306 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44cddaa8-d228-45e1-ab4c-322a4a399c04 admin admin] Pushing event updated for resources: {'Subnet': ['ID=58e9d53a-333d-4a2f-a575-92c9de3fb737,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:48.558979 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-44cddaa8-d228-45e1-ab4c-322a4a399c04 admin admin] Checking segment: {'id': '6dfc82da-1689-40bb-a749-6245f29bfd89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 244, 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94346) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:39:48.559346 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44cddaa8-d228-45e1-ab4c-322a4a399c04 admin admin] Network hostable DHCP agents. Network: c81b2232-3aba-4f15-b8f1-a71826c8c1ca, hostable agents: ['6aaa6222-6d04-44a7-b807-bfc2cbd3e99f'], hosted agents: [] {{(pid=94346) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 18 08:39:48.575107 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44cddaa8-d228-45e1-ab4c-322a4a399c04 admin admin] Network c81b2232-3aba-4f15-b8f1-a71826c8c1ca is scheduled to be hosted by DHCP agent 6aaa6222-6d04-44a7-b807-bfc2cbd3e99f with binding_index 1 {{(pid=94346) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 18 08:39:48.582926 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-44cddaa8-d228-45e1-ab4c-322a4a399c04 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804470-6-iscsi, c81b2232-3aba-4f15-b8f1-a71826c8c1ca) {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:39:48.586844 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-44cddaa8-d228-45e1-ab4c-322a4a399c04 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:48.587430 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-44cddaa8-d228-45e1-ab4c-322a4a399c04 admin admin] Notify callbacks [] for subnet, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:48.592179 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-61932458-6d4d-486e-9aac-0485928a212f None None] Network c81b2232-3aba-4f15-b8f1-a71826c8c1ca requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:39:48.600718 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-44cddaa8-d228-45e1-ab4c-322a4a399c04 admin admin] 10.222.0.35 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.3034835 Sep 18 08:39:48.603625 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 57514) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:48.607741 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-37e30038-6cbe-4915-a71f-4fb49a35048a admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-734449530-router', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:39:48.627008 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-37e30038-6cbe-4915-a71f-4fb49a35048a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-784001', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2995'] for router, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:48.628160 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-37e30038-6cbe-4915-a71f-4fb49a35048a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-782353', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-784513', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-710924', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2984'] for router, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:48.678723 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-37e30038-6cbe-4915-a71f-4fb49a35048a admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:48.741455 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-68911ab4-6f2b-4162-a1ce-52cae79d29cd None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp22fa9bf9-2738-5c16-87a3-3f58ee5e2dc2-c81b2232-3aba-4f15-b8f1-a71826c8c1ca', 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'fixed_ips': [{'subnet_id': '58e9d53a-333d-4a2f-a575-92c9de3fb737'}]}} from dv-cinder-804470-6-iscsi. {{(pid=94348) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 18 08:39:48.742323 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-68911ab4-6f2b-4162-a1ce-52cae79d29cd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:48.813069 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-37e30038-6cbe-4915-a71f-4fb49a35048a admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:48.816058 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['324203bb-e8cc-4392-974c-20b4f2896cc6'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:39:48.905648 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.db_base_plugin_common [None req-68911ab4-6f2b-4162-a1ce-52cae79d29cd None None] Allocated IP 172.20.0.2 (c81b2232-3aba-4f15-b8f1-a71826c8c1ca/58e9d53a-333d-4a2f-a575-92c9de3fb737/401be85d-dae3-417c-b99c-d0561b3ff92b) {{(pid=94348) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:39:49.024425 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-37e30038-6cbe-4915-a71f-4fb49a35048a admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:49.046098 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-37e30038-6cbe-4915-a71f-4fb49a35048a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:49.062661 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fff7e5f-2a9c-45ec-9caa-414d92d58a08 req-1682f6cd-e1d2-4b10-aa5c-cb023e9b658b tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:49.064221 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0fff7e5f-2a9c-45ec-9caa-414d92d58a08 req-1682f6cd-e1d2-4b10-aa5c-cb023e9b658b tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.0485420 Sep 18 08:39:49.064918 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-68911ab4-6f2b-4162-a1ce-52cae79d29cd None None] Notify callbacks [] for port, precommit_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:49.071623 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-68911ab4-6f2b-4162-a1ce-52cae79d29cd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528'] for port, after_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:49.108847 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0fff7e5f-2a9c-45ec-9caa-414d92d58a08 req-d695e327-6c21-4f58-9a75-105c99f875e8 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0350981 Sep 18 08:39:49.112049 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-68911ab4-6f2b-4162-a1ce-52cae79d29cd None None] Network c81b2232-3aba-4f15-b8f1-a71826c8c1ca is already hosted by enough agents. {{(pid=94348) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:39:49.113404 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.scheduler.base_scheduler [None req-68911ab4-6f2b-4162-a1ce-52cae79d29cd None None] Resources bound (agent type, host, resource id): {{(pid=94348) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:39:49.119317 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68911ab4-6f2b-4162-a1ce-52cae79d29cd None None] Received port after_create {{(pid=94348) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:39:49.128517 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68911ab4-6f2b-4162-a1ce-52cae79d29cd None None] Pushing event updated for resources: {'Port': ['ID=401be85d-dae3-417c-b99c-d0561b3ff92b,revision_number=1']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:49.160420 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_common [None req-37e30038-6cbe-4915-a71f-4fb49a35048a admin admin] Allocated IP 172.27.1.84 (2e3b3f85-63e4-4380-917a-8c90c80b3e38/cd525bb9-7f93-490c-a5d6-a08911817e54/bd096082-b42e-4e6d-a36f-afdc95ef9ae4) {{(pid=94346) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:39:49.178883 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-68911ab4-6f2b-4162-a1ce-52cae79d29cd None None] Attempting to bind port 401be85d-dae3-417c-b99c-d0561b3ff92b on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:39:49.179261 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-68911ab4-6f2b-4162-a1ce-52cae79d29cd None None] Attempting to bind port 401be85d-dae3-417c-b99c-d0561b3ff92b by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': '6dfc82da-1689-40bb-a749-6245f29bfd89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 244, 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca'}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:39:49.179630 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68911ab4-6f2b-4162-a1ce-52cae79d29cd None None] Attempting to bind port 401be85d-dae3-417c-b99c-d0561b3ff92b on network c81b2232-3aba-4f15-b8f1-a71826c8c1ca {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:39:49.189479 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68911ab4-6f2b-4162-a1ce-52cae79d29cd None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 39, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:39:49.190275 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68911ab4-6f2b-4162-a1ce-52cae79d29cd None None] Checking segment: {'id': '6dfc82da-1689-40bb-a749-6245f29bfd89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 244, 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94348) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:39:49.191010 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-68911ab4-6f2b-4162-a1ce-52cae79d29cd None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:49.191411 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-68911ab4-6f2b-4162-a1ce-52cae79d29cd None None] Bound using segment: {'id': '6dfc82da-1689-40bb-a749-6245f29bfd89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 244, 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca'} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:39:49.192161 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-68911ab4-6f2b-4162-a1ce-52cae79d29cd None None] Bound port: 401be85d-dae3-417c-b99c-d0561b3ff92b, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6dfc82da-1689-40bb-a749-6245f29bfd89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 244, 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca'}}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:39:49.192552 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-68911ab4-6f2b-4162-a1ce-52cae79d29cd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:49.212581 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-21e8e343-d455-44f5-84cc-6f57faa5c446 req-a6d65fc3-9f7e-41bb-ad1f-256314a91a64 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8949a467-d4ed-449f-be4b-3fe465e79fd7 HTTP/1.1" status: 200 len: 210 time: 0.0303338 Sep 18 08:39:49.241470 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-f7e7d25e-101b-450d-bb87-d300e37bbf62 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Request body: {'port': {'device_id': '8949a467-d4ed-449f-be4b-3fe465e79fd7', 'network_id': '5e2d06a6-7f04-4134-8004-d5639986c75e', 'admin_state_up': True, 'tenant_id': 'fb9519a4056a4e2ebbe5200ff83d0a1e'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:39:49.270831 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-68911ab4-6f2b-4162-a1ce-52cae79d29cd None None] For port 401be85d-dae3-417c-b99c-d0561b3ff92b, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94348) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:39:49.275779 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-68911ab4-6f2b-4162-a1ce-52cae79d29cd None None] For port 401be85d-dae3-417c-b99c-d0561b3ff92b, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=401be85d-dae3-417c-b99c-d0561b3ff92b,segment=NetworkSegment(6dfc82da-1689-40bb-a749-6245f29bfd89),segment_id=6dfc82da-1689-40bb-a749-6245f29bfd89)] {{(pid=94348) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:39:49.280632 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-37e30038-6cbe-4915-a71f-4fb49a35048a admin admin] Notify callbacks [] for port, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:49.281358 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-68911ab4-6f2b-4162-a1ce-52cae79d29cd None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:49.319266 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-37e30038-6cbe-4915-a71f-4fb49a35048a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:49.349069 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68911ab4-6f2b-4162-a1ce-52cae79d29cd None None] Pushing event updated for resources: {'Port': ['ID=401be85d-dae3-417c-b99c-d0561b3ff92b,revision_number=2']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:49.363337 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0337d402-8c3b-47bc-bc42-88bfd234e10f req-a424b9fb-680b-414c-8e83-41e225db522c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:49.365012 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0337d402-8c3b-47bc-bc42-88bfd234e10f req-a424b9fb-680b-414c-8e83-41e225db522c service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 1103 time: 0.0913761 Sep 18 08:39:49.366694 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-37e30038-6cbe-4915-a71f-4fb49a35048a admin admin] Network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:39:49.371574 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-37e30038-6cbe-4915-a71f-4fb49a35048a admin admin] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:39:49.375878 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [None req-37e30038-6cbe-4915-a71f-4fb49a35048a admin admin] Received port after_create {{(pid=94346) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:39:49.378818 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37e30038-6cbe-4915-a71f-4fb49a35048a admin admin] Pushing event updated for resources: {'Port': ['ID=bd096082-b42e-4e6d-a36f-afdc95ef9ae4,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:49.437770 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0337d402-8c3b-47bc-bc42-88bfd234e10f req-8dfc13e1-3b97-4aa3-8b9a-cbdcec86a365 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=32504d5c-b702-4d1a-8d76-e0cd4da86123&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486262 Sep 18 08:39:49.445668 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-f7e7d25e-101b-450d-bb87-d300e37bbf62 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Made reservation on behalf of fb9519a4056a4e2ebbe5200ff83d0a1e for: {'port': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:39:49.449457 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-f7e7d25e-101b-450d-bb87-d300e37bbf62 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:49.618176 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-9f6b11bf-d993-4650-a882-d4e9b504e08f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:49.652806 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01dda928-6b10-4093-bd7f-0c8ad95d54e2 req-2600b1b1-cea0-4f47-a449-27284571b3c3 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:49.654521 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-01dda928-6b10-4093-bd7f-0c8ad95d54e2 req-2600b1b1-cea0-4f47-a449-27284571b3c3 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/ports?device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 950 time: 0.1448069 Sep 18 08:39:49.688438 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_common [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-f7e7d25e-101b-450d-bb87-d300e37bbf62 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Allocated IP 172.20.0.12 (5e2d06a6-7f04-4134-8004-d5639986c75e/10680649-3557-49d0-9377-0d9cdb4efe69/b7ffb91b-4d87-4a7b-9de9-7e947fb6d687) {{(pid=94347) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:39:49.695642 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-37e30038-6cbe-4915-a71f-4fb49a35048a admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:49.717972 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5967b20c-3217-4092-b1a0-65c9ebc69204 req-c42e9d37-6289-4bf6-9f03-ce36ff317910 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 210 time: 0.0558689 Sep 18 08:39:49.757967 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-01dda928-6b10-4093-bd7f-0c8ad95d54e2 req-c322bca9-2e31-46db-89d4-520b6919c3ba tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/security-groups?id=32504d5c-b702-4d1a-8d76-e0cd4da86123&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0968761 Sep 18 08:39:49.876650 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:49.901980 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-f7e7d25e-101b-450d-bb87-d300e37bbf62 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Notify callbacks [] for port, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:49.942561 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-f7e7d25e-101b-450d-bb87-d300e37bbf62 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:50.005803 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-f7e7d25e-101b-450d-bb87-d300e37bbf62 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Network 5e2d06a6-7f04-4134-8004-d5639986c75e is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:39:50.009337 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-f7e7d25e-101b-450d-bb87-d300e37bbf62 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:39:50.024423 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-f7e7d25e-101b-450d-bb87-d300e37bbf62 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Received port after_create {{(pid=94347) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:39:50.055109 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7e7d25e-101b-450d-bb87-d300e37bbf62 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Pushing event updated for resources: {'Port': ['ID=b7ffb91b-4d87-4a7b-9de9-7e947fb6d687,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:50.093983 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-f7e7d25e-101b-450d-bb87-d300e37bbf62 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:50.095007 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-f7e7d25e-101b-450d-bb87-d300e37bbf62 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:50.113455 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-f7e7d25e-101b-450d-bb87-d300e37bbf62 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8775110 Sep 18 08:39:50.135988 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-590a155e-1fbc-4e22-b34a-b000701332d4 service neutron] Request body: {'port': {'device_id': '8949a467-d4ed-449f-be4b-3fe465e79fd7', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80447'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:39:50.157886 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-37e30038-6cbe-4915-a71f-4fb49a35048a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-782366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-784982'] for router, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:50.199138 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-590a155e-1fbc-4e22-b34a-b000701332d4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:50.358958 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-37e30038-6cbe-4915-a71f-4fb49a35048a admin admin] Router d221b587-201f-4923-926d-02481e296d23 is scheduled to L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a with binding_index 1 {{(pid=94346) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 18 08:39:50.443433 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c8488e1-5089-4105-8772-a2557fe9cbed req-7d19aff3-5fd8-4860-a15c-e36db1b9cd2a tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:50.445573 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9c8488e1-5089-4105-8772-a2557fe9cbed req-7d19aff3-5fd8-4860-a15c-e36db1b9cd2a tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.2439203 Sep 18 08:39:50.486199 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22aa975e-b475-4de2-add3-a6a9555c91d7 req-4ea024e3-c9ab-4dd2-83f8-675e32f4a9f9 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:50.487753 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-22aa975e-b475-4de2-add3-a6a9555c91d7 req-4ea024e3-c9ab-4dd2-83f8-675e32f4a9f9 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8949a467-d4ed-449f-be4b-3fe465e79fd7 HTTP/1.1" status: 200 len: 932 time: 0.1267221 Sep 18 08:39:50.520526 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-49b9e343-f936-479d-8748-430407a8065c None None] Network c81b2232-3aba-4f15-b8f1-a71826c8c1ca requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:39:50.526881 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-37e30038-6cbe-4915-a71f-4fb49a35048a admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94346) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:39:50.540498 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] Sync routers for ids ['d221b587-201f-4923-926d-02481e296d23'] in dv-cinder-804470-6-iscsi {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:39:50.557923 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-37e30038-6cbe-4915-a71f-4fb49a35048a admin admin] Notify callbacks [] for router, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:50.558233 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] Routers {'d221b587-201f-4923-926d-02481e296d23'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:39:50.559114 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:39:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['d221b587-201f-4923-926d-02481e296d23'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:39:50.562631 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-37e30038-6cbe-4915-a71f-4fb49a35048a admin admin] 10.222.0.35 "POST /v2.0/routers HTTP/1.1" status: 201 len: 919 time: 1.9553752 Sep 18 08:39:50.562912 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 57560) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:50.577662 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9c8488e1-5089-4105-8772-a2557fe9cbed req-b4851362-1c6c-4b29-9ef8-bf5ef5233acf tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1202633 Sep 18 08:39:50.595484 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-22aa975e-b475-4de2-add3-a6a9555c91d7 req-c87090ea-abde-4e33-8a36-e05e2b9c85a1 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0950952 Sep 18 08:39:50.677187 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-60b7edd6-327b-463d-9545-f5e9ff4c23ce None None] Provisioning complete for port 401be85d-dae3-417c-b99c-d0561b3ff92b triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:39:50.679062 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-60b7edd6-327b-463d-9545-f5e9ff4c23ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:50.704042 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-590a155e-1fbc-4e22-b34a-b000701332d4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b7ffb91b-4d87-4a7b-9de9-7e947fb6d687 {{(pid=94347) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:39:50.716137 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-590a155e-1fbc-4e22-b34a-b000701332d4 service neutron] Notify callbacks [] for port, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:50.739320 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.provisioning_blocks [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-590a155e-1fbc-4e22-b34a-b000701332d4 service neutron] Transition to ACTIVE for port object b7ffb91b-4d87-4a7b-9de9-7e947fb6d687 will not be triggered until provisioned by entity L2. {{(pid=94347) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 18 08:39:50.747899 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-590a155e-1fbc-4e22-b34a-b000701332d4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:50.757679 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] Set router d221b587-201f-4923-926d-02481e296d23 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:39:50.797031 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 324203bb-e8cc-4392-974c-20b4f2896cc6 no longer exists at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:39:50.824835 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] No Port match for: 324203bb-e8cc-4392-974c-20b4f2896cc6 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:39:50.825188 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 324203bb-e8cc-4392-974c-20b4f2896cc6 not bound to the agent host hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:39:50.842386 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-60b7edd6-327b-463d-9545-f5e9ff4c23ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:50.868862 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-590a155e-1fbc-4e22-b34a-b000701332d4 service neutron] Pushing event updated for resources: {'Port': ['ID=b7ffb91b-4d87-4a7b-9de9-7e947fb6d687,revision_number=2']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:50.938771 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-60b7edd6-327b-463d-9545-f5e9ff4c23ce None None] For port 401be85d-dae3-417c-b99c-d0561b3ff92b, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=401be85d-dae3-417c-b99c-d0561b3ff92b,segment=NetworkSegment(6dfc82da-1689-40bb-a749-6245f29bfd89),segment_id=6dfc82da-1689-40bb-a749-6245f29bfd89)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:39:50.946865 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-60b7edd6-327b-463d-9545-f5e9ff4c23ce None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:51.025565 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60b7edd6-327b-463d-9545-f5e9ff4c23ce None None] Pushing event updated for resources: {'Port': ['ID=401be85d-dae3-417c-b99c-d0561b3ff92b,revision_number=3']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:51.062444 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd221b587-201f-4923-926d-02481e296d23', 'name': 'tempest-TestShelveInstance-734449530-router', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.84'}], 'enable_snat': True}, 'gw_port_id': 'bd096082-b42e-4e6d-a36f-afdc95ef9ae4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:39:48Z', 'updated_at': '2021-09-18T08:39:49Z', 'revision_number': 3, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'gw_port': {'id': 'bd096082-b42e-4e6d-a36f-afdc95ef9ae4', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:ed:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd221b587-201f-4923-926d-02481e296d23', 'device_owner': 'network:router_gateway', 'standard_attr_id': 303, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:49Z', 'updated_at': '2021-09-18T08:39:49Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:39:51.081535 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3a667b65-67fb-4870-9d27-931e12830380 req-087b1ffd-e0fc-4677-9a00-2807a667bdc1 tempest-DeleteServersTestJSON-1529020961 tempest-DeleteServersTestJSON-1529020961-project] 10.222.0.35 "GET /v2.0/ports?device_id=6cd27eb8-8447-40a0-9229-d59ec6008eeb HTTP/1.1" status: 200 len: 210 time: 0.1425469 Sep 18 08:39:51.102452 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] Checking router: d221b587-201f-4923-926d-02481e296d23 for host: dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:39:51.102859 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] Updating router d221b587-201f-4923-926d-02481e296d23 port bd096082-b42e-4e6d-a36f-afdc95ef9ae4 binding host dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 18 08:39:51.118497 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-590a155e-1fbc-4e22-b34a-b000701332d4 service neutron] Attempting to bind port b7ffb91b-4d87-4a7b-9de9-7e947fb6d687 on host hv-cinder-80447 for vnic_type normal with profile {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:39:51.119460 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-590a155e-1fbc-4e22-b34a-b000701332d4 service neutron] Attempting to bind port b7ffb91b-4d87-4a7b-9de9-7e947fb6d687 by drivers openvswitch,hyperv on host hv-cinder-80447 at level 0 using segments [{'id': '4f8dffb0-f8d4-41b5-beed-53bcf370cb42', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 213, 'network_id': '5e2d06a6-7f04-4134-8004-d5639986c75e'}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:39:51.119946 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-590a155e-1fbc-4e22-b34a-b000701332d4 service neutron] Attempting to bind port b7ffb91b-4d87-4a7b-9de9-7e947fb6d687 on network 5e2d06a6-7f04-4134-8004-d5639986c75e {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:39:51.126773 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-590a155e-1fbc-4e22-b34a-b000701332d4 service neutron] Port b7ffb91b-4d87-4a7b-9de9-7e947fb6d687 on network 5e2d06a6-7f04-4134-8004-d5639986c75e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80447 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 18 08:39:51.127154 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-590a155e-1fbc-4e22-b34a-b000701332d4 service neutron] Attempting to bind port b7ffb91b-4d87-4a7b-9de9-7e947fb6d687 on network 5e2d06a6-7f04-4134-8004-d5639986c75e {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:39:51.135433 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-590a155e-1fbc-4e22-b34a-b000701332d4 service neutron] Checking agent: {'id': '8d51fdc4-974b-4200-9c3f-5dddea60a869', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80447', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'started_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 39, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:39:51.136334 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-590a155e-1fbc-4e22-b34a-b000701332d4 service neutron] Checking segment: {'id': '4f8dffb0-f8d4-41b5-beed-53bcf370cb42', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 213, 'network_id': '5e2d06a6-7f04-4134-8004-d5639986c75e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94347) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:39:51.136736 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-590a155e-1fbc-4e22-b34a-b000701332d4 service neutron] Bound using segment: {'id': '4f8dffb0-f8d4-41b5-beed-53bcf370cb42', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 213, 'network_id': '5e2d06a6-7f04-4134-8004-d5639986c75e'} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:39:51.137337 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-590a155e-1fbc-4e22-b34a-b000701332d4 service neutron] Bound port: b7ffb91b-4d87-4a7b-9de9-7e947fb6d687, host: hv-cinder-80447, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '4f8dffb0-f8d4-41b5-beed-53bcf370cb42', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 213, 'network_id': '5e2d06a6-7f04-4134-8004-d5639986c75e'}}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:39:51.137697 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-590a155e-1fbc-4e22-b34a-b000701332d4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:51.146919 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e554ccfd-9aff-42f1-b14c-ab0456e18b3d req-b8806d90-7ab8-4ad7-b06b-9578a0901478 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:51.148261 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:51.154884 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e554ccfd-9aff-42f1-b14c-ab0456e18b3d req-b8806d90-7ab8-4ad7-b06b-9578a0901478 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/ports?device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 950 time: 0.1230087 Sep 18 08:39:51.241908 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e554ccfd-9aff-42f1-b14c-ab0456e18b3d req-e206560c-d8aa-4b9b-a0a1-cd54b6452a88 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/security-groups?id=32504d5c-b702-4d1a-8d76-e0cd4da86123&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0860438 Sep 18 08:39:51.264206 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-829b2190-c256-4ad5-9618-e3056a9806f4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:51.278215 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-590a155e-1fbc-4e22-b34a-b000701332d4 service neutron] For port b7ffb91b-4d87-4a7b-9de9-7e947fb6d687, host hv-cinder-80447, cleared binding levels {{(pid=94347) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:39:51.281880 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-590a155e-1fbc-4e22-b34a-b000701332d4 service neutron] For port b7ffb91b-4d87-4a7b-9de9-7e947fb6d687, host hv-cinder-80447, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=b7ffb91b-4d87-4a7b-9de9-7e947fb6d687,segment=NetworkSegment(4f8dffb0-f8d4-41b5-beed-53bcf370cb42),segment_id=4f8dffb0-f8d4-41b5-beed-53bcf370cb42)] {{(pid=94347) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:39:51.290514 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-590a155e-1fbc-4e22-b34a-b000701332d4 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:51.333044 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-590a155e-1fbc-4e22-b34a-b000701332d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:51.334027 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-590a155e-1fbc-4e22-b34a-b000701332d4 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:51.335455 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-590a155e-1fbc-4e22-b34a-b000701332d4 service neutron] 10.222.0.13 "PUT /v2.0/ports/b7ffb91b-4d87-4a7b-9de9-7e947fb6d687 HTTP/1.1" status: 200 len: 1094 time: 1.2052186 Sep 18 08:39:51.335890 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8949a467-d4ed-449f-be4b-3fe465e79fd7', 'tag': 'b7ffb91b-4d87-4a7b-9de9-7e947fb6d687'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:39:51.338801 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6b03bbaa-6de8-4b94-a641-7d8ab8a67411" -d '{"events": [{"name": "network-changed", "server_uuid": "8949a467-d4ed-449f-be4b-3fe465e79fd7", "tag": "b7ffb91b-4d87-4a7b-9de9-7e947fb6d687"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:39:51.375722 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-63f92e69-6d79-4be3-8f6a-938f96c4fbc4 None None] Provisioning complete for port 401be85d-dae3-417c-b99c-d0561b3ff92b triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:39:51.376339 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-63f92e69-6d79-4be3-8f6a-938f96c4fbc4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:51.380788 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-590a155e-1fbc-4e22-b34a-b000701332d4 service neutron] Pushing event updated for resources: {'Port': ['ID=b7ffb91b-4d87-4a7b-9de9-7e947fb6d687,revision_number=3']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:51.409564 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:39:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fc8bd92b-4d4c-422b-b1e1-3e0b5ed0b35e x-openstack-request-id: req-fc8bd92b-4d4c-422b-b1e1-3e0b5ed0b35e {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:39:51.409923 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8949a467-d4ed-449f-be4b-3fe465e79fd7", "tag": "b7ffb91b-4d87-4a7b-9de9-7e947fb6d687", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:39:51.410240 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-fc8bd92b-4d4c-422b-b1e1-3e0b5ed0b35e {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:39:51.410730 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8949a467-d4ed-449f-be4b-3fe465e79fd7', 'tag': 'b7ffb91b-4d87-4a7b-9de9-7e947fb6d687', 'status': 'completed', 'code': 200} Sep 18 08:39:51.464006 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 401be85d-dae3-417c-b99c-d0561b3ff92b up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:39:51.529533 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] Notify callbacks [] for port, precommit_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:51.533302 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_common [None req-829b2190-c256-4ad5-9618-e3056a9806f4 admin admin] Allocated IP 172.20.0.1 (c81b2232-3aba-4f15-b8f1-a71826c8c1ca/58e9d53a-333d-4a2f-a575-92c9de3fb737/23821731-be27-4d6b-834b-f6953b4d873a) {{(pid=94346) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:39:51.540251 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 401be85d-dae3-417c-b99c-d0561b3ff92b triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:39:51.540761 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:51.542322 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:51.579848 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b03bbaa-6de8-4b94-a641-7d8ab8a67411 req-6379a4ce-8871-4425-be0d-e9591f5efd0c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:51.582862 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6b03bbaa-6de8-4b94-a641-7d8ab8a67411 req-6379a4ce-8871-4425-be0d-e9591f5efd0c service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=fb9519a4056a4e2ebbe5200ff83d0a1e&device_id=8949a467-d4ed-449f-be4b-3fe465e79fd7 HTTP/1.1" status: 200 len: 1097 time: 0.0647106 Sep 18 08:39:51.679732 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd1f2751-4f75-477b-a3b2-70fdf095069c None None] Pushing event updated for resources: {'Port': ['ID=bd096082-b42e-4e6d-a36f-afdc95ef9ae4,revision_number=2']} {{(pid=94349) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:51.699902 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] Attempting to bind port bd096082-b42e-4e6d-a36f-afdc95ef9ae4 on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:39:51.703466 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] Attempting to bind port bd096082-b42e-4e6d-a36f-afdc95ef9ae4 by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}] {{(pid=94349) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:39:51.704084 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] Attempting to bind port bd096082-b42e-4e6d-a36f-afdc95ef9ae4 on network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:39:51.719394 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-829b2190-c256-4ad5-9618-e3056a9806f4 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:51.721853 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd1f2751-4f75-477b-a3b2-70fdf095069c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:51.722248 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd1f2751-4f75-477b-a3b2-70fdf095069c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:51.722610 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd1f2751-4f75-477b-a3b2-70fdf095069c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:51.722960 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd1f2751-4f75-477b-a3b2-70fdf095069c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:51.723327 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd1f2751-4f75-477b-a3b2-70fdf095069c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:51.723827 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd1f2751-4f75-477b-a3b2-70fdf095069c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:51.724181 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd1f2751-4f75-477b-a3b2-70fdf095069c None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:51.725406 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd1f2751-4f75-477b-a3b2-70fdf095069c None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:51.725787 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd1f2751-4f75-477b-a3b2-70fdf095069c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:51.726139 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd1f2751-4f75-477b-a3b2-70fdf095069c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:51.726486 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd1f2751-4f75-477b-a3b2-70fdf095069c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:51.731959 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cd1f2751-4f75-477b-a3b2-70fdf095069c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:39:51.739013 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 39, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:39:51.739411 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] Checking segment: {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94349) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:39:51.739829 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:51.741193 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] Bound using segment: {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'} {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:39:51.741322 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] Bound port: bd096082-b42e-4e6d-a36f-afdc95ef9ae4, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}}] {{(pid=94349) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:39:51.741727 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:51.778616 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-829b2190-c256-4ad5-9618-e3056a9806f4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:51.809583 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.db [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] For port bd096082-b42e-4e6d-a36f-afdc95ef9ae4, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94349) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:39:51.816879 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.db [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] For port bd096082-b42e-4e6d-a36f-afdc95ef9ae4, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=bd096082-b42e-4e6d-a36f-afdc95ef9ae4,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94349) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:39:51.824137 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:51.827188 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-829b2190-c256-4ad5-9618-e3056a9806f4 admin admin] Network c81b2232-3aba-4f15-b8f1-a71826c8c1ca is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:39:51.832078 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-829b2190-c256-4ad5-9618-e3056a9806f4 admin admin] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:39:51.835115 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b03bbaa-6de8-4b94-a641-7d8ab8a67411 req-b12ecfe2-2e57-421c-b0f7-c756d235ef24 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:51.836022 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [None req-829b2190-c256-4ad5-9618-e3056a9806f4 admin admin] Received port after_create {{(pid=94346) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:39:51.836611 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6b03bbaa-6de8-4b94-a641-7d8ab8a67411 req-b12ecfe2-2e57-421c-b0f7-c756d235ef24 service neutron] 10.222.0.13 "GET /v2.0/networks?tenant_id=fb9519a4056a4e2ebbe5200ff83d0a1e&shared=False HTTP/1.1" status: 200 len: 909 time: 0.2308583 Sep 18 08:39:51.876819 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-829b2190-c256-4ad5-9618-e3056a9806f4 admin admin] Pushing event updated for resources: {'Port': ['ID=23821731-be27-4d6b-834b-f6953b4d873a,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:51.887830 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-829b2190-c256-4ad5-9618-e3056a9806f4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-785025'] for router_interface, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:51.900644 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] Routers {'d221b587-201f-4923-926d-02481e296d23'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:39:51.902151 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:39:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['d221b587-201f-4923-926d-02481e296d23'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:39:51.908027 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a34728ad-9f33-4b39-b518-fbc1fdf8dba6 req-df70bd0f-72ff-43fa-a615-c78f715a2818 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:51.909577 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a34728ad-9f33-4b39-b518-fbc1fdf8dba6 req-df70bd0f-72ff-43fa-a615-c78f715a2818 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8949a467-d4ed-449f-be4b-3fe465e79fd7 HTTP/1.1" status: 200 len: 944 time: 0.1537886 Sep 18 08:39:51.919926 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ee59882-9040-4992-be0d-5954022c625c req-004c87e6-9698-4c71-868a-b162bba8f3a1 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:51.921504 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7ee59882-9040-4992-be0d-5954022c625c req-004c87e6-9698-4c71-868a-b162bba8f3a1 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.1640911 Sep 18 08:39:51.969353 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd1f2751-4f75-477b-a3b2-70fdf095069c None None] Pushing event updated for resources: {'Port': ['ID=bd096082-b42e-4e6d-a36f-afdc95ef9ae4,revision_number=3']} {{(pid=94349) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:52.044188 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7ee59882-9040-4992-be0d-5954022c625c req-a471ae34-7394-4d18-aacd-48fe9f65bdf8 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1031549 Sep 18 08:39:52.086926 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a34728ad-9f33-4b39-b518-fbc1fdf8dba6 req-75cee09c-4ee2-45f1-bf96-82df992f5282 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1580150 Sep 18 08:39:52.120884 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] Set router d221b587-201f-4923-926d-02481e296d23 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:39:52.134765 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b03bbaa-6de8-4b94-a641-7d8ab8a67411 req-35e0d0b4-415e-4941-a1b3-fd074c09959c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:52.136175 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6b03bbaa-6de8-4b94-a641-7d8ab8a67411 req-35e0d0b4-415e-4941-a1b3-fd074c09959c service neutron] 10.222.0.13 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2863426 Sep 18 08:39:52.147111 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-1540f986-51cc-49c8-aa8f-d98234742534 None None] Provisioning complete for port 23821731-be27-4d6b-834b-f6953b4d873a triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:39:52.147674 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-1540f986-51cc-49c8-aa8f-d98234742534 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:52.204243 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-1540f986-51cc-49c8-aa8f-d98234742534 None None] Port 23821731-be27-4d6b-834b-f6953b4d873a cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:39:52.207008 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-829b2190-c256-4ad5-9618-e3056a9806f4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:52.417818 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-164fa545-9945-4ae2-8fed-da8cc93ffa9b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:52.425339 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-0495fbd4-b1a5-4bcc-b758-ee39ca12ac2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:52.427072 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-0495fbd4-b1a5-4bcc-b758-ee39ca12ac2a service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=fb9519a4056a4e2ebbe5200ff83d0a1e&device_id=8949a467-d4ed-449f-be4b-3fe465e79fd7 HTTP/1.1" status: 200 len: 1097 time: 0.1486557 Sep 18 08:39:52.465125 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-829b2190-c256-4ad5-9618-e3056a9806f4 admin admin] Notify callbacks [] for port, precommit_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:52.472165 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-829b2190-c256-4ad5-9618-e3056a9806f4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14290155'] for port, after_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:52.482884 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-a9eebd54-5a99-4b3d-ba86-5d9a08521f7c service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=b7ffb91b-4d87-4a7b-9de9-7e947fb6d687 HTTP/1.1" status: 200 len: 217 time: 0.0388715 Sep 18 08:39:52.501232 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c715eb3-9be7-45cb-8efe-f9322403b312 req-be54165e-95e1-49bf-80ff-f98d46886d03 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:52.501232 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4c715eb3-9be7-45cb-8efe-f9322403b312 req-be54165e-95e1-49bf-80ff-f98d46886d03 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/ports?device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 950 time: 0.1553378 Sep 18 08:39:52.545741 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd221b587-201f-4923-926d-02481e296d23', 'name': 'tempest-TestShelveInstance-734449530-router', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.84'}], 'enable_snat': True}, 'gw_port_id': 'bd096082-b42e-4e6d-a36f-afdc95ef9ae4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:39:48Z', 'updated_at': '2021-09-18T08:39:49Z', 'revision_number': 3, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'gw_port': {'id': 'bd096082-b42e-4e6d-a36f-afdc95ef9ae4', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:ed:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd221b587-201f-4923-926d-02481e296d23', 'device_owner': 'network:router_gateway', 'standard_attr_id': 303, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:49Z', 'updated_at': '2021-09-18T08:39:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:39:52.547920 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-829b2190-c256-4ad5-9618-e3056a9806f4 admin admin] Pushing event updated for resources: {'Port': ['ID=23821731-be27-4d6b-834b-f6953b4d873a,revision_number=2']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:52.559935 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-829b2190-c256-4ad5-9618-e3056a9806f4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-580051', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-783377'] for router_interface, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:52.586956 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ced86321-cff8-4642-9dfb-7557cd91e120 None None] The sync data for ids ['d221b587-201f-4923-926d-02481e296d23'] in dv-cinder-804470-6-iscsi is: [{'id': 'd221b587-201f-4923-926d-02481e296d23', 'name': 'tempest-TestShelveInstance-734449530-router', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.84'}], 'enable_snat': True}, 'gw_port_id': 'bd096082-b42e-4e6d-a36f-afdc95ef9ae4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:39:48Z', 'updated_at': '2021-09-18T08:39:49Z', 'revision_number': 3, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'gw_port': {'id': 'bd096082-b42e-4e6d-a36f-afdc95ef9ae4', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:ed:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd221b587-201f-4923-926d-02481e296d23', 'device_owner': 'network:router_gateway', 'standard_attr_id': 303, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:49Z', 'updated_at': '2021-09-18T08:39:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}] {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:39:52.624783 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4c715eb3-9be7-45cb-8efe-f9322403b312 req-c6d146e1-25da-4edc-af59-84aa320676a1 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/security-groups?id=32504d5c-b702-4d1a-8d76-e0cd4da86123&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1250048 Sep 18 08:39:52.661314 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-166efda5-7464-41a0-8c32-907df5ce663c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:52.662926 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-166efda5-7464-41a0-8c32-907df5ce663c service neutron] 10.222.0.13 "GET /v2.0/subnets?id=10680649-3557-49d0-9377-0d9cdb4efe69 HTTP/1.1" status: 200 len: 848 time: 0.1214812 Sep 18 08:39:52.687023 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-829b2190-c256-4ad5-9618-e3056a9806f4 admin admin] Network c81b2232-3aba-4f15-b8f1-a71826c8c1ca is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:39:52.688432 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-829b2190-c256-4ad5-9618-e3056a9806f4 admin admin] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:39:52.743669 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-7ad973cf-f60a-413a-ba9c-4821477306e7 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=5e2d06a6-7f04-4134-8004-d5639986c75e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0723886 Sep 18 08:39:52.803466 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-341627b2-ad48-4237-9b30-2316470ac233 req-2a92d971-f33c-44b8-9117-23c0ec994b3f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:52.805169 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-341627b2-ad48-4237-9b30-2316470ac233 req-2a92d971-f33c-44b8-9117-23c0ec994b3f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/networks?id=fe2753d3-7f3b-4739-adbf-6643a840c73e HTTP/1.1" status: 200 len: 815 time: 0.2055550 Sep 18 08:39:52.847752 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-829b2190-c256-4ad5-9618-e3056a9806f4 admin admin] Router d221b587-201f-4923-926d-02481e296d23 has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94346) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:39:52.884929 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-341627b2-ad48-4237-9b30-2316470ac233 req-79283189-2fe4-4912-bcb3-bd4832408714 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/quotas/38bd82e43ad3497aa14e8e4e68a29009 HTTP/1.1" status: 200 len: 375 time: 0.0690396 Sep 18 08:39:53.017586 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-fa9fd256-12a7-439c-84e9-516569f5efa0 service neutron] 10.222.0.13 "GET /v2.0/networks/5e2d06a6-7f04-4134-8004-d5639986c75e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2540455 Sep 18 08:39:53.033412 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-829b2190-c256-4ad5-9618-e3056a9806f4 admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94346) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:39:53.049110 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-829b2190-c256-4ad5-9618-e3056a9806f4 admin admin] 10.222.0.35 "PUT /v2.0/routers/d221b587-201f-4923-926d-02481e296d23/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4772618 Sep 18 08:39:53.049509 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-341627b2-ad48-4237-9b30-2316470ac233 req-479835b6-6fb1-431a-b90c-02845b042166 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?tenant_id=38bd82e43ad3497aa14e8e4e68a29009&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1443307 Sep 18 08:39:53.059413 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-5354c766-1c52-4b02-9033-bcd4ee2caaf3 None None] Provisioning complete for port 23821731-be27-4d6b-834b-f6953b4d873a triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:39:53.060723 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-5354c766-1c52-4b02-9033-bcd4ee2caaf3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:53.120974 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-5354c766-1c52-4b02-9033-bcd4ee2caaf3 None None] Port 23821731-be27-4d6b-834b-f6953b4d873a cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:39:53.167776 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-208357d7-dd30-4b03-8414-d36e6c429e25 req-6d73b302-1e73-45ab-84cc-64da272ffc05 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:53.169396 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-208357d7-dd30-4b03-8414-d36e6c429e25 req-6d73b302-1e73-45ab-84cc-64da272ffc05 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/ports?device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 950 time: 0.1972060 Sep 18 08:39:53.196381 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:53.273241 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d58a5767-0039-4c8d-97a2-6d8db9dda647 req-a9a416e9-f151-4910-90f9-71529f79b006 service neutron] 10.222.0.13 "GET /v2.0/networks/5e2d06a6-7f04-4134-8004-d5639986c75e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2447910 Sep 18 08:39:53.303468 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-208357d7-dd30-4b03-8414-d36e6c429e25 req-e1b6a20f-26b1-474b-9672-1cdfcd9bd4c6 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/security-groups?id=32504d5c-b702-4d1a-8d76-e0cd4da86123&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1166408 Sep 18 08:39:53.345743 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:53.348644 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-341627b2-ad48-4237-9b30-2316470ac233 req-0327944a-674f-436c-8161-97d2041acf03 service neutron] 10.222.0.35 "GET /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2107189 Sep 18 08:39:53.449204 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device bd096082-b42e-4e6d-a36f-afdc95ef9ae4 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:39:53.533047 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port bd096082-b42e-4e6d-a36f-afdc95ef9ae4 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:39:53.533465 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:53.544112 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-341627b2-ad48-4237-9b30-2316470ac233 req-a9a97589-0b38-4bf0-ba43-3c25422425f3 service neutron] 10.222.0.35 "GET /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1856196 Sep 18 08:39:53.551952 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caa8e29f-1693-4720-9578-3d6cf7fd07ca req-4b13cd6e-1a9b-4388-a3ca-723481fe7c1f tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:53.553977 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-caa8e29f-1693-4720-9578-3d6cf7fd07ca req-4b13cd6e-1a9b-4388-a3ca-723481fe7c1f tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.1334226 Sep 18 08:39:53.618056 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-caa8e29f-1693-4720-9578-3d6cf7fd07ca req-81b03a2a-619f-4c04-9bf4-aa3a45153f98 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0572371 Sep 18 08:39:53.702608 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:53.736259 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-536c997d-2873-442a-81bf-9fe918803742 None None] For port bd096082-b42e-4e6d-a36f-afdc95ef9ae4, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=bd096082-b42e-4e6d-a36f-afdc95ef9ae4,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:39:53.742669 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:53.805041 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfe8452a-510b-433d-9a5d-9430d6cbcc66 req-05af60ea-1631-4f4e-bd1b-431b71e6a9f7 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:53.811349 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dfe8452a-510b-433d-9a5d-9430d6cbcc66 req-05af60ea-1631-4f4e-bd1b-431b71e6a9f7 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8949a467-d4ed-449f-be4b-3fe465e79fd7 HTTP/1.1" status: 200 len: 944 time: 0.0942204 Sep 18 08:39:53.828633 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 57672) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:53.835652 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Pushing event updated for resources: {'Port': ['ID=bd096082-b42e-4e6d-a36f-afdc95ef9ae4,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:53.916236 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 57676) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:53.922095 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-6e57b6df-f874-47b4-ac44-cee41ab12d6a admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-608586296-network', 'tenant_id': '0f8143966f2943cb9a8e3ca19c244e1c'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:39:53.974268 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6e57b6df-f874-47b4-ac44-cee41ab12d6a admin admin] Made reservation on behalf of 0f8143966f2943cb9a8e3ca19c244e1c for: {'network': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:39:53.979095 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6e57b6df-f874-47b4-ac44-cee41ab12d6a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for network, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:53.993929 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6e57b6df-f874-47b4-ac44-cee41ab12d6a admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.172721 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-29f78476-b8ee-4880-9f71-ca9f1544d984 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.180697 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8cf0839-4d0e-46f0-bae4-1e96448e1677 req-fb8d2833-9076-43ce-959c-7cc0290bd7d0 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=ed593970-f617-452d-95b7-c2fd7615fd0a HTTP/1.1" status: 200 len: 210 time: 0.0281403 Sep 18 08:39:54.190096 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6e57b6df-f874-47b4-ac44-cee41ab12d6a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.213951 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dfe8452a-510b-433d-9a5d-9430d6cbcc66 req-f0b2f95a-7904-45d2-9061-563922674e88 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3835185 Sep 18 08:39:54.215425 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6e57b6df-f874-47b4-ac44-cee41ab12d6a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.237361 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 57686) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:54.248242 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6e57b6df-f874-47b4-ac44-cee41ab12d6a admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 225} {{(pid=94346) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 18 08:39:54.266855 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6e57b6df-f874-47b4-ac44-cee41ab12d6a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.267208 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.db.segments_db [None req-6e57b6df-f874-47b4-ac44-cee41ab12d6a admin admin] Added segment 260fc424-2182-42ea-bfe3-fe4a03948384 of type vlan for network 71ee8a3f-e7a5-4917-924c-07e7cffbbf9f Sep 18 08:39:54.277544 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e57b6df-f874-47b4-ac44-cee41ab12d6a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=18ee65c3-e785-4945-9d63-aa18c99b7a22,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:54.293594 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_v2 [None req-6cfd5a25-2710-431a-b3cc-f35ae94972f1 admin admin] Deleting subnet 9ed653e4-68a0-4108-b090-7571bdc067bc {{(pid=94347) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 18 08:39:54.296924 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-6cfd5a25-2710-431a-b3cc-f35ae94972f1 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.324006 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6e57b6df-f874-47b4-ac44-cee41ab12d6a admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732885226527'] for network, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.336652 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-6cfd5a25-2710-431a-b3cc-f35ae94972f1 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-13659316'] for subnet, precommit_delete_associations {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.383136 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6e57b6df-f874-47b4-ac44-cee41ab12d6a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for network, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.384112 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6e57b6df-f874-47b4-ac44-cee41ab12d6a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:54.384693 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6e57b6df-f874-47b4-ac44-cee41ab12d6a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.386914 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-6cfd5a25-2710-431a-b3cc-f35ae94972f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1821528'] for subnet, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.421819 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-29f78476-b8ee-4880-9f71-ca9f1544d984 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.455607 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-29f78476-b8ee-4880-9f71-ca9f1544d984 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.462026 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e57b6df-f874-47b4-ac44-cee41ab12d6a admin admin] Pushing event updated for resources: {'Network': ['ID=71ee8a3f-e7a5-4917-924c-07e7cffbbf9f,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:54.475635 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-6e57b6df-f874-47b4-ac44-cee41ab12d6a admin admin] 10.222.0.35 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.5576949 Sep 18 08:39:54.477942 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1688c37e-bc42-41db-a1c1-89e280564200 req-82a4178d-634c-42ea-9655-bdac1ba70928 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:54.479430 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1688c37e-bc42-41db-a1c1-89e280564200 req-82a4178d-634c-42ea-9655-bdac1ba70928 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/ports?device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 950 time: 0.0693746 Sep 18 08:39:54.479565 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 57690) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:54.483413 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Network 71ee8a3f-e7a5-4917-924c-07e7cffbbf9f details requested by agent ovs-agent-dv-cinder-804470-6-iscsi with host dv-cinder-804470-6-iscsi {{(pid=94348) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 18 08:39:54.486589 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-d7e25d34-9327-4385-92ac-257dfe17e21c admin admin] Request body: {'subnet': {'network_id': '71ee8a3f-e7a5-4917-924c-07e7cffbbf9f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-608586296-subnet', 'tenant_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'ip_version': 4}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:39:54.487044 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-6cfd5a25-2710-431a-b3cc-f35ae94972f1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1821519', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15069100', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-13996283'] for subnet, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.518664 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-29f78476-b8ee-4880-9f71-ca9f1544d984 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=c365c7b43c3340ea9358688b031e5078&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6859715 Sep 18 08:39:54.519714 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29f78476-b8ee-4880-9f71-ca9f1544d984 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d000bd7d-d682-4181-a300-50d66e2e9b83,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:54.519828 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 57692) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:54.532022 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cfd5a25-2710-431a-b3cc-f35ae94972f1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9ed653e4-68a0-4108-b090-7571bdc067bc,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:54.537354 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d7e25d34-9327-4385-92ac-257dfe17e21c admin admin] Made reservation on behalf of 0f8143966f2943cb9a8e3ca19c244e1c for: {'subnet': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:39:54.540869 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d7e25d34-9327-4385-92ac-257dfe17e21c admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14198618'] for subnet, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.546825 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-6cfd5a25-2710-431a-b3cc-f35ae94972f1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for subnet, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.548673 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-6cfd5a25-2710-431a-b3cc-f35ae94972f1 admin admin] 10.222.0.35 "DELETE /v2.0/subnets/9ed653e4-68a0-4108-b090-7571bdc067bc HTTP/1.1" status: 204 len: 168 time: 0.3098850 Sep 18 08:39:54.555170 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 57694) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:54.651274 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1688c37e-bc42-41db-a1c1-89e280564200 req-cbe7f42a-5d37-47c1-b1be-98b1c4f2f0b2 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/security-groups?id=32504d5c-b702-4d1a-8d76-e0cd4da86123&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1617076 Sep 18 08:39:54.676957 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-327c315a-5da2-4422-8335-d0aa530df8bc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1861545'] for network, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.695641 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-77656b0f-bf88-414c-aafd-21675902885a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.713441 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-77656b0f-bf88-414c-aafd-21675902885a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.765642 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d7e25d34-9327-4385-92ac-257dfe17e21c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-14290078', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14198644'] for subnet, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.836577 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-327c315a-5da2-4422-8335-d0aa530df8bc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1806559', 'neutron.services.segments.db._delete_segments_for_network-8732885752733'] for network, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.866771 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.874198 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7bc5093-80f1-4854-9de5-666e90edc9f7 req-667251c1-896a-4ea4-93f4-4c0a5ecc1e9c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:54.875790 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e7bc5093-80f1-4854-9de5-666e90edc9f7 req-667251c1-896a-4ea4-93f4-4c0a5ecc1e9c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.1402125 Sep 18 08:39:54.877880 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.services.segments.db [None req-327c315a-5da2-4422-8335-d0aa530df8bc admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2c7737b5-792d-4a8d-bacc-cd5c180b7fc0']}} {{(pid=94347) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:39:54.889122 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-77656b0f-bf88-414c-aafd-21675902885a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.891694 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-77656b0f-bf88-414c-aafd-21675902885a admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.895269 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-77656b0f-bf88-414c-aafd-21675902885a admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/d000bd7d-d682-4181-a300-50d66e2e9b83 HTTP/1.1" status: 204 len: 168 time: 0.3724902 Sep 18 08:39:54.895269 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.services.segments.db [None req-327c315a-5da2-4422-8335-d0aa530df8bc admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '892b5fda-4f2b-4e3a-af39-7d4f8d89394b') {'for_net_delete': True} {{(pid=94347) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:39:54.895269 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.services.segments.db [None req-327c315a-5da2-4422-8335-d0aa530df8bc admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '892b5fda-4f2b-4e3a-af39-7d4f8d89394b') {} {{(pid=94347) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:39:54.914727 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-327c315a-5da2-4422-8335-d0aa530df8bc admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732885753254', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-13659327'] for segment, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.923452 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77656b0f-bf88-414c-aafd-21675902885a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d000bd7d-d682-4181-a300-50d66e2e9b83,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:54.948580 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-327c315a-5da2-4422-8335-d0aa530df8bc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.964163 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-327c315a-5da2-4422-8335-d0aa530df8bc admin admin] Releasing vlan 218 on physical network physnet1 to pool {{(pid=94347) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 18 08:39:54.964508 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-327c315a-5da2-4422-8335-d0aa530df8bc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15067250'] for segment, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: Traceback (most recent call last): Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: timer() Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: cb(*args, **kw) Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: return func(*args, **kwargs) Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: self._notify() Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: self.callback(batched_events) Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: event.method(event) Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: aggregate_uuid = self.p_client.list_aggregates( Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: return f(self, *a, **k) Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: return self._get(url).json() Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: return self.request(url, 'GET', **kwargs) Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: base_url = self.get_endpoint(auth, allow=allow, Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 18 08:39:54.966301 dv-cinder-804470-6-iscsi neutron-server[94347]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 18 08:39:54.981841 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e7bc5093-80f1-4854-9de5-666e90edc9f7 req-111739cf-9927-4a58-94e8-00ad41093866 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0648649 Sep 18 08:39:55.004537 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7e25d34-9327-4385-92ac-257dfe17e21c admin admin] Pushing event updated for resources: {'Subnet': ['ID=979e5af3-22a3-4c66-a051-2000dea384e9,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:55.024642 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7e25d34-9327-4385-92ac-257dfe17e21c admin admin] Checking segment: {'id': '260fc424-2182-42ea-bfe3-fe4a03948384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 225, 'network_id': '71ee8a3f-e7a5-4917-924c-07e7cffbbf9f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94346) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:39:55.024642 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7e25d34-9327-4385-92ac-257dfe17e21c admin admin] Network hostable DHCP agents. Network: 71ee8a3f-e7a5-4917-924c-07e7cffbbf9f, hostable agents: ['6aaa6222-6d04-44a7-b807-bfc2cbd3e99f'], hosted agents: [] {{(pid=94346) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 18 08:39:55.040877 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-327c315a-5da2-4422-8335-d0aa530df8bc admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1806534', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-784926'] for network, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:55.053484 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7e25d34-9327-4385-92ac-257dfe17e21c admin admin] Network 71ee8a3f-e7a5-4917-924c-07e7cffbbf9f is scheduled to be hosted by DHCP agent 6aaa6222-6d04-44a7-b807-bfc2cbd3e99f with binding_index 1 {{(pid=94346) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 18 08:39:55.060401 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-327c315a-5da2-4422-8335-d0aa530df8bc admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:55.064917 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-327c315a-5da2-4422-8335-d0aa530df8bc admin admin] 10.222.0.35 "DELETE /v2.0/networks/2c7737b5-792d-4a8d-bacc-cd5c180b7fc0 HTTP/1.1" status: 204 len: 168 time: 0.5024033 Sep 18 08:39:55.064917 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-327c315a-5da2-4422-8335-d0aa530df8bc admin admin] Pushing event deleted for resources: {'Network': ['ID=2c7737b5-792d-4a8d-bacc-cd5c180b7fc0,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:55.070187 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-d7e25d34-9327-4385-92ac-257dfe17e21c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804470-6-iscsi, 71ee8a3f-e7a5-4917-924c-07e7cffbbf9f) {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:39:55.081165 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d7e25d34-9327-4385-92ac-257dfe17e21c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:55.081470 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0e1d7f0a-1085-4b08-849c-848616d9eaeb None None] Network 71ee8a3f-e7a5-4917-924c-07e7cffbbf9f requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:39:55.082050 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d7e25d34-9327-4385-92ac-257dfe17e21c admin admin] Notify callbacks [] for subnet, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:55.104356 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-d7e25d34-9327-4385-92ac-257dfe17e21c admin admin] 10.222.0.35 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.6212854 Sep 18 08:39:55.106764 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 57706) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:55.112466 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-628ce594-8a9b-46b7-8c4f-cccf37e71079 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-608586296-router', 'tenant_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:39:55.148800 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-628ce594-8a9b-46b7-8c4f-cccf37e71079 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-784001', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2995'] for router, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:55.150009 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-628ce594-8a9b-46b7-8c4f-cccf37e71079 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-782353', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-784513', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-710924', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2984'] for router, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:55.167577 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] Sync routers for ids ['d221b587-201f-4923-926d-02481e296d23'] in dv-cinder-804470-6-iscsi {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:39:55.183394 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] Routers {'d221b587-201f-4923-926d-02481e296d23'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:39:55.184061 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:39:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['d221b587-201f-4923-926d-02481e296d23'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:39:55.218917 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-628ce594-8a9b-46b7-8c4f-cccf37e71079 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:55.393760 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device bd096082-b42e-4e6d-a36f-afdc95ef9ae4 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:39:55.401820 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 57712) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:55.439508 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9bd3c32b-261a-4241-b0fd-b72438fd1f58 req-fdc07598-8827-433b-8506-f452884998e9 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=ed593970-f617-452d-95b7-c2fd7615fd0a HTTP/1.1" status: 200 len: 210 time: 0.0690296 Sep 18 08:39:55.442653 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7d7f36a8-5ca4-42d3-a77b-db8107dc8f88 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:55.491963 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bc1ce37-ce12-4609-b278-fe232e2bfb30 req-27fcf90e-a2a7-4430-897e-4d3dd1d6aaae tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:55.493988 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5bc1ce37-ce12-4609-b278-fe232e2bfb30 req-27fcf90e-a2a7-4430-897e-4d3dd1d6aaae tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8949a467-d4ed-449f-be4b-3fe465e79fd7 HTTP/1.1" status: 200 len: 944 time: 0.1662576 Sep 18 08:39:55.524410 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 57714) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:55.570095 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] Set router d221b587-201f-4923-926d-02481e296d23 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:39:55.572517 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port bd096082-b42e-4e6d-a36f-afdc95ef9ae4 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:39:55.573049 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:55.578865 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-628ce594-8a9b-46b7-8c4f-cccf37e71079 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:55.601049 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9559dbb5-976d-40f1-933e-d655b2c96cc0 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp22fa9bf9-2738-5c16-87a3-3f58ee5e2dc2-71ee8a3f-e7a5-4917-924c-07e7cffbbf9f', 'network_id': '71ee8a3f-e7a5-4917-924c-07e7cffbbf9f', 'tenant_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'fixed_ips': [{'subnet_id': '979e5af3-22a3-4c66-a051-2000dea384e9'}]}} from dv-cinder-804470-6-iscsi. {{(pid=94348) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 18 08:39:55.602216 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-9559dbb5-976d-40f1-933e-d655b2c96cc0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:55.620477 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5bc1ce37-ce12-4609-b278-fe232e2bfb30 req-36f0ece3-a96b-4c2c-bd8d-01bbd7d9a440 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1132538 Sep 18 08:39:55.681877 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-dc4daea8-ff20-46e5-888a-1466fe164821 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=79ab1eeea623437e8ca702571b96da7d&name=default HTTP/1.1" status: 200 len: 2975 time: 0.1561341 Sep 18 08:39:55.686641 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 57716) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:55.742715 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7d7f36a8-5ca4-42d3-a77b-db8107dc8f88 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:55.761885 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7d7f36a8-5ca4-42d3-a77b-db8107dc8f88 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:55.773026 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-341627b2-ad48-4237-9b30-2316470ac233 req-c73b8413-6c6a-47b4-98d8-f8efbb510711 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:55.774656 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-341627b2-ad48-4237-9b30-2316470ac233 req-c73b8413-6c6a-47b4-98d8-f8efbb510711 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.13 "GET /v2.0/networks?id=fe2753d3-7f3b-4739-adbf-6643a840c73e HTTP/1.1" status: 200 len: 815 time: 0.2003815 Sep 18 08:39:55.850882 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3b3d5b3a-7f7f-4af3-8de0-ba4b4a9396b5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:55.852756 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d7f36a8-5ca4-42d3-a77b-db8107dc8f88 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=674dbb03-6306-4e3e-aada-48daebf1512f,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:55.862145 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-7d7f36a8-5ca4-42d3-a77b-db8107dc8f88 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=299c51e721864027a05987289d566db1&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4580312 Sep 18 08:39:55.865046 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 57720) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:55.891103 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-628ce594-8a9b-46b7-8c4f-cccf37e71079 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:55.906912 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-341627b2-ad48-4237-9b30-2316470ac233 req-c05de609-b2c8-48f8-8340-895a19304f1b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Request body: {'port': {'device_id': 'ed593970-f617-452d-95b7-c2fd7615fd0a', 'network_id': 'fe2753d3-7f3b-4739-adbf-6643a840c73e', 'admin_state_up': True, 'tenant_id': '38bd82e43ad3497aa14e8e4e68a29009'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:39:55.910778 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-628ce594-8a9b-46b7-8c4f-cccf37e71079 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:55.929687 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3b3d5b3a-7f7f-4af3-8de0-ba4b4a9396b5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:55.963526 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.db_base_plugin_common [None req-9559dbb5-976d-40f1-933e-d655b2c96cc0 None None] Allocated IP 172.20.0.2 (71ee8a3f-e7a5-4917-924c-07e7cffbbf9f/979e5af3-22a3-4c66-a051-2000dea384e9/0c4aad35-0f98-4e28-8018-c199999da418) {{(pid=94348) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:39:55.988267 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bc88a62-17d6-4786-b79f-5dc6bf594e2e req-bf11fb30-1ecc-4f02-b95f-f5d6b89a4f77 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:55.989825 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2bc88a62-17d6-4786-b79f-5dc6bf594e2e req-bf11fb30-1ecc-4f02-b95f-f5d6b89a4f77 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/ports?device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 950 time: 0.2002127 Sep 18 08:39:56.043643 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_common [None req-628ce594-8a9b-46b7-8c4f-cccf37e71079 admin admin] Allocated IP 172.27.1.125 (2e3b3f85-63e4-4380-917a-8c90c80b3e38/cd525bb9-7f93-490c-a5d6-a08911817e54/629d0b34-445c-4313-b738-d9083c86fbce) {{(pid=94346) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:39:56.059107 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd221b587-201f-4923-926d-02481e296d23', 'name': 'tempest-TestShelveInstance-734449530-router', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.84'}], 'enable_snat': True}, 'gw_port_id': 'bd096082-b42e-4e6d-a36f-afdc95ef9ae4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:39:48Z', 'updated_at': '2021-09-18T08:39:52Z', 'revision_number': 4, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'gw_port': {'id': 'bd096082-b42e-4e6d-a36f-afdc95ef9ae4', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:ed:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd221b587-201f-4923-926d-02481e296d23', 'device_owner': 'network:router_gateway', 'standard_attr_id': 303, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:49Z', 'updated_at': '2021-09-18T08:39:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '23821731-be27-4d6b-834b-f6953b4d873a', 'name': '', 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'mac_address': 'fa:16:3e:47:27:a2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd221b587-201f-4923-926d-02481e296d23', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': '58e9d53a-333d-4a2f-a575-92c9de3fb737', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:51Z', 'updated_at': '2021-09-18T08:39:52Z', 'revision_number': 2, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'subnets': [{'id': '58e9d53a-333d-4a2f-a575-92c9de3fb737', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:39:56.093534 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] Checking router: d221b587-201f-4923-926d-02481e296d23 for host: dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:39:56.094352 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] Updating router d221b587-201f-4923-926d-02481e296d23 port 23821731-be27-4d6b-834b-f6953b4d873a binding host dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 18 08:39:56.139830 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:56.152825 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56c93319-9130-4a3e-af53-801a2ec44542 req-fc133bbd-6100-4142-92fd-2a1ccfce8428 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:56.154317 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-56c93319-9130-4a3e-af53-801a2ec44542 req-fc133bbd-6100-4142-92fd-2a1ccfce8428 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.13 "GET /v2.0/ports?device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 950 time: 0.2594082 Sep 18 08:39:56.169018 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-628ce594-8a9b-46b7-8c4f-cccf37e71079 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:56.186388 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b0467e29-f2da-409e-80c8-8bc10d47e198 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:56.212589 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-628ce594-8a9b-46b7-8c4f-cccf37e71079 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:56.214337 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-9559dbb5-976d-40f1-933e-d655b2c96cc0 None None] Notify callbacks [] for port, precommit_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:56.216258 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2bc88a62-17d6-4786-b79f-5dc6bf594e2e req-6f480083-053c-407c-914a-759d63b6ad43 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/security-groups?id=32504d5c-b702-4d1a-8d76-e0cd4da86123&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2034874 Sep 18 08:39:56.233135 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-9559dbb5-976d-40f1-933e-d655b2c96cc0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528'] for port, after_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:56.267340 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-628ce594-8a9b-46b7-8c4f-cccf37e71079 admin admin] Network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:39:56.275900 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-628ce594-8a9b-46b7-8c4f-cccf37e71079 admin admin] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:39:56.278317 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-628ce594-8a9b-46b7-8c4f-cccf37e71079 admin admin] Pushing event updated for resources: {'Port': ['ID=629d0b34-445c-4313-b738-d9083c86fbce,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:56.291142 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [None req-628ce594-8a9b-46b7-8c4f-cccf37e71079 admin admin] Received port after_create {{(pid=94346) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:39:56.319248 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3b3d5b3a-7f7f-4af3-8de0-ba4b4a9396b5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:56.322274 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3b3d5b3a-7f7f-4af3-8de0-ba4b4a9396b5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:56.323425 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-3b3d5b3a-7f7f-4af3-8de0-ba4b4a9396b5 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/8ec8ef7b-d527-4952-98bf-d882a759da55 HTTP/1.1" status: 204 len: 168 time: 0.6358104 Sep 18 08:39:56.339557 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66ef5549-fb2b-46be-8c03-6b234d4dae59 req-a781ee3f-51df-4f31-8893-88ffb0a3e572 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:56.341087 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-66ef5549-fb2b-46be-8c03-6b234d4dae59 req-a781ee3f-51df-4f31-8893-88ffb0a3e572 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.2473741 Sep 18 08:39:56.341728 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-341627b2-ad48-4237-9b30-2316470ac233 req-c05de609-b2c8-48f8-8340-895a19304f1b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Made reservation on behalf of 38bd82e43ad3497aa14e8e4e68a29009 for: {'port': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:39:56.344068 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9559dbb5-976d-40f1-933e-d655b2c96cc0 None None] Network 71ee8a3f-e7a5-4917-924c-07e7cffbbf9f is already hosted by enough agents. {{(pid=94348) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:39:56.345483 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-341627b2-ad48-4237-9b30-2316470ac233 req-c05de609-b2c8-48f8-8340-895a19304f1b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:56.350517 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.scheduler.base_scheduler [None req-9559dbb5-976d-40f1-933e-d655b2c96cc0 None None] Resources bound (agent type, host, resource id): {{(pid=94348) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:39:56.362036 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9559dbb5-976d-40f1-933e-d655b2c96cc0 None None] Received port after_create {{(pid=94348) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:39:56.368984 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9559dbb5-976d-40f1-933e-d655b2c96cc0 None None] Pushing event updated for resources: {'Port': ['ID=0c4aad35-0f98-4e28-8018-c199999da418,revision_number=1']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:56.371685 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b0467e29-f2da-409e-80c8-8bc10d47e198 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:56.419490 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b3d5b3a-7f7f-4af3-8de0-ba4b4a9396b5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8ec8ef7b-d527-4952-98bf-d882a759da55,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:56.493794 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-66ef5549-fb2b-46be-8c03-6b234d4dae59 req-251bd34d-d99f-4b64-a62c-5c890d60573a tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1131411 Sep 18 08:39:56.593324 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-9559dbb5-976d-40f1-933e-d655b2c96cc0 None None] Attempting to bind port 0c4aad35-0f98-4e28-8018-c199999da418 on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:39:56.594828 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-9559dbb5-976d-40f1-933e-d655b2c96cc0 None None] Attempting to bind port 0c4aad35-0f98-4e28-8018-c199999da418 by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': '260fc424-2182-42ea-bfe3-fe4a03948384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 225, 'network_id': '71ee8a3f-e7a5-4917-924c-07e7cffbbf9f'}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:39:56.595348 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9559dbb5-976d-40f1-933e-d655b2c96cc0 None None] Attempting to bind port 0c4aad35-0f98-4e28-8018-c199999da418 on network 71ee8a3f-e7a5-4917-924c-07e7cffbbf9f {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:39:56.607162 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-06f79e75-de89-4007-adf9-e10224c995eb req-b8e55bd8-f453-488d-a161-be2d94c073cb tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=ed593970-f617-452d-95b7-c2fd7615fd0a HTTP/1.1" status: 200 len: 210 time: 0.0320098 Sep 18 08:39:56.612580 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-56c93319-9130-4a3e-af53-801a2ec44542 req-019e410e-6f10-4a5a-bb30-147a36a00f0e tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Deleting port 27a509fa-10dc-4ef1-bb19-0a80691837ef {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:39:56.612930 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-56c93319-9130-4a3e-af53-801a2ec44542 req-019e410e-6f10-4a5a-bb30-147a36a00f0e tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:56.613772 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9559dbb5-976d-40f1-933e-d655b2c96cc0 None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 39, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:39:56.614339 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9559dbb5-976d-40f1-933e-d655b2c96cc0 None None] Checking segment: {'id': '260fc424-2182-42ea-bfe3-fe4a03948384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 225, 'network_id': '71ee8a3f-e7a5-4917-924c-07e7cffbbf9f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94348) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:39:56.616074 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-9559dbb5-976d-40f1-933e-d655b2c96cc0 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:56.616707 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9559dbb5-976d-40f1-933e-d655b2c96cc0 None None] Bound using segment: {'id': '260fc424-2182-42ea-bfe3-fe4a03948384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 225, 'network_id': '71ee8a3f-e7a5-4917-924c-07e7cffbbf9f'} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:39:56.617403 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-9559dbb5-976d-40f1-933e-d655b2c96cc0 None None] Bound port: 0c4aad35-0f98-4e28-8018-c199999da418, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '260fc424-2182-42ea-bfe3-fe4a03948384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 225, 'network_id': '71ee8a3f-e7a5-4917-924c-07e7cffbbf9f'}}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:39:56.617959 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-9559dbb5-976d-40f1-933e-d655b2c96cc0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:56.633375 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] Notify callbacks [] for port, precommit_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:56.688136 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:56.700774 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b0467e29-f2da-409e-80c8-8bc10d47e198 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:56.703503 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b0467e29-f2da-409e-80c8-8bc10d47e198 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:56.704602 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-628ce594-8a9b-46b7-8c4f-cccf37e71079 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:56.708996 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-b0467e29-f2da-409e-80c8-8bc10d47e198 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/674dbb03-6306-4e3e-aada-48daebf1512f HTTP/1.1" status: 204 len: 168 time: 0.8412230 Sep 18 08:39:56.710746 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:39:56.752513 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c91280a5-bbcc-4ef1-be53-21529af3bf70 None None] Pushing event updated for resources: {'Port': ['ID=23821731-be27-4d6b-834b-f6953b4d873a,revision_number=3']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:56.756812 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0467e29-f2da-409e-80c8-8bc10d47e198 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=674dbb03-6306-4e3e-aada-48daebf1512f,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:56.838669 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-9559dbb5-976d-40f1-933e-d655b2c96cc0 None None] For port 0c4aad35-0f98-4e28-8018-c199999da418, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94348) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:39:56.840437 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-56c93319-9130-4a3e-af53-801a2ec44542 req-019e410e-6f10-4a5a-bb30-147a36a00f0e tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] For port 27a509fa-10dc-4ef1-bb19-0a80691837ef, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=27a509fa-10dc-4ef1-bb19-0a80691837ef,segment=NetworkSegment(4771e64b-9ced-4a35-b6b5-805d70815e86),segment_id=4771e64b-9ced-4a35-b6b5-805d70815e86)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:39:56.841778 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-56c93319-9130-4a3e-af53-801a2ec44542 req-019e410e-6f10-4a5a-bb30-147a36a00f0e tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:56.861197 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-56c93319-9130-4a3e-af53-801a2ec44542 req-019e410e-6f10-4a5a-bb30-147a36a00f0e tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Calling delete_port for 27a509fa-10dc-4ef1-bb19-0a80691837ef owned by compute:nova {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:39:56.889903 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_common [req-341627b2-ad48-4237-9b30-2316470ac233 req-c05de609-b2c8-48f8-8340-895a19304f1b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Allocated IP 172.20.0.12 (fe2753d3-7f3b-4739-adbf-6643a840c73e/b96e08ba-91b8-4c1f-bd27-4a1270ccbde2/1f9a3d54-fb75-4f0c-8013-46a939823a2e) {{(pid=94347) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:39:56.896903 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-9559dbb5-976d-40f1-933e-d655b2c96cc0 None None] For port 0c4aad35-0f98-4e28-8018-c199999da418, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=0c4aad35-0f98-4e28-8018-c199999da418,segment=NetworkSegment(260fc424-2182-42ea-bfe3-fe4a03948384),segment_id=260fc424-2182-42ea-bfe3-fe4a03948384)] {{(pid=94348) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:39:56.909437 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-9559dbb5-976d-40f1-933e-d655b2c96cc0 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:56.952152 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] Attempting to bind port 23821731-be27-4d6b-834b-f6953b4d873a on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:39:56.952537 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] Attempting to bind port 23821731-be27-4d6b-834b-f6953b4d873a by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': '6dfc82da-1689-40bb-a749-6245f29bfd89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 244, 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca'}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:39:56.952913 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] Attempting to bind port 23821731-be27-4d6b-834b-f6953b4d873a on network c81b2232-3aba-4f15-b8f1-a71826c8c1ca {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:39:56.974778 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 39, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:39:56.975678 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] Checking segment: {'id': '6dfc82da-1689-40bb-a749-6245f29bfd89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 244, 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94348) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:39:56.976061 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:56.976459 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] Bound using segment: {'id': '6dfc82da-1689-40bb-a749-6245f29bfd89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 244, 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca'} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:39:56.976958 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] Bound port: 23821731-be27-4d6b-834b-f6953b4d873a, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6dfc82da-1689-40bb-a749-6245f29bfd89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 244, 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca'}}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:39:56.977373 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:57.041905 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c8a7649-3c47-4838-8049-71868a81a624 req-b3d071d5-d4d1-4ce3-bc90-9d3aa1264aec tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:57.043490 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0c8a7649-3c47-4838-8049-71868a81a624 req-b3d071d5-d4d1-4ce3-bc90-9d3aa1264aec tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8949a467-d4ed-449f-be4b-3fe465e79fd7 HTTP/1.1" status: 200 len: 944 time: 0.2775979 Sep 18 08:39:57.056110 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9559dbb5-976d-40f1-933e-d655b2c96cc0 None None] Pushing event updated for resources: {'Port': ['ID=0c4aad35-0f98-4e28-8018-c199999da418,revision_number=2']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:57.110415 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] For port 23821731-be27-4d6b-834b-f6953b4d873a, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94348) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:39:57.114826 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] For port 23821731-be27-4d6b-834b-f6953b4d873a, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=23821731-be27-4d6b-834b-f6953b4d873a,segment=NetworkSegment(6dfc82da-1689-40bb-a749-6245f29bfd89),segment_id=6dfc82da-1689-40bb-a749-6245f29bfd89)] {{(pid=94348) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:39:57.122144 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:57.208484 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-628ce594-8a9b-46b7-8c4f-cccf37e71079 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-782366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-784982'] for router, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:57.217400 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] Routers {'d221b587-201f-4923-926d-02481e296d23'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:39:57.218062 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:39:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['d221b587-201f-4923-926d-02481e296d23'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:39:57.224783 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c91280a5-bbcc-4ef1-be53-21529af3bf70 None None] Pushing event updated for resources: {'Port': ['ID=23821731-be27-4d6b-834b-f6953b4d873a,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:57.346477 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-d2acfa0d-2cf8-4499-a053-fcc63120e7d8 None None] Provisioning complete for port 23821731-be27-4d6b-834b-f6953b4d873a triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:39:57.347121 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-d2acfa0d-2cf8-4499-a053-fcc63120e7d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:57.478837 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-56c93319-9130-4a3e-af53-801a2ec44542 req-019e410e-6f10-4a5a-bb30-147a36a00f0e tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:57.601679 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-811cbbac-e937-47ea-bba4-df5f562b074a req-47d7e546-bfda-4a87-9f94-7bbe629c1592 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/ports?device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 210 time: 0.1279011 Sep 18 08:39:57.611991 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-628ce594-8a9b-46b7-8c4f-cccf37e71079 admin admin] Router 11fd14b5-1378-4aa8-9fbb-a4577850589e is scheduled to L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a with binding_index 1 {{(pid=94346) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 18 08:39:57.715323 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-341627b2-ad48-4237-9b30-2316470ac233 req-c05de609-b2c8-48f8-8340-895a19304f1b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks [] for port, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:57.729498 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['27a509fa-10dc-4ef1-bb19-0a80691837ef'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:39:57.771562 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] Set router d221b587-201f-4923-926d-02481e296d23 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:39:57.812809 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-628ce594-8a9b-46b7-8c4f-cccf37e71079 admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94346) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:39:57.822917 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0c8a7649-3c47-4838-8049-71868a81a624 req-44e6eaa8-cca5-4e10-b899-1a700c7bbbe7 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6782222 Sep 18 08:39:57.825534 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-019e410e-6f10-4a5a-bb30-147a36a00f0e tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Pushing event deleted for resources: {'Port': ['ID=27a509fa-10dc-4ef1-bb19-0a80691837ef,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:57.828946 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-d2acfa0d-2cf8-4499-a053-fcc63120e7d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:57.834980 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] Sync routers for ids ['11fd14b5-1378-4aa8-9fbb-a4577850589e'] in dv-cinder-804470-6-iscsi {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:39:57.845757 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-628ce594-8a9b-46b7-8c4f-cccf37e71079 admin admin] Notify callbacks [] for router, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:57.847340 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-628ce594-8a9b-46b7-8c4f-cccf37e71079 admin admin] 10.222.0.35 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 2.7383556 Sep 18 08:39:57.850473 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 57774) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:39:57.850619 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] Routers {'11fd14b5-1378-4aa8-9fbb-a4577850589e'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:39:57.851190 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:39:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['11fd14b5-1378-4aa8-9fbb-a4577850589e'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:39:57.866896 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-341627b2-ad48-4237-9b30-2316470ac233 req-c05de609-b2c8-48f8-8340-895a19304f1b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:58.071022 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-d2acfa0d-2cf8-4499-a053-fcc63120e7d8 None None] For port 23821731-be27-4d6b-834b-f6953b4d873a, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=23821731-be27-4d6b-834b-f6953b4d873a,segment=NetworkSegment(6dfc82da-1689-40bb-a749-6245f29bfd89),segment_id=6dfc82da-1689-40bb-a749-6245f29bfd89)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:39:58.073410 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-56c93319-9130-4a3e-af53-801a2ec44542 req-019e410e-6f10-4a5a-bb30-147a36a00f0e tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] No DVR routers for this DVR port 27a509fa-10dc-4ef1-bb19-0a80691837ef on host hv-cinder-80447 {{(pid=94347) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:39:58.078860 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['9a4f8ce9-f706-4c25-b3f4-05f2173cf516'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:39:58.081763 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-56c93319-9130-4a3e-af53-801a2ec44542 req-019e410e-6f10-4a5a-bb30-147a36a00f0e tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:58.086423 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-56c93319-9130-4a3e-af53-801a2ec44542 req-019e410e-6f10-4a5a-bb30-147a36a00f0e tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.13 "DELETE /v2.0/ports/27a509fa-10dc-4ef1-bb19-0a80691837ef HTTP/1.1" status: 204 len: 173 time: 1.9172924 Sep 18 08:39:58.119940 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-d2acfa0d-2cf8-4499-a053-fcc63120e7d8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:58.162098 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '09faa6cc-6619-4eac-8e44-8d07532200d0', 'name': 'network-vif-deleted', 'tag': '27a509fa-10dc-4ef1-bb19-0a80691837ef'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:39:58.167264 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2b493569-3300-49a5-af10-b1553b1dddb6" -d '{"events": [{"server_uuid": "09faa6cc-6619-4eac-8e44-8d07532200d0", "name": "network-vif-deleted", "tag": "27a509fa-10dc-4ef1-bb19-0a80691837ef"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:39:58.167859 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] Set router 11fd14b5-1378-4aa8-9fbb-a4577850589e gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:39:58.238824 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-341627b2-ad48-4237-9b30-2316470ac233 req-c05de609-b2c8-48f8-8340-895a19304f1b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Network fe2753d3-7f3b-4739-adbf-6643a840c73e is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:39:58.311917 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [req-341627b2-ad48-4237-9b30-2316470ac233 req-c05de609-b2c8-48f8-8340-895a19304f1b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:39:58.336671 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-341627b2-ad48-4237-9b30-2316470ac233 req-c05de609-b2c8-48f8-8340-895a19304f1b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Received port after_create {{(pid=94347) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:39:58.362837 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2d13a54-8c14-4205-a49d-2736f9888608 req-3a7b93fe-22ff-4a3f-ac41-63ab5232bf0f tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:58.374285 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a2d13a54-8c14-4205-a49d-2736f9888608 req-3a7b93fe-22ff-4a3f-ac41-63ab5232bf0f tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.3153646 Sep 18 08:39:58.383089 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c05de609-b2c8-48f8-8340-895a19304f1b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Pushing event updated for resources: {'Port': ['ID=1f9a3d54-fb75-4f0c-8013-46a939823a2e,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:58.406898 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2acfa0d-2cf8-4499-a053-fcc63120e7d8 None None] Pushing event updated for resources: {'Port': ['ID=23821731-be27-4d6b-834b-f6953b4d873a,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:58.518040 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-f61a5e16-d4b3-46d9-bd59-0447020ff03f None None] Provisioning complete for port 23821731-be27-4d6b-834b-f6953b4d873a triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:39:58.519856 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-f61a5e16-d4b3-46d9-bd59-0447020ff03f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:58.533451 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a2d13a54-8c14-4205-a49d-2736f9888608 req-f2b3501e-c96b-42f6-bc2f-7f9df9f664c6 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1581383 Sep 18 08:39:58.561512 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-176a7318-9021-4a70-b984-ac46d3ebdefa req-58f61286-f8c8-423a-a828-9cf600f7e318 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:58.568264 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-176a7318-9021-4a70-b984-ac46d3ebdefa req-58f61286-f8c8-423a-a828-9cf600f7e318 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=ed593970-f617-452d-95b7-c2fd7615fd0a HTTP/1.1" status: 200 len: 932 time: 0.5294168 Sep 18 08:39:58.630857 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '11fd14b5-1378-4aa8-9fbb-a4577850589e', 'name': 'tempest-TestShelveInstance-608586296-router', 'tenant_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.125'}], 'enable_snat': True}, 'gw_port_id': '629d0b34-445c-4313-b738-d9083c86fbce', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:39:55Z', 'updated_at': '2021-09-18T08:39:56Z', 'revision_number': 3, 'project_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'gw_port': {'id': '629d0b34-445c-4313-b738-d9083c86fbce', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:50:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11fd14b5-1378-4aa8-9fbb-a4577850589e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 326, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.125', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:55Z', 'updated_at': '2021-09-18T08:39:56Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:39:58.650687 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:39:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-84439b15-2b95-41a5-bcd7-ec15c91e64b3 x-openstack-request-id: req-84439b15-2b95-41a5-bcd7-ec15c91e64b3 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:39:58.651280 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "09faa6cc-6619-4eac-8e44-8d07532200d0", "name": "network-vif-deleted", "tag": "27a509fa-10dc-4ef1-bb19-0a80691837ef", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:39:58.651792 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-84439b15-2b95-41a5-bcd7-ec15c91e64b3 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:39:58.652728 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '09faa6cc-6619-4eac-8e44-8d07532200d0', 'name': 'network-vif-deleted', 'tag': '27a509fa-10dc-4ef1-bb19-0a80691837ef', 'status': 'completed', 'code': 200} Sep 18 08:39:58.671490 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-341627b2-ad48-4237-9b30-2316470ac233 req-c05de609-b2c8-48f8-8340-895a19304f1b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:58.678720 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-341627b2-ad48-4237-9b30-2316470ac233 req-c05de609-b2c8-48f8-8340-895a19304f1b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:58.717832 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-176a7318-9021-4a70-b984-ac46d3ebdefa req-6790a2a0-cd42-450a-8111-40104e74ede4 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1309950 Sep 18 08:39:58.736641 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] Checking router: 11fd14b5-1378-4aa8-9fbb-a4577850589e for host: dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:39:58.739656 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] Updating router 11fd14b5-1378-4aa8-9fbb-a4577850589e port 629d0b34-445c-4313-b738-d9083c86fbce binding host dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 18 08:39:58.753977 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-341627b2-ad48-4237-9b30-2316470ac233 req-c05de609-b2c8-48f8-8340-895a19304f1b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.8531880 Sep 18 08:39:58.804677 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5282712e-21d5-431a-9db0-e513ef904e0d req-4521f226-d460-4c30-8a83-42cd078050b5 tempest-VolumesNegativeTest-1333434839 tempest-VolumesNegativeTest-1333434839-project] 10.222.0.35 "GET /v2.0/ports?device_id=09faa6cc-6619-4eac-8e44-8d07532200d0 HTTP/1.1" status: 200 len: 210 time: 0.0376475 Sep 18 08:39:58.805204 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ec446da-88f6-48c2-b2da-82e58b520878 None None] Network 71ee8a3f-e7a5-4917-924c-07e7cffbbf9f requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:39:58.811085 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-341627b2-ad48-4237-9b30-2316470ac233 req-66af8b73-a1d9-470d-8ef6-186b0961b368 service neutron] Request body: {'port': {'device_id': 'ed593970-f617-452d-95b7-c2fd7615fd0a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80447'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:39:58.823593 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:58.936921 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device b7ffb91b-4d87-4a7b-9de9-7e947fb6d687 details requested by agent hyperv_hv-cinder-80447 with host hv-cinder-80447 {{(pid=94348) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 18 08:39:58.938653 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-341627b2-ad48-4237-9b30-2316470ac233 req-66af8b73-a1d9-470d-8ef6-186b0961b368 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:59.044472 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1b953d4-e2cf-47ca-a627-84363c4545fd req-7f7009fd-1cab-4e6e-a8de-60b8d5c3ec9f tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:59.051903 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f1b953d4-e2cf-47ca-a627-84363c4545fd req-7f7009fd-1cab-4e6e-a8de-60b8d5c3ec9f tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8949a467-d4ed-449f-be4b-3fe465e79fd7 HTTP/1.1" status: 200 len: 944 time: 0.1151633 Sep 18 08:39:59.129458 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f1b953d4-e2cf-47ca-a627-84363c4545fd req-a93d635f-4c68-4415-bdd0-099ccc6fe9a5 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0629249 Sep 18 08:39:59.312461 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd221b587-201f-4923-926d-02481e296d23', 'name': 'tempest-TestShelveInstance-734449530-router', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.84'}], 'enable_snat': True}, 'gw_port_id': 'bd096082-b42e-4e6d-a36f-afdc95ef9ae4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:39:48Z', 'updated_at': '2021-09-18T08:39:52Z', 'revision_number': 4, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'gw_port': {'id': 'bd096082-b42e-4e6d-a36f-afdc95ef9ae4', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:ed:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd221b587-201f-4923-926d-02481e296d23', 'device_owner': 'network:router_gateway', 'standard_attr_id': 303, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:49Z', 'updated_at': '2021-09-18T08:39:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '23821731-be27-4d6b-834b-f6953b4d873a', 'name': '', 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'mac_address': 'fa:16:3e:47:27:a2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd221b587-201f-4923-926d-02481e296d23', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': '58e9d53a-333d-4a2f-a575-92c9de3fb737', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:51Z', 'updated_at': '2021-09-18T08:39:57Z', 'revision_number': 4, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'subnets': [{'id': '58e9d53a-333d-4a2f-a575-92c9de3fb737', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:39:59.395261 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port b7ffb91b-4d87-4a7b-9de9-7e947fb6d687, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=b7ffb91b-4d87-4a7b-9de9-7e947fb6d687,segment=NetworkSegment(4f8dffb0-f8d4-41b5-beed-53bcf370cb42),segment_id=4f8dffb0-f8d4-41b5-beed-53bcf370cb42)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:39:59.396219 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-708b0df0-181d-48b5-bfdb-6e8f51779b2f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:59.409902 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Returning: {'device': 'b7ffb91b-4d87-4a7b-9de9-7e947fb6d687', 'network_id': '5e2d06a6-7f04-4134-8004-d5639986c75e', 'port_id': 'b7ffb91b-4d87-4a7b-9de9-7e947fb6d687', 'mac_address': 'fa:16:3e:a3:64:c9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 213, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '10680649-3557-49d0-9377-0d9cdb4efe69', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94348) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 18 08:39:59.481720 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [req-341627b2-ad48-4237-9b30-2316470ac233 req-66af8b73-a1d9-470d-8ef6-186b0961b368 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1f9a3d54-fb75-4f0c-8013-46a939823a2e {{(pid=94347) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:39:59.482780 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b33490e-3b5c-40f3-822f-2617f50b1036 None None] The sync data for ids ['d221b587-201f-4923-926d-02481e296d23'] in dv-cinder-804470-6-iscsi is: [{'id': 'd221b587-201f-4923-926d-02481e296d23', 'name': 'tempest-TestShelveInstance-734449530-router', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.84'}], 'enable_snat': True}, 'gw_port_id': 'bd096082-b42e-4e6d-a36f-afdc95ef9ae4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:39:48Z', 'updated_at': '2021-09-18T08:39:52Z', 'revision_number': 4, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'gw_port': {'id': 'bd096082-b42e-4e6d-a36f-afdc95ef9ae4', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:ed:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd221b587-201f-4923-926d-02481e296d23', 'device_owner': 'network:router_gateway', 'standard_attr_id': 303, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:49Z', 'updated_at': '2021-09-18T08:39:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '23821731-be27-4d6b-834b-f6953b4d873a', 'name': '', 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'mac_address': 'fa:16:3e:47:27:a2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd221b587-201f-4923-926d-02481e296d23', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': '58e9d53a-333d-4a2f-a575-92c9de3fb737', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:51Z', 'updated_at': '2021-09-18T08:39:57Z', 'revision_number': 4, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'subnets': [{'id': '58e9d53a-333d-4a2f-a575-92c9de3fb737', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:39:59.491140 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-341627b2-ad48-4237-9b30-2316470ac233 req-66af8b73-a1d9-470d-8ef6-186b0961b368 service neutron] Notify callbacks [] for port, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:59.499308 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] Notify callbacks [] for port, precommit_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:59.511737 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.provisioning_blocks [req-341627b2-ad48-4237-9b30-2316470ac233 req-66af8b73-a1d9-470d-8ef6-186b0961b368 service neutron] Transition to ACTIVE for port object 1f9a3d54-fb75-4f0c-8013-46a939823a2e will not be triggered until provisioned by entity L2. {{(pid=94347) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 18 08:39:59.521279 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:59.523890 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 0c4aad35-0f98-4e28-8018-c199999da418 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:39:59.524265 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:59.530233 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-341627b2-ad48-4237-9b30-2316470ac233 req-66af8b73-a1d9-470d-8ef6-186b0961b368 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:59.588032 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b7ffb91b-4d87-4a7b-9de9-7e947fb6d687 {{(pid=94348) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:39:59.705101 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] Attempting to bind port 629d0b34-445c-4313-b738-d9083c86fbce on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:39:59.713547 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66af8b73-a1d9-470d-8ef6-186b0961b368 service neutron] Pushing event updated for resources: {'Port': ['ID=1f9a3d54-fb75-4f0c-8013-46a939823a2e,revision_number=2']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:59.716088 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] Attempting to bind port 629d0b34-445c-4313-b738-d9083c86fbce by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}] {{(pid=94349) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:39:59.716524 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] Attempting to bind port 629d0b34-445c-4313-b738-d9083c86fbce on network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:39:59.732211 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 39, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:39:59.732835 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] Checking segment: {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94349) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:39:59.733431 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:59.733970 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] Bound using segment: {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'} {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:39:59.734726 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] Bound port: 629d0b34-445c-4313-b738-d9083c86fbce, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}}] {{(pid=94349) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:39:59.735297 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:59.737116 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b7f37c0-c209-4df8-addb-8b2e39d67328 None None] Pushing event updated for resources: {'Port': ['ID=629d0b34-445c-4313-b738-d9083c86fbce,revision_number=2']} {{(pid=94349) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:59.774383 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_common [None req-708b0df0-181d-48b5-bfdb-6e8f51779b2f admin admin] Allocated IP 172.20.0.1 (71ee8a3f-e7a5-4917-924c-07e7cffbbf9f/979e5af3-22a3-4c66-a051-2000dea384e9/5fca4850-9dbe-4847-a121-123f4a9dc375) {{(pid=94346) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:39:59.823202 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port b7ffb91b-4d87-4a7b-9de9-7e947fb6d687, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=b7ffb91b-4d87-4a7b-9de9-7e947fb6d687,segment=NetworkSegment(4f8dffb0-f8d4-41b5-beed-53bcf370cb42),segment_id=4f8dffb0-f8d4-41b5-beed-53bcf370cb42)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:39:59.826458 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13aa24db-194f-4208-a1af-2cd8026bf4bb req-7ec074b2-58a8-4494-9ab3-1e8a95816d14 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:39:59.828334 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-13aa24db-194f-4208-a1af-2cd8026bf4bb req-7ec074b2-58a8-4494-9ab3-1e8a95816d14 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.1557417 Sep 18 08:39:59.831973 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-341627b2-ad48-4237-9b30-2316470ac233 req-66af8b73-a1d9-470d-8ef6-186b0961b368 service neutron] Attempting to bind port 1f9a3d54-fb75-4f0c-8013-46a939823a2e on host hv-cinder-80447 for vnic_type normal with profile {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:39:59.832320 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-341627b2-ad48-4237-9b30-2316470ac233 req-66af8b73-a1d9-470d-8ef6-186b0961b368 service neutron] Attempting to bind port 1f9a3d54-fb75-4f0c-8013-46a939823a2e by drivers openvswitch,hyperv on host hv-cinder-80447 at level 0 using segments [{'id': 'd1432479-9c27-42c4-87db-6905e7868675', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 233, 'network_id': 'fe2753d3-7f3b-4739-adbf-6643a840c73e'}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:39:59.832839 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-341627b2-ad48-4237-9b30-2316470ac233 req-66af8b73-a1d9-470d-8ef6-186b0961b368 service neutron] Attempting to bind port 1f9a3d54-fb75-4f0c-8013-46a939823a2e on network fe2753d3-7f3b-4739-adbf-6643a840c73e {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:39:59.849235 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 0c4aad35-0f98-4e28-8018-c199999da418 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:39:59.850643 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:59.855178 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:59.862562 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.db [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] For port 629d0b34-445c-4313-b738-d9083c86fbce, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94349) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:39:59.874674 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.db [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] For port 629d0b34-445c-4313-b738-d9083c86fbce, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=629d0b34-445c-4313-b738-d9083c86fbce,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94349) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:39:59.884495 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:59.887681 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-341627b2-ad48-4237-9b30-2316470ac233 req-66af8b73-a1d9-470d-8ef6-186b0961b368 service neutron] Port 1f9a3d54-fb75-4f0c-8013-46a939823a2e on network fe2753d3-7f3b-4739-adbf-6643a840c73e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80447 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 18 08:39:59.888018 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-341627b2-ad48-4237-9b30-2316470ac233 req-66af8b73-a1d9-470d-8ef6-186b0961b368 service neutron] Attempting to bind port 1f9a3d54-fb75-4f0c-8013-46a939823a2e on network fe2753d3-7f3b-4739-adbf-6643a840c73e {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:39:59.898343 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-341627b2-ad48-4237-9b30-2316470ac233 req-66af8b73-a1d9-470d-8ef6-186b0961b368 service neutron] Checking agent: {'id': '8d51fdc4-974b-4200-9c3f-5dddea60a869', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80447', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'started_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 39, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:39:59.898688 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-341627b2-ad48-4237-9b30-2316470ac233 req-66af8b73-a1d9-470d-8ef6-186b0961b368 service neutron] Checking segment: {'id': 'd1432479-9c27-42c4-87db-6905e7868675', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 233, 'network_id': 'fe2753d3-7f3b-4739-adbf-6643a840c73e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94347) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:39:59.899084 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-341627b2-ad48-4237-9b30-2316470ac233 req-66af8b73-a1d9-470d-8ef6-186b0961b368 service neutron] Bound using segment: {'id': 'd1432479-9c27-42c4-87db-6905e7868675', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 233, 'network_id': 'fe2753d3-7f3b-4739-adbf-6643a840c73e'} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:39:59.899534 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-341627b2-ad48-4237-9b30-2316470ac233 req-66af8b73-a1d9-470d-8ef6-186b0961b368 service neutron] Bound port: 1f9a3d54-fb75-4f0c-8013-46a939823a2e, host: hv-cinder-80447, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd1432479-9c27-42c4-87db-6905e7868675', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 233, 'network_id': 'fe2753d3-7f3b-4739-adbf-6643a840c73e'}}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:39:59.899891 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-341627b2-ad48-4237-9b30-2316470ac233 req-66af8b73-a1d9-470d-8ef6-186b0961b368 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:39:59.948407 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b7f37c0-c209-4df8-addb-8b2e39d67328 None None] Pushing event updated for resources: {'Port': ['ID=629d0b34-445c-4313-b738-d9083c86fbce,revision_number=3']} {{(pid=94349) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:39:59.955349 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-13aa24db-194f-4208-a1af-2cd8026bf4bb req-77ddb1bd-ccb6-4f6c-bdd6-cd4f3e46922d tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1172864 Sep 18 08:40:00.007156 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] Routers {'11fd14b5-1378-4aa8-9fbb-a4577850589e'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:40:00.008087 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:39:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['11fd14b5-1378-4aa8-9fbb-a4577850589e'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:40:00.029237 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=b7ffb91b-4d87-4a7b-9de9-7e947fb6d687,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:00.032916 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-708b0df0-181d-48b5-bfdb-6e8f51779b2f admin admin] Notify callbacks [] for port, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:00.037192 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-b85a8bf7-9cb6-4cf1-b736-46208ab015d1 None None] Provisioning complete for port 0c4aad35-0f98-4e28-8018-c199999da418 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:40:00.037745 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-b85a8bf7-9cb6-4cf1-b736-46208ab015d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:00.094900 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf6d0a61-7262-4f1a-a931-649641866da4 req-db83e4db-eec7-43be-8a38-ade349c32cb9 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:00.096520 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cf6d0a61-7262-4f1a-a931-649641866da4 req-db83e4db-eec7-43be-8a38-ade349c32cb9 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=ed593970-f617-452d-95b7-c2fd7615fd0a HTTP/1.1" status: 200 len: 944 time: 0.2428596 Sep 18 08:40:00.138435 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-708b0df0-181d-48b5-bfdb-6e8f51779b2f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:00.204438 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-708b0df0-181d-48b5-bfdb-6e8f51779b2f admin admin] Network 71ee8a3f-e7a5-4917-924c-07e7cffbbf9f is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:40:00.210854 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-708b0df0-181d-48b5-bfdb-6e8f51779b2f admin admin] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:40:00.214676 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [None req-708b0df0-181d-48b5-bfdb-6e8f51779b2f admin admin] Received port after_create {{(pid=94346) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:40:00.265189 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-341627b2-ad48-4237-9b30-2316470ac233 req-66af8b73-a1d9-470d-8ef6-186b0961b368 service neutron] For port 1f9a3d54-fb75-4f0c-8013-46a939823a2e, host hv-cinder-80447, cleared binding levels {{(pid=94347) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:40:00.284006 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cf6d0a61-7262-4f1a-a931-649641866da4 req-1344db17-170d-4b06-adbd-b5f985ab9ef2 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1690466 Sep 18 08:40:00.316378 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-341627b2-ad48-4237-9b30-2316470ac233 req-66af8b73-a1d9-470d-8ef6-186b0961b368 service neutron] For port 1f9a3d54-fb75-4f0c-8013-46a939823a2e, host hv-cinder-80447, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=1f9a3d54-fb75-4f0c-8013-46a939823a2e,segment=NetworkSegment(d1432479-9c27-42c4-87db-6905e7868675),segment_id=d1432479-9c27-42c4-87db-6905e7868675)] {{(pid=94347) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:40:00.331414 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-341627b2-ad48-4237-9b30-2316470ac233 req-66af8b73-a1d9-470d-8ef6-186b0961b368 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:00.376226 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-708b0df0-181d-48b5-bfdb-6e8f51779b2f admin admin] Pushing event updated for resources: {'Port': ['ID=5fca4850-9dbe-4847-a121-123f4a9dc375,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:00.401087 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] Set router 11fd14b5-1378-4aa8-9fbb-a4577850589e gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:40:00.412842 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-708b0df0-181d-48b5-bfdb-6e8f51779b2f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-785025'] for router_interface, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:00.434981 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:00.457606 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-341627b2-ad48-4237-9b30-2316470ac233 req-66af8b73-a1d9-470d-8ef6-186b0961b368 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:00.458376 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-341627b2-ad48-4237-9b30-2316470ac233 req-66af8b73-a1d9-470d-8ef6-186b0961b368 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:00.460337 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-341627b2-ad48-4237-9b30-2316470ac233 req-66af8b73-a1d9-470d-8ef6-186b0961b368 service neutron] 10.222.0.13 "PUT /v2.0/ports/1f9a3d54-fb75-4f0c-8013-46a939823a2e HTTP/1.1" status: 200 len: 1094 time: 1.6539237 Sep 18 08:40:00.556409 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-536c997d-2873-442a-81bf-9fe918803742 None None] For port 0c4aad35-0f98-4e28-8018-c199999da418, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=0c4aad35-0f98-4e28-8018-c199999da418,segment=NetworkSegment(260fc424-2182-42ea-bfe3-fe4a03948384),segment_id=260fc424-2182-42ea-bfe3-fe4a03948384)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:40:00.654106 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-b85a8bf7-9cb6-4cf1-b736-46208ab015d1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:00.666128 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ed593970-f617-452d-95b7-c2fd7615fd0a', 'tag': '1f9a3d54-fb75-4f0c-8013-46a939823a2e'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:40:00.672619 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fb05e82c-d399-499d-93da-0c0b69af96e0" -d '{"events": [{"name": "network-changed", "server_uuid": "ed593970-f617-452d-95b7-c2fd7615fd0a", "tag": "1f9a3d54-fb75-4f0c-8013-46a939823a2e"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:40:00.683170 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:00.686683 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['b7ffb91b-4d87-4a7b-9de9-7e947fb6d687'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:40:00.801265 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-708b0df0-181d-48b5-bfdb-6e8f51779b2f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:00.947998 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 57858) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:00.963000 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '11fd14b5-1378-4aa8-9fbb-a4577850589e', 'name': 'tempest-TestShelveInstance-608586296-router', 'tenant_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.125'}], 'enable_snat': True}, 'gw_port_id': '629d0b34-445c-4313-b738-d9083c86fbce', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:39:55Z', 'updated_at': '2021-09-18T08:39:56Z', 'revision_number': 3, 'project_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'gw_port': {'id': '629d0b34-445c-4313-b738-d9083c86fbce', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:50:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11fd14b5-1378-4aa8-9fbb-a4577850589e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 326, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.125', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:55Z', 'updated_at': '2021-09-18T08:39:59Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:40:00.991707 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Pushing event updated for resources: {'Port': ['ID=0c4aad35-0f98-4e28-8018-c199999da418,revision_number=3']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:01.013915 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 27a509fa-10dc-4ef1-bb19-0a80691837ef no longer exists at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:40:01.033569 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65e099a1-52cb-4e86-97b4-34ed98eb7e2e None None] The sync data for ids ['11fd14b5-1378-4aa8-9fbb-a4577850589e'] in dv-cinder-804470-6-iscsi is: [{'id': '11fd14b5-1378-4aa8-9fbb-a4577850589e', 'name': 'tempest-TestShelveInstance-608586296-router', 'tenant_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.125'}], 'enable_snat': True}, 'gw_port_id': '629d0b34-445c-4313-b738-d9083c86fbce', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:39:55Z', 'updated_at': '2021-09-18T08:39:56Z', 'revision_number': 3, 'project_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'gw_port': {'id': '629d0b34-445c-4313-b738-d9083c86fbce', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:50:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11fd14b5-1378-4aa8-9fbb-a4577850589e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 326, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.125', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:55Z', 'updated_at': '2021-09-18T08:39:59Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}] {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:40:01.056867 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] No Port match for: 27a509fa-10dc-4ef1-bb19-0a80691837ef {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:40:01.057520 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 27a509fa-10dc-4ef1-bb19-0a80691837ef not bound to the agent host hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:40:01.141894 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.db.api [None req-b85a8bf7-9cb6-4cf1-b736-46208ab015d1 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=94348) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Sep 18 08:40:01.142309 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG oslo_db.api [None req-b85a8bf7-9cb6-4cf1-b736-46208ab015d1 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Sep 18 08:40:01.275617 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-708b0df0-181d-48b5-bfdb-6e8f51779b2f admin admin] Notify callbacks [] for port, precommit_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:01.321458 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-708b0df0-181d-48b5-bfdb-6e8f51779b2f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14290155'] for port, after_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:01.321897 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:40:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-63a14835-dedf-47e8-895d-ee82cd410a78 x-openstack-request-id: req-63a14835-dedf-47e8-895d-ee82cd410a78 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:40:01.322341 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ed593970-f617-452d-95b7-c2fd7615fd0a", "tag": "1f9a3d54-fb75-4f0c-8013-46a939823a2e", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:40:01.322421 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-63a14835-dedf-47e8-895d-ee82cd410a78 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:40:01.322803 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ed593970-f617-452d-95b7-c2fd7615fd0a', 'tag': '1f9a3d54-fb75-4f0c-8013-46a939823a2e', 'status': 'completed', 'code': 200} Sep 18 08:40:01.325644 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66af8b73-a1d9-470d-8ef6-186b0961b368 service neutron] Pushing event updated for resources: {'Port': ['ID=1f9a3d54-fb75-4f0c-8013-46a939823a2e,revision_number=3']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:01.398154 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-881dd17e-27f7-4dce-8255-28425975a45d admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:01.426493 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9896412a-0a47-4042-b844-57608b082350 req-5fc3ba87-34cf-4d95-8201-a0f5552f8202 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:01.435361 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9896412a-0a47-4042-b844-57608b082350 req-5fc3ba87-34cf-4d95-8201-a0f5552f8202 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8949a467-d4ed-449f-be4b-3fe465e79fd7 HTTP/1.1" status: 200 len: 945 time: 0.9624715 Sep 18 08:40:01.492174 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-708b0df0-181d-48b5-bfdb-6e8f51779b2f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-580051', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-783377'] for router_interface, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:01.516849 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-708b0df0-181d-48b5-bfdb-6e8f51779b2f admin admin] Pushing event updated for resources: {'Port': ['ID=5fca4850-9dbe-4847-a121-123f4a9dc375,revision_number=2']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:01.521952 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9896412a-0a47-4042-b844-57608b082350 req-534d7ea9-477c-4610-936c-e6e0b48822e8 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0825927 Sep 18 08:40:01.545020 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-341627b2-ad48-4237-9b30-2316470ac233 req-d7a61185-1e29-4937-91d9-8dba673574d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:01.547812 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-341627b2-ad48-4237-9b30-2316470ac233 req-d7a61185-1e29-4937-91d9-8dba673574d5 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=38bd82e43ad3497aa14e8e4e68a29009&device_id=ed593970-f617-452d-95b7-c2fd7615fd0a HTTP/1.1" status: 200 len: 1097 time: 0.9824779 Sep 18 08:40:01.550379 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 0c4aad35-0f98-4e28-8018-c199999da418 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:40:01.661388 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c7aeca2-22b6-4893-80a6-bf270e363389 req-2b18f009-ab63-452f-ab6c-8ce61986cb38 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:01.669539 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9c7aeca2-22b6-4893-80a6-bf270e363389 req-2b18f009-ab63-452f-ab6c-8ce61986cb38 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.3457487 Sep 18 08:40:01.709161 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-341627b2-ad48-4237-9b30-2316470ac233 req-acd09094-a20f-479b-88f5-d853cb55b1e1 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=1f9a3d54-fb75-4f0c-8013-46a939823a2e HTTP/1.1" status: 200 len: 217 time: 0.1305847 Sep 18 08:40:01.776879 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 0c4aad35-0f98-4e28-8018-c199999da418 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:40:01.779287 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:01.828410 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9c7aeca2-22b6-4893-80a6-bf270e363389 req-27d37032-56a2-4536-ad94-8106ae4e39c9 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1578522 Sep 18 08:40:01.836366 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-341627b2-ad48-4237-9b30-2316470ac233 req-5622c784-f480-41a4-b07b-9d66fa3d09fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:01.838094 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-341627b2-ad48-4237-9b30-2316470ac233 req-5622c784-f480-41a4-b07b-9d66fa3d09fe service neutron] 10.222.0.13 "GET /v2.0/subnets?id=b96e08ba-91b8-4c1f-bd27-4a1270ccbde2 HTTP/1.1" status: 200 len: 855 time: 0.0955038 Sep 18 08:40:01.840607 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-708b0df0-181d-48b5-bfdb-6e8f51779b2f admin admin] Network 71ee8a3f-e7a5-4917-924c-07e7cffbbf9f is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:40:01.851511 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-708b0df0-181d-48b5-bfdb-6e8f51779b2f admin admin] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:40:01.863270 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e11fc0b9-7300-4076-9acc-67c5a0776800 req-5e18c64b-70cd-4ee9-a755-dd71b098a0a8 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:01.874752 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e11fc0b9-7300-4076-9acc-67c5a0776800 req-5e18c64b-70cd-4ee9-a755-dd71b098a0a8 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=ed593970-f617-452d-95b7-c2fd7615fd0a HTTP/1.1" status: 200 len: 944 time: 0.2236445 Sep 18 08:40:01.917532 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-4a238b2e-72a8-4f0c-b443-76dd38f65556 None None] Provisioning complete for port 5fca4850-9dbe-4847-a121-123f4a9dc375 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:40:01.918117 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-4a238b2e-72a8-4f0c-b443-76dd38f65556 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:01.929369 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-881dd17e-27f7-4dce-8255-28425975a45d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:01.933498 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-341627b2-ad48-4237-9b30-2316470ac233 req-3791c55e-8eb8-4bb3-99f5-919cdfb34a97 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fe2753d3-7f3b-4739-adbf-6643a840c73e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0562916 Sep 18 08:40:02.002608 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-881dd17e-27f7-4dce-8255-28425975a45d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:02.048303 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-881dd17e-27f7-4dce-8255-28425975a45d admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=3266c217157e4070ae25ae56de18a0cb&name=default HTTP/1.1" status: 200 len: 2979 time: 1.0909669 Sep 18 08:40:02.049979 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 57902) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:02.074525 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 23821731-be27-4d6b-834b-f6953b4d873a up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:40:02.076320 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-4a238b2e-72a8-4f0c-b443-76dd38f65556 None None] Port 5fca4850-9dbe-4847-a121-123f4a9dc375 cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:40:02.113614 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-341627b2-ad48-4237-9b30-2316470ac233 req-50fdde38-2389-40f1-b572-b7c422bbd520 service neutron] 10.222.0.13 "GET /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1609678 Sep 18 08:40:02.127849 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-4a238b2e-72a8-4f0c-b443-76dd38f65556 None None] Provisioning complete for port 0c4aad35-0f98-4e28-8018-c199999da418 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:40:02.128233 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-4a238b2e-72a8-4f0c-b443-76dd38f65556 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:02.140142 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e11fc0b9-7300-4076-9acc-67c5a0776800 req-16625b0b-34e0-4506-875e-c588d91ccd6e tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2646403 Sep 18 08:40:02.181704 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ec0c7129-07de-4c8d-982e-854889585865 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:02.208261 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ec0c7129-07de-4c8d-982e-854889585865 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:02.272321 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-881dd17e-27f7-4dce-8255-28425975a45d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=97a50fd2-38bb-4c92-b444-1d631e2c5f73,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:02.293470 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ec0c7129-07de-4c8d-982e-854889585865 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:02.298059 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 23821731-be27-4d6b-834b-f6953b4d873a triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:40:02.298628 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:02.302829 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ec0c7129-07de-4c8d-982e-854889585865 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:02.306778 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-ec0c7129-07de-4c8d-982e-854889585865 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/97a50fd2-38bb-4c92-b444-1d631e2c5f73 HTTP/1.1" status: 204 len: 168 time: 0.2528055 Sep 18 08:40:02.357127 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec0c7129-07de-4c8d-982e-854889585865 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=97a50fd2-38bb-4c92-b444-1d631e2c5f73,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:02.392683 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-708b0df0-181d-48b5-bfdb-6e8f51779b2f admin admin] Router 11fd14b5-1378-4aa8-9fbb-a4577850589e has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94346) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:40:02.404028 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-341627b2-ad48-4237-9b30-2316470ac233 req-b841fa0c-9715-4b24-9a53-afe28d1a069c service neutron] 10.222.0.13 "GET /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2671599 Sep 18 08:40:02.639305 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-9696be5f-58fe-4f24-97f1-bfe8f3909e6e None None] Provisioning complete for port 5fca4850-9dbe-4847-a121-123f4a9dc375 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:40:02.639679 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-9696be5f-58fe-4f24-97f1-bfe8f3909e6e None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:02.646198 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-708b0df0-181d-48b5-bfdb-6e8f51779b2f admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94346) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:40:02.651952 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-708b0df0-181d-48b5-bfdb-6e8f51779b2f admin admin] 10.222.0.35 "PUT /v2.0/routers/11fd14b5-1378-4aa8-9fbb-a4577850589e/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.8003833 Sep 18 08:40:02.663373 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb05e82c-d399-499d-93da-0c0b69af96e0 req-bb216ff7-e480-4b5c-84f5-b699f4755f6e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:02.664896 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fb05e82c-d399-499d-93da-0c0b69af96e0 req-bb216ff7-e480-4b5c-84f5-b699f4755f6e service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=38bd82e43ad3497aa14e8e4e68a29009&device_id=ed593970-f617-452d-95b7-c2fd7615fd0a HTTP/1.1" status: 200 len: 1097 time: 0.1388440 Sep 18 08:40:02.796911 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e02e5f86-29fc-479e-a447-40485bae15fc req-0bb67fb4-09d8-43aa-80c5-19b69fac9827 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:02.804575 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-9696be5f-58fe-4f24-97f1-bfe8f3909e6e None None] Port 5fca4850-9dbe-4847-a121-123f4a9dc375 cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:40:02.804788 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e02e5f86-29fc-479e-a447-40485bae15fc req-0bb67fb4-09d8-43aa-80c5-19b69fac9827 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8949a467-d4ed-449f-be4b-3fe465e79fd7 HTTP/1.1" status: 200 len: 945 time: 0.1837835 Sep 18 08:40:02.808005 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb05e82c-d399-499d-93da-0c0b69af96e0 req-37b266e1-02bd-4d9b-8c25-0c726027e60f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:02.809488 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fb05e82c-d399-499d-93da-0c0b69af96e0 req-37b266e1-02bd-4d9b-8c25-0c726027e60f service neutron] 10.222.0.13 "GET /v2.0/networks?id=fe2753d3-7f3b-4739-adbf-6643a840c73e HTTP/1.1" status: 200 len: 916 time: 0.1292455 Sep 18 08:40:02.862809 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device b7ffb91b-4d87-4a7b-9de9-7e947fb6d687 up at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:40:02.869728 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fb05e82c-d399-499d-93da-0c0b69af96e0 req-04e01a6a-0ff6-4838-b734-f6e5a9d86d38 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=1f9a3d54-fb75-4f0c-8013-46a939823a2e HTTP/1.1" status: 200 len: 217 time: 0.0448360 Sep 18 08:40:02.899613 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e02e5f86-29fc-479e-a447-40485bae15fc req-0557d5b0-ea10-4c5d-b9d8-dcdac2361678 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0938404 Sep 18 08:40:02.941333 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning for port b7ffb91b-4d87-4a7b-9de9-7e947fb6d687 completed by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 18 08:40:02.947652 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning complete for port b7ffb91b-4d87-4a7b-9de9-7e947fb6d687 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:40:02.948266 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:02.952571 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb05e82c-d399-499d-93da-0c0b69af96e0 req-b4ba5dd2-249d-4ad0-816f-0e4009ef1158 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:02.954460 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fb05e82c-d399-499d-93da-0c0b69af96e0 req-b4ba5dd2-249d-4ad0-816f-0e4009ef1158 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=b96e08ba-91b8-4c1f-bd27-4a1270ccbde2 HTTP/1.1" status: 200 len: 855 time: 0.0761456 Sep 18 08:40:02.957291 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 57982) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:03.013496 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fb05e82c-d399-499d-93da-0c0b69af96e0 req-7a1b8524-c7e5-4994-a736-f42367b64e5f service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fe2753d3-7f3b-4739-adbf-6643a840c73e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0463369 Sep 18 08:40:03.051491 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-4b0a2d93-9440-4755-8f83-004f25e209be admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:03.108346 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:03.150084 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8949a467-d4ed-449f-be4b-3fe465e79fd7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b7ffb91b-4d87-4a7b-9de9-7e947fb6d687'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:40:03.152668 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b030d137-5ad3-42ab-8acb-6cae9180501a" -d '{"events": [{"server_uuid": "8949a467-d4ed-449f-be4b-3fe465e79fd7", "name": "network-vif-plugged", "status": "completed", "tag": "b7ffb91b-4d87-4a7b-9de9-7e947fb6d687"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:40:03.182328 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port b7ffb91b-4d87-4a7b-9de9-7e947fb6d687, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=b7ffb91b-4d87-4a7b-9de9-7e947fb6d687,segment=NetworkSegment(4f8dffb0-f8d4-41b5-beed-53bcf370cb42),segment_id=4f8dffb0-f8d4-41b5-beed-53bcf370cb42)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:40:03.190595 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:03.304736 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=b7ffb91b-4d87-4a7b-9de9-7e947fb6d687,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:03.351661 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d13667a6-981e-4dd9-8e2f-a5f8191c4c86 req-2714f4f9-c2dd-48c6-8efd-01fbbe8a1aac tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:03.353396 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d13667a6-981e-4dd9-8e2f-a5f8191c4c86 req-2714f4f9-c2dd-48c6-8efd-01fbbe8a1aac tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.3389149 Sep 18 08:40:03.423253 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fb05e82c-d399-499d-93da-0c0b69af96e0 req-55d09186-c22e-47a1-a1ee-6384b42eda3e service neutron] 10.222.0.13 "GET /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3739645 Sep 18 08:40:03.436893 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 629d0b34-445c-4313-b738-d9083c86fbce up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:40:03.494671 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d13667a6-981e-4dd9-8e2f-a5f8191c4c86 req-7a524eee-07cc-4e44-8b42-c233c62c03d7 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1255832 Sep 18 08:40:03.500605 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 629d0b34-445c-4313-b738-d9083c86fbce triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:40:03.500995 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:03.509072 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-4b0a2d93-9440-4755-8f83-004f25e209be admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:03.574719 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-4b0a2d93-9440-4755-8f83-004f25e209be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:03.583320 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] Sync routers for ids ['11fd14b5-1378-4aa8-9fbb-a4577850589e'] in dv-cinder-804470-6-iscsi {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:40:03.616716 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] Routers {'11fd14b5-1378-4aa8-9fbb-a4577850589e'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:40:03.617475 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:39:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['11fd14b5-1378-4aa8-9fbb-a4577850589e'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:40:03.624220 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 58012) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:03.629153 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-3fec7a4d-8c8e-41b9-a277-07032081896d tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-217661707', 'description': 'tempest-secgroup-smoke-217661707 description', 'project_id': '467aba0ce03e40a6927a5c05223dd512'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:40:03.639330 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b0a2d93-9440-4755-8f83-004f25e209be admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1347b11c-1236-4591-b364-5703c5cac3c4,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:03.648904 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-4b0a2d93-9440-4755-8f83-004f25e209be admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=9f55d77f81f5440c954cc028d090237c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6902080 Sep 18 08:40:03.656020 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 58014) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:03.672039 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fb05e82c-d399-499d-93da-0c0b69af96e0 req-005a86ae-cb0d-4d82-a97e-f1c0d561c87e service neutron] 10.222.0.13 "GET /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2402170 Sep 18 08:40:03.685350 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:03.686844 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3fec7a4d-8c8e-41b9-a277-07032081896d tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:03.739134 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:40:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-52453c04-9854-407a-8196-c55bb69b6061 x-openstack-request-id: req-52453c04-9854-407a-8196-c55bb69b6061 {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:40:03.739413 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8949a467-d4ed-449f-be4b-3fe465e79fd7", "name": "network-vif-plugged", "status": "completed", "tag": "b7ffb91b-4d87-4a7b-9de9-7e947fb6d687", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:40:03.739545 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-52453c04-9854-407a-8196-c55bb69b6061 {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:40:03.740005 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8949a467-d4ed-449f-be4b-3fe465e79fd7', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b7ffb91b-4d87-4a7b-9de9-7e947fb6d687', 'code': 200} Sep 18 08:40:03.746910 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-536c997d-2873-442a-81bf-9fe918803742 None None] For port 629d0b34-445c-4313-b738-d9083c86fbce, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=629d0b34-445c-4313-b738-d9083c86fbce,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:40:03.752632 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:03.800871 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-735b8e23-f1ee-4a01-9e39-16f0a478de38 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:03.813889 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Pushing event updated for resources: {'Port': ['ID=629d0b34-445c-4313-b738-d9083c86fbce,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:03.830146 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] Set router 11fd14b5-1378-4aa8-9fbb-a4577850589e gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:40:03.835615 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b31dc595-ce3d-4fb1-93dc-2146c1103578 req-54c6f43f-37ea-4eb8-9f42-6d2d4085e157 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:03.838059 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b31dc595-ce3d-4fb1-93dc-2146c1103578 req-54c6f43f-37ea-4eb8-9f42-6d2d4085e157 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=ed593970-f617-452d-95b7-c2fd7615fd0a HTTP/1.1" status: 200 len: 944 time: 0.0882385 Sep 18 08:40:03.850709 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-735b8e23-f1ee-4a01-9e39-16f0a478de38 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:03.898395 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b31dc595-ce3d-4fb1-93dc-2146c1103578 req-8fd5f2ca-72d0-424b-ba57-85a3a5827d22 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0536270 Sep 18 08:40:03.968250 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3fec7a4d-8c8e-41b9-a277-07032081896d tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:03.979290 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3fec7a4d-8c8e-41b9-a277-07032081896d tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:04.018702 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-735b8e23-f1ee-4a01-9e39-16f0a478de38 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:04.021254 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-735b8e23-f1ee-4a01-9e39-16f0a478de38 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:04.024756 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-735b8e23-f1ee-4a01-9e39-16f0a478de38 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/1347b11c-1236-4591-b364-5703c5cac3c4 HTTP/1.1" status: 204 len: 168 time: 0.3634641 Sep 18 08:40:04.050569 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80230e9a-c5c5-4cd9-923e-9d42f33d9747 req-af807a10-32fd-4d96-bbd5-710405ada7a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:04.052730 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-80230e9a-c5c5-4cd9-923e-9d42f33d9747 req-af807a10-32fd-4d96-bbd5-710405ada7a5 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=8949a467-d4ed-449f-be4b-3fe465e79fd7 HTTP/1.1" status: 200 len: 1099 time: 0.0784576 Sep 18 08:40:04.056911 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3fec7a4d-8c8e-41b9-a277-07032081896d tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:04.062711 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-3fec7a4d-8c8e-41b9-a277-07032081896d tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1792 time: 0.4374392 Sep 18 08:40:04.063366 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 58064) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:04.066366 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fec7a4d-8c8e-41b9-a277-07032081896d tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4468335f-9dd9-4e13-b58c-f44e8d1615f2,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:04.072218 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-b4158edc-acd0-4b7a-939b-676517f4a6c2 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Request body: {'security_group_rule': {'security_group_id': '4468335f-9dd9-4e13-b58c-f44e8d1615f2', 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:40:04.095518 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-735b8e23-f1ee-4a01-9e39-16f0a478de38 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1347b11c-1236-4591-b364-5703c5cac3c4,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:04.119340 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-80230e9a-c5c5-4cd9-923e-9d42f33d9747 req-461bd123-d798-4bd8-a730-6b2506489e9d service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446339 Sep 18 08:40:04.127539 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '11fd14b5-1378-4aa8-9fbb-a4577850589e', 'name': 'tempest-TestShelveInstance-608586296-router', 'tenant_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.125'}], 'enable_snat': True}, 'gw_port_id': '629d0b34-445c-4313-b738-d9083c86fbce', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:39:55Z', 'updated_at': '2021-09-18T08:40:00Z', 'revision_number': 4, 'project_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'gw_port': {'id': '629d0b34-445c-4313-b738-d9083c86fbce', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:50:d2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11fd14b5-1378-4aa8-9fbb-a4577850589e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 326, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.125', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:55Z', 'updated_at': '2021-09-18T08:39:59Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '5fca4850-9dbe-4847-a121-123f4a9dc375', 'name': '', 'network_id': '71ee8a3f-e7a5-4917-924c-07e7cffbbf9f', 'tenant_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'mac_address': 'fa:16:3e:c8:cc:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11fd14b5-1378-4aa8-9fbb-a4577850589e', 'device_owner': 'network:router_interface', 'standard_attr_id': 328, 'fixed_ips': [{'subnet_id': '979e5af3-22a3-4c66-a051-2000dea384e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:59Z', 'updated_at': '2021-09-18T08:40:00Z', 'revision_number': 2, 'project_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'subnets': [{'id': '979e5af3-22a3-4c66-a051-2000dea384e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:40:04.131454 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b4158edc-acd0-4b7a-939b-676517f4a6c2 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:04.141778 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91ab8230-1622-4686-b05d-e197a5b77a99 req-6f3fa780-e7ba-41bc-a1d6-b6821c5adb87 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:04.143471 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-91ab8230-1622-4686-b05d-e197a5b77a99 req-6f3fa780-e7ba-41bc-a1d6-b6821c5adb87 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8949a467-d4ed-449f-be4b-3fe465e79fd7 HTTP/1.1" status: 200 len: 946 time: 0.1109045 Sep 18 08:40:04.158298 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] Checking router: 11fd14b5-1378-4aa8-9fbb-a4577850589e for host: dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:40:04.158698 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] Updating router 11fd14b5-1378-4aa8-9fbb-a4577850589e port 5fca4850-9dbe-4847-a121-123f4a9dc375 binding host dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 18 08:40:04.186266 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:04.193955 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-91ab8230-1622-4686-b05d-e197a5b77a99 req-a5caee65-96e8-437d-a58a-58d23f82ec83 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430255 Sep 18 08:40:04.218123 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b4158edc-acd0-4b7a-939b-676517f4a6c2 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:04.223785 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b4158edc-acd0-4b7a-939b-676517f4a6c2 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-561193'] for security_group_rule, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:04.243177 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4158edc-acd0-4b7a-939b-676517f4a6c2 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5c9ec92e-5790-42e0-b255-c4dbda46f63d,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:04.254910 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b4158edc-acd0-4b7a-939b-676517f4a6c2 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:04.256781 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-b4158edc-acd0-4b7a-939b-676517f4a6c2 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1915498 Sep 18 08:40:04.259524 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 58078) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:04.264015 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-12ce4a4c-002a-4008-b3f6-25c0e956da63 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Request body: {'security_group_rule': {'security_group_id': '4468335f-9dd9-4e13-b58c-f44e8d1615f2', 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:40:04.296828 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-12ce4a4c-002a-4008-b3f6-25c0e956da63 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:04.370769 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-12ce4a4c-002a-4008-b3f6-25c0e956da63 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:04.381681 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-12ce4a4c-002a-4008-b3f6-25c0e956da63 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-561193'] for security_group_rule, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:04.419326 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12ce4a4c-002a-4008-b3f6-25c0e956da63 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dab34df4-3d2b-4c92-bcbd-6c7ae280e3e5,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:04.427329 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-12ce4a4c-002a-4008-b3f6-25c0e956da63 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:04.428868 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-12ce4a4c-002a-4008-b3f6-25c0e956da63 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1681771 Sep 18 08:40:04.431658 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 58094) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:04.438233 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-680c9682-edaf-43f5-b4d1-a7e43e2231c9 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Request body: {'security_group_rule': {'security_group_id': '4468335f-9dd9-4e13-b58c-f44e8d1615f2', 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:40:04.513867 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-680c9682-edaf-43f5-b4d1-a7e43e2231c9 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:04.571230 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] Notify callbacks [] for port, precommit_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:04.583407 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:04.608344 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-680c9682-edaf-43f5-b4d1-a7e43e2231c9 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:04.614000 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-680c9682-edaf-43f5-b4d1-a7e43e2231c9 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-561193'] for security_group_rule, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:04.647437 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-680c9682-edaf-43f5-b4d1-a7e43e2231c9 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:04.648775 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-680c9682-edaf-43f5-b4d1-a7e43e2231c9 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2161162 Sep 18 08:40:04.651795 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 58122) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:04.657055 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-7cfd9215-2c95-44bd-a830-850f92542e23 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Request body: {'security_group_rule': {'security_group_id': '4468335f-9dd9-4e13-b58c-f44e8d1615f2', 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:40:04.685757 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67cfffd8-30f1-48e5-943d-cf62accdf07c None None] Pushing event updated for resources: {'Port': ['ID=5fca4850-9dbe-4847-a121-123f4a9dc375,revision_number=3']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:04.699114 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-680c9682-edaf-43f5-b4d1-a7e43e2231c9 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=11fdc191-733f-4437-a1eb-c38d80593693,revision_number=0']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:04.737756 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7cfd9215-2c95-44bd-a830-850f92542e23 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:04.759882 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4670fe2a-c081-41ac-87b4-bcba2dc31ae1 req-c0838e35-dac0-4dbe-88b0-7c73e056e89b tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:04.777355 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4670fe2a-c081-41ac-87b4-bcba2dc31ae1 req-c0838e35-dac0-4dbe-88b0-7c73e056e89b tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.1331527 Sep 18 08:40:04.798866 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] Attempting to bind port 5fca4850-9dbe-4847-a121-123f4a9dc375 on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:40:04.799249 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] Attempting to bind port 5fca4850-9dbe-4847-a121-123f4a9dc375 by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': '260fc424-2182-42ea-bfe3-fe4a03948384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 225, 'network_id': '71ee8a3f-e7a5-4917-924c-07e7cffbbf9f'}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:40:04.804279 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] Attempting to bind port 5fca4850-9dbe-4847-a121-123f4a9dc375 on network 71ee8a3f-e7a5-4917-924c-07e7cffbbf9f {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:40:04.819265 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 39, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:40:04.819802 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] Checking segment: {'id': '260fc424-2182-42ea-bfe3-fe4a03948384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 225, 'network_id': '71ee8a3f-e7a5-4917-924c-07e7cffbbf9f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94348) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:40:04.820732 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:04.821273 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] Bound using segment: {'id': '260fc424-2182-42ea-bfe3-fe4a03948384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 225, 'network_id': '71ee8a3f-e7a5-4917-924c-07e7cffbbf9f'} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:40:04.821879 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] Bound port: 5fca4850-9dbe-4847-a121-123f4a9dc375, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '260fc424-2182-42ea-bfe3-fe4a03948384', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 225, 'network_id': '71ee8a3f-e7a5-4917-924c-07e7cffbbf9f'}}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:40:04.822376 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:04.861382 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4670fe2a-c081-41ac-87b4-bcba2dc31ae1 req-993a5f29-11fe-406c-bdee-ae447504ff49 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0765829 Sep 18 08:40:04.898917 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] For port 5fca4850-9dbe-4847-a121-123f4a9dc375, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94348) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:40:04.902342 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] For port 5fca4850-9dbe-4847-a121-123f4a9dc375, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=5fca4850-9dbe-4847-a121-123f4a9dc375,segment=NetworkSegment(260fc424-2182-42ea-bfe3-fe4a03948384),segment_id=260fc424-2182-42ea-bfe3-fe4a03948384)] {{(pid=94348) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:40:04.914227 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7cfd9215-2c95-44bd-a830-850f92542e23 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:04.914548 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:04.922729 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7cfd9215-2c95-44bd-a830-850f92542e23 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-561193'] for security_group_rule, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:04.944648 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cfd9215-2c95-44bd-a830-850f92542e23 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=279bbf31-8ad8-4f6e-8421-b3373fae1d72,revision_number=0']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:04.952273 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7cfd9215-2c95-44bd-a830-850f92542e23 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:04.957461 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-7cfd9215-2c95-44bd-a830-850f92542e23 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3020754 Sep 18 08:40:04.958577 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 58148) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:04.967748 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-53be7d2c-b581-4450-9437-82ea2c491586 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Request body: {'security_group_rule': {'security_group_id': '4468335f-9dd9-4e13-b58c-f44e8d1615f2', 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:40:05.018157 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67cfffd8-30f1-48e5-943d-cf62accdf07c None None] Pushing event updated for resources: {'Port': ['ID=5fca4850-9dbe-4847-a121-123f4a9dc375,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:05.019958 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.db.securitygroups_db [None req-53be7d2c-b581-4450-9437-82ea2c491586 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Project 467aba0ce03e40a6927a5c05223dd512 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Sep 18 08:40:05.026927 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-53be7d2c-b581-4450-9437-82ea2c491586 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:05.070835 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] Routers {'11fd14b5-1378-4aa8-9fbb-a4577850589e'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:40:05.073996 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:39:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['11fd14b5-1378-4aa8-9fbb-a4577850589e'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:40:05.154414 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fb6cc06e-0b9a-48ae-851b-118c5384e80b None None] Provisioning complete for port 5fca4850-9dbe-4847-a121-123f4a9dc375 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:40:05.155024 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fb6cc06e-0b9a-48ae-851b-118c5384e80b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:05.216636 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7757ea64-4336-4b50-a7d2-613434cf30f0 req-64b0dc55-98a1-4b2f-9baf-c3adf826fb85 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:05.224393 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7757ea64-4336-4b50-a7d2-613434cf30f0 req-64b0dc55-98a1-4b2f-9baf-c3adf826fb85 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=ed593970-f617-452d-95b7-c2fd7615fd0a HTTP/1.1" status: 200 len: 944 time: 0.1349950 Sep 18 08:40:05.242247 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-53be7d2c-b581-4450-9437-82ea2c491586 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:05.250940 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] Set router 11fd14b5-1378-4aa8-9fbb-a4577850589e gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:40:05.262254 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-53be7d2c-b581-4450-9437-82ea2c491586 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-561193'] for security_group_rule, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:05.318023 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53be7d2c-b581-4450-9437-82ea2c491586 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8c0a9032-5709-4c10-9168-7747d4d5cc94,revision_number=0']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:05.326955 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-53be7d2c-b581-4450-9437-82ea2c491586 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:05.328238 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-53be7d2c-b581-4450-9437-82ea2c491586 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3681397 Sep 18 08:40:05.331760 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 58172) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:05.339380 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-b061bfdf-1319-481c-a6c5-973d71c1a54f tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Request body: {'security_group_rule': {'security_group_id': '4468335f-9dd9-4e13-b58c-f44e8d1615f2', 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:40:05.343336 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 58174) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:05.371906 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7757ea64-4336-4b50-a7d2-613434cf30f0 req-c12fc8d5-23a1-4530-b92a-9de1589032b1 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1338286 Sep 18 08:40:05.401268 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.db.securitygroups_db [None req-b061bfdf-1319-481c-a6c5-973d71c1a54f tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Project 467aba0ce03e40a6927a5c05223dd512 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Sep 18 08:40:05.416643 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b061bfdf-1319-481c-a6c5-973d71c1a54f tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:05.496127 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 629d0b34-445c-4313-b738-d9083c86fbce up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:40:05.526977 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4454315-a232-4840-9f59-96d676844a3a req-ff3c3a2d-2f2e-4a83-b78f-b93a2e996fc5 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:05.528583 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e4454315-a232-4840-9f59-96d676844a3a req-ff3c3a2d-2f2e-4a83-b78f-b93a2e996fc5 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8949a467-d4ed-449f-be4b-3fe465e79fd7 HTTP/1.1" status: 200 len: 946 time: 0.0935981 Sep 18 08:40:05.574374 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-e64d1545-36bb-431d-9a16-f1600a2ee8e8 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-2104939625-network', 'tenant_id': 'f6c648eca8dd4001ae79ed3ee33c9944'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:40:05.583763 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b061bfdf-1319-481c-a6c5-973d71c1a54f tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:05.595377 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b061bfdf-1319-481c-a6c5-973d71c1a54f tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-561193'] for security_group_rule, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:05.614471 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fb6cc06e-0b9a-48ae-851b-118c5384e80b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:05.627159 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e4454315-a232-4840-9f59-96d676844a3a req-0894cec2-22bf-47f5-8ca4-eedc0e712813 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0822041 Sep 18 08:40:05.640176 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e64d1545-36bb-431d-9a16-f1600a2ee8e8 admin admin] Made reservation on behalf of f6c648eca8dd4001ae79ed3ee33c9944 for: {'network': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:40:05.642541 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-e64d1545-36bb-431d-9a16-f1600a2ee8e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for network, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:05.647737 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b061bfdf-1319-481c-a6c5-973d71c1a54f tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f56e02c2-bc31-4a01-b4af-0aa68c93c184,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:05.676727 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b061bfdf-1319-481c-a6c5-973d71c1a54f tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:05.688305 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-b061bfdf-1319-481c-a6c5-973d71c1a54f tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3545566 Sep 18 08:40:05.692769 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-e64d1545-36bb-431d-9a16-f1600a2ee8e8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:05.703407 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fb6cc06e-0b9a-48ae-851b-118c5384e80b None None] For port 5fca4850-9dbe-4847-a121-123f4a9dc375, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=5fca4850-9dbe-4847-a121-123f4a9dc375,segment=NetworkSegment(260fc424-2182-42ea-bfe3-fe4a03948384),segment_id=260fc424-2182-42ea-bfe3-fe4a03948384)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:40:05.746970 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fb6cc06e-0b9a-48ae-851b-118c5384e80b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:05.756424 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 629d0b34-445c-4313-b738-d9083c86fbce triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:40:05.756809 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:05.887297 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb6cc06e-0b9a-48ae-851b-118c5384e80b None None] Pushing event updated for resources: {'Port': ['ID=5fca4850-9dbe-4847-a121-123f4a9dc375,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:05.906498 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-e64d1545-36bb-431d-9a16-f1600a2ee8e8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:05.913701 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-e64d1545-36bb-431d-9a16-f1600a2ee8e8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:05.935379 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '11fd14b5-1378-4aa8-9fbb-a4577850589e', 'name': 'tempest-TestShelveInstance-608586296-router', 'tenant_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.125'}], 'enable_snat': True}, 'gw_port_id': '629d0b34-445c-4313-b738-d9083c86fbce', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:39:55Z', 'updated_at': '2021-09-18T08:40:00Z', 'revision_number': 4, 'project_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'gw_port': {'id': '629d0b34-445c-4313-b738-d9083c86fbce', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:50:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '11fd14b5-1378-4aa8-9fbb-a4577850589e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 326, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.125', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:55Z', 'updated_at': '2021-09-18T08:40:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '5fca4850-9dbe-4847-a121-123f4a9dc375', 'name': '', 'network_id': '71ee8a3f-e7a5-4917-924c-07e7cffbbf9f', 'tenant_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'mac_address': 'fa:16:3e:c8:cc:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11fd14b5-1378-4aa8-9fbb-a4577850589e', 'device_owner': 'network:router_interface', 'standard_attr_id': 328, 'fixed_ips': [{'subnet_id': '979e5af3-22a3-4c66-a051-2000dea384e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:59Z', 'updated_at': '2021-09-18T08:40:04Z', 'revision_number': 4, 'project_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'subnets': [{'id': '979e5af3-22a3-4c66-a051-2000dea384e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:40:05.937400 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-7a208127-2d22-4ac8-895c-d610d38a5aee None None] Provisioning complete for port 5fca4850-9dbe-4847-a121-123f4a9dc375 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:40:05.937519 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e64d1545-36bb-431d-9a16-f1600a2ee8e8 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 206} {{(pid=94347) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 18 08:40:05.937852 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-7a208127-2d22-4ac8-895c-d610d38a5aee None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:05.959862 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-e64d1545-36bb-431d-9a16-f1600a2ee8e8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:05.960462 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.db.segments_db [None req-e64d1545-36bb-431d-9a16-f1600a2ee8e8 admin admin] Added segment 423256e4-3aa4-4a93-b180-ed8d2baea524 of type vlan for network b65d8cad-fd63-4b4e-9acf-f430f1925cb5 Sep 18 08:40:06.106687 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e64d1545-36bb-431d-9a16-f1600a2ee8e8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3805466d-8ade-4fc0-aaac-cef596cbc5c6,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:06.123452 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-e64d1545-36bb-431d-9a16-f1600a2ee8e8 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732885226527'] for network, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:06.179098 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7d55fb5-3b9d-4847-babd-74472eafce12 req-4dd36754-d336-4604-9fa7-69816ca27aa2 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:06.180693 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b7d55fb5-3b9d-4847-babd-74472eafce12 req-4dd36754-d336-4604-9fa7-69816ca27aa2 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.1776774 Sep 18 08:40:06.195883 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32d1a7c3-7d87-4116-9cdd-dbbcef553e92 None None] The sync data for ids ['11fd14b5-1378-4aa8-9fbb-a4577850589e'] in dv-cinder-804470-6-iscsi is: [{'id': '11fd14b5-1378-4aa8-9fbb-a4577850589e', 'name': 'tempest-TestShelveInstance-608586296-router', 'tenant_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.125'}], 'enable_snat': True}, 'gw_port_id': '629d0b34-445c-4313-b738-d9083c86fbce', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:39:55Z', 'updated_at': '2021-09-18T08:40:00Z', 'revision_number': 4, 'project_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'gw_port': {'id': '629d0b34-445c-4313-b738-d9083c86fbce', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:50:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '11fd14b5-1378-4aa8-9fbb-a4577850589e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 326, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.125', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:55Z', 'updated_at': '2021-09-18T08:40:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '5fca4850-9dbe-4847-a121-123f4a9dc375', 'name': '', 'network_id': '71ee8a3f-e7a5-4917-924c-07e7cffbbf9f', 'tenant_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'mac_address': 'fa:16:3e:c8:cc:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '11fd14b5-1378-4aa8-9fbb-a4577850589e', 'device_owner': 'network:router_interface', 'standard_attr_id': 328, 'fixed_ips': [{'subnet_id': '979e5af3-22a3-4c66-a051-2000dea384e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:59Z', 'updated_at': '2021-09-18T08:40:04Z', 'revision_number': 4, 'project_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'subnets': [{'id': '979e5af3-22a3-4c66-a051-2000dea384e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:40:06.212097 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-e64d1545-36bb-431d-9a16-f1600a2ee8e8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for network, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:06.213103 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e64d1545-36bb-431d-9a16-f1600a2ee8e8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:06.213726 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-e64d1545-36bb-431d-9a16-f1600a2ee8e8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:06.251792 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b3813a0-1eaf-43a0-b56e-ac5ddb98cb40 req-f005798a-724a-4bae-9b4a-4e566b990ed8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:06.253446 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0b3813a0-1eaf-43a0-b56e-ac5ddb98cb40 req-f005798a-724a-4bae-9b4a-4e566b990ed8 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 1099 time: 0.1327512 Sep 18 08:40:06.274465 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-e64d1545-36bb-431d-9a16-f1600a2ee8e8 admin admin] 10.222.0.35 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.9269376 Sep 18 08:40:06.284737 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 58270) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:06.298839 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-a4172d59-087e-4c73-b69c-b6eff2400785 admin admin] Request body: {'subnet': {'network_id': 'b65d8cad-fd63-4b4e-9acf-f430f1925cb5', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-2104939625-subnet', 'tenant_id': 'f6c648eca8dd4001ae79ed3ee33c9944', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:40:06.315563 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b7d55fb5-3b9d-4847-babd-74472eafce12 req-bfe713df-0651-4077-a893-054047e57bd0 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1274483 Sep 18 08:40:06.379621 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a4172d59-087e-4c73-b69c-b6eff2400785 admin admin] Made reservation on behalf of f6c648eca8dd4001ae79ed3ee33c9944 for: {'subnet': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:40:06.382969 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-a4172d59-087e-4c73-b69c-b6eff2400785 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14198618'] for subnet, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:06.385832 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e64d1545-36bb-431d-9a16-f1600a2ee8e8 admin admin] Pushing event updated for resources: {'Network': ['ID=b65d8cad-fd63-4b4e-9acf-f430f1925cb5,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:06.413092 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0b3813a0-1eaf-43a0-b56e-ac5ddb98cb40 req-ae19bf97-e2d3-4750-80d7-b1ee8d9bb559 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1403742 Sep 18 08:40:06.422539 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Network b65d8cad-fd63-4b4e-9acf-f430f1925cb5 details requested by agent ovs-agent-dv-cinder-804470-6-iscsi with host dv-cinder-804470-6-iscsi {{(pid=94348) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 18 08:40:06.585552 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f066e076-20da-4ac5-9aff-64f280fa4c65 req-f5e56c26-e46c-46ae-9c27-077d89e2bc0e tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:06.587898 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f066e076-20da-4ac5-9aff-64f280fa4c65 req-f5e56c26-e46c-46ae-9c27-077d89e2bc0e tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=ed593970-f617-452d-95b7-c2fd7615fd0a HTTP/1.1" status: 200 len: 944 time: 0.1020167 Sep 18 08:40:06.641529 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f066e076-20da-4ac5-9aff-64f280fa4c65 req-4bd25691-144d-498a-8090-b43a8eb06e6f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451081 Sep 18 08:40:06.667567 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-a4172d59-087e-4c73-b69c-b6eff2400785 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-14290078', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14198644'] for subnet, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:06.732043 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4172d59-087e-4c73-b69c-b6eff2400785 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ae63bff3-75e7-4322-9b89-71ddb667d1bb,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:06.741277 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4172d59-087e-4c73-b69c-b6eff2400785 admin admin] Checking segment: {'id': '423256e4-3aa4-4a93-b180-ed8d2baea524', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 206, 'network_id': 'b65d8cad-fd63-4b4e-9acf-f430f1925cb5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94346) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:40:06.741643 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4172d59-087e-4c73-b69c-b6eff2400785 admin admin] Network hostable DHCP agents. Network: b65d8cad-fd63-4b4e-9acf-f430f1925cb5, hostable agents: ['6aaa6222-6d04-44a7-b807-bfc2cbd3e99f'], hosted agents: [] {{(pid=94346) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 18 08:40:06.763745 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4172d59-087e-4c73-b69c-b6eff2400785 admin admin] Network b65d8cad-fd63-4b4e-9acf-f430f1925cb5 is scheduled to be hosted by DHCP agent 6aaa6222-6d04-44a7-b807-bfc2cbd3e99f with binding_index 1 {{(pid=94346) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 18 08:40:06.778819 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-a4172d59-087e-4c73-b69c-b6eff2400785 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804470-6-iscsi, b65d8cad-fd63-4b4e-9acf-f430f1925cb5) {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:40:06.783565 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a4172d59-087e-4c73-b69c-b6eff2400785 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:06.784185 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-a4172d59-087e-4c73-b69c-b6eff2400785 admin admin] Notify callbacks [] for subnet, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:06.789725 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8086ad62-f164-42f0-ae36-cdab4170ab49 None None] Network b65d8cad-fd63-4b4e-9acf-f430f1925cb5 requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:40:06.805447 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-a4172d59-087e-4c73-b69c-b6eff2400785 admin admin] 10.222.0.35 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.5157642 Sep 18 08:40:06.822367 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4dbda3c-ccaa-4706-ba08-167c254ab99c req-50a8869b-d4da-43c8-88ba-b947a4459eea tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:06.829142 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c4dbda3c-ccaa-4706-ba08-167c254ab99c req-50a8869b-d4da-43c8-88ba-b947a4459eea tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8949a467-d4ed-449f-be4b-3fe465e79fd7 HTTP/1.1" status: 200 len: 946 time: 0.0854154 Sep 18 08:40:06.866070 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c4dbda3c-ccaa-4706-ba08-167c254ab99c req-4c713d1f-9920-48cf-9ab5-09b54e38e06b tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0355108 Sep 18 08:40:06.888336 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 1f9a3d54-fb75-4f0c-8013-46a939823a2e details requested by agent hyperv_hv-cinder-80447 with host hv-cinder-80447 {{(pid=94348) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 18 08:40:06.966472 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f50802c-3a21-42a9-9aef-e67cddc712bb None None] Network b65d8cad-fd63-4b4e-9acf-f430f1925cb5 requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:40:07.105201 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 1f9a3d54-fb75-4f0c-8013-46a939823a2e, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=1f9a3d54-fb75-4f0c-8013-46a939823a2e,segment=NetworkSegment(d1432479-9c27-42c4-87db-6905e7868675),segment_id=d1432479-9c27-42c4-87db-6905e7868675)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:40:07.126970 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Returning: {'device': '1f9a3d54-fb75-4f0c-8013-46a939823a2e', 'network_id': 'fe2753d3-7f3b-4739-adbf-6643a840c73e', 'port_id': '1f9a3d54-fb75-4f0c-8013-46a939823a2e', 'mac_address': 'fa:16:3e:8f:f8:c5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 233, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b96e08ba-91b8-4c1f-bd27-4a1270ccbde2', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94348) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 18 08:40:07.207671 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:07.227644 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1f9a3d54-fb75-4f0c-8013-46a939823a2e {{(pid=94348) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:40:07.250787 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 1f9a3d54-fb75-4f0c-8013-46a939823a2e, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=1f9a3d54-fb75-4f0c-8013-46a939823a2e,segment=NetworkSegment(d1432479-9c27-42c4-87db-6905e7868675),segment_id=d1432479-9c27-42c4-87db-6905e7868675)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:40:07.259294 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:07.332487 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=1f9a3d54-fb75-4f0c-8013-46a939823a2e,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:07.561752 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 5fca4850-9dbe-4847-a121-123f4a9dc375 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:40:07.618334 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 58332) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:07.627454 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 58336) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:07.639973 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-c2e1c1f8-b69e-4fff-ba0c-80877a2b66f7 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-813263340-network', 'tenant_id': '09965c611a924e2e8701a5f1fc6647c6'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:40:07.655065 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 5fca4850-9dbe-4847-a121-123f4a9dc375 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:40:07.655456 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:07.666699 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90339b5a-a401-4e32-a831-46d30968fdc6 req-36c98b8f-d887-471b-b7d4-6ba0d62ed744 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:07.683680 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-90339b5a-a401-4e32-a831-46d30968fdc6 req-36c98b8f-d887-471b-b7d4-6ba0d62ed744 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.1564341 Sep 18 08:40:07.704819 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c2e1c1f8-b69e-4fff-ba0c-80877a2b66f7 admin admin] Made reservation on behalf of 09965c611a924e2e8701a5f1fc6647c6 for: {'network': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:40:07.708326 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c2e1c1f8-b69e-4fff-ba0c-80877a2b66f7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for network, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:07.725533 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c2e1c1f8-b69e-4fff-ba0c-80877a2b66f7 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:07.801578 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-90339b5a-a401-4e32-a831-46d30968fdc6 req-4abbf8aa-6cdc-4261-930b-c613deb9d65b tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1039526 Sep 18 08:40:07.840038 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['1f9a3d54-fb75-4f0c-8013-46a939823a2e'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:40:07.870491 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fd876e1-e04b-4296-8a39-5c34127fbd24 req-7e6e1002-bfc0-4cbc-b1fc-1b717fe49bbb tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:07.879988 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5fd876e1-e04b-4296-8a39-5c34127fbd24 req-7e6e1002-bfc0-4cbc-b1fc-1b717fe49bbb tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=ed593970-f617-452d-95b7-c2fd7615fd0a HTTP/1.1" status: 200 len: 945 time: 0.0846417 Sep 18 08:40:07.899200 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c2e1c1f8-b69e-4fff-ba0c-80877a2b66f7 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:07.909649 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c2e1c1f8-b69e-4fff-ba0c-80877a2b66f7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:07.950684 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5fd876e1-e04b-4296-8a39-5c34127fbd24 req-9f0e0331-e463-43c1-ae1a-07f39bc6c212 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0698099 Sep 18 08:40:07.954308 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c2e1c1f8-b69e-4fff-ba0c-80877a2b66f7 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 228} {{(pid=94346) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 18 08:40:07.994764 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c2e1c1f8-b69e-4fff-ba0c-80877a2b66f7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:07.995126 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.db.segments_db [None req-c2e1c1f8-b69e-4fff-ba0c-80877a2b66f7 admin admin] Added segment e842b13e-4180-46fb-817d-cffe43040763 of type vlan for network af22b74e-ec5b-418e-a9eb-b8a4203e2476 Sep 18 08:40:08.013299 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2e1c1f8-b69e-4fff-ba0c-80877a2b66f7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f761100b-8596-4f9b-a3b8-e4d8a5f37b10,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:08.066909 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c2e1c1f8-b69e-4fff-ba0c-80877a2b66f7 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732885226527'] for network, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:08.132667 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c2e1c1f8-b69e-4fff-ba0c-80877a2b66f7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for network, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:08.133077 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c2e1c1f8-b69e-4fff-ba0c-80877a2b66f7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:08.133686 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c2e1c1f8-b69e-4fff-ba0c-80877a2b66f7 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:08.184508 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-aee1f715-9475-4436-ba23-5e7084ae4d07 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=adfddd23e1874cb7bd027bf41e4d64c4&name=default HTTP/1.1" status: 200 len: 2979 time: 0.5649927 Sep 18 08:40:08.187332 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 58348) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:08.189093 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-c2e1c1f8-b69e-4fff-ba0c-80877a2b66f7 admin admin] 10.222.0.35 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.5606930 Sep 18 08:40:08.191953 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 58350) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:08.196931 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-cc436eef-bd7f-43ea-9279-41e12e8fe779 admin admin] Request body: {'subnet': {'network_id': 'af22b74e-ec5b-418e-a9eb-b8a4203e2476', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-813263340-subnet', 'tenant_id': '09965c611a924e2e8701a5f1fc6647c6', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:40:08.234322 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c2e1c1f8-b69e-4fff-ba0c-80877a2b66f7 admin admin] Pushing event updated for resources: {'Network': ['ID=af22b74e-ec5b-418e-a9eb-b8a4203e2476,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:08.247193 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Network af22b74e-ec5b-418e-a9eb-b8a4203e2476 details requested by agent ovs-agent-dv-cinder-804470-6-iscsi with host dv-cinder-804470-6-iscsi {{(pid=94348) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 18 08:40:08.250094 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cc436eef-bd7f-43ea-9279-41e12e8fe779 admin admin] Made reservation on behalf of 09965c611a924e2e8701a5f1fc6647c6 for: {'subnet': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:40:08.252820 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-cc436eef-bd7f-43ea-9279-41e12e8fe779 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14198618'] for subnet, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:08.272838 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-dd43ca35-3572-44ae-80c0-49bb47b9e516 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:08.304238 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82f684f2-ef5a-436d-83eb-241a3f05fa73 req-1fb7675b-dbd0-410c-872c-5241191e8d36 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:08.305742 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-82f684f2-ef5a-436d-83eb-241a3f05fa73 req-1fb7675b-dbd0-410c-872c-5241191e8d36 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8949a467-d4ed-449f-be4b-3fe465e79fd7 HTTP/1.1" status: 200 len: 946 time: 0.0902617 Sep 18 08:40:08.310292 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-dd43ca35-3572-44ae-80c0-49bb47b9e516 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:08.370483 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-82f684f2-ef5a-436d-83eb-241a3f05fa73 req-6454d8fe-b1c6-46c9-9431-0507ab8a44dd tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0533478 Sep 18 08:40:08.402615 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-dd43ca35-3572-44ae-80c0-49bb47b9e516 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:08.405585 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-dd43ca35-3572-44ae-80c0-49bb47b9e516 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:08.406927 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-dd43ca35-3572-44ae-80c0-49bb47b9e516 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/32504d5c-b702-4d1a-8d76-e0cd4da86123 HTTP/1.1" status: 204 len: 168 time: 0.2182288 Sep 18 08:40:08.416567 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd43ca35-3572-44ae-80c0-49bb47b9e516 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=32504d5c-b702-4d1a-8d76-e0cd4da86123,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:08.442841 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-cc436eef-bd7f-43ea-9279-41e12e8fe779 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-14290078', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14198644'] for subnet, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:08.495423 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc436eef-bd7f-43ea-9279-41e12e8fe779 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e3207320-e62a-4b27-b843-164bb5c7629c,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:08.506373 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cc436eef-bd7f-43ea-9279-41e12e8fe779 admin admin] Checking segment: {'id': 'e842b13e-4180-46fb-817d-cffe43040763', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 228, 'network_id': 'af22b74e-ec5b-418e-a9eb-b8a4203e2476'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94346) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:40:08.507044 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cc436eef-bd7f-43ea-9279-41e12e8fe779 admin admin] Network hostable DHCP agents. Network: af22b74e-ec5b-418e-a9eb-b8a4203e2476, hostable agents: ['6aaa6222-6d04-44a7-b807-bfc2cbd3e99f'], hosted agents: [] {{(pid=94346) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 18 08:40:08.528049 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cc436eef-bd7f-43ea-9279-41e12e8fe779 admin admin] Network af22b74e-ec5b-418e-a9eb-b8a4203e2476 is scheduled to be hosted by DHCP agent 6aaa6222-6d04-44a7-b807-bfc2cbd3e99f with binding_index 1 {{(pid=94346) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 18 08:40:08.540832 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-cc436eef-bd7f-43ea-9279-41e12e8fe779 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804470-6-iscsi, af22b74e-ec5b-418e-a9eb-b8a4203e2476) {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:40:08.544357 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cc436eef-bd7f-43ea-9279-41e12e8fe779 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:08.545278 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-cc436eef-bd7f-43ea-9279-41e12e8fe779 admin admin] Notify callbacks [] for subnet, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:08.549602 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e7951715-589b-47ab-a62a-ff77f049848e None None] Network af22b74e-ec5b-418e-a9eb-b8a4203e2476 requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:40:08.561364 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-cc436eef-bd7f-43ea-9279-41e12e8fe779 admin admin] 10.222.0.35 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3683174 Sep 18 08:40:08.712108 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-61f39b0e-2c8e-4406-aefd-e079e19631bf None None] Network af22b74e-ec5b-418e-a9eb-b8a4203e2476 requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:40:08.917596 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adf707c6-bf25-4df3-8bf1-d54a412a7033 req-68b8fc12-5960-46bf-ba88-7bb186a54065 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:08.924821 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-adf707c6-bf25-4df3-8bf1-d54a412a7033 req-68b8fc12-5960-46bf-ba88-7bb186a54065 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.0570540 Sep 18 08:40:08.960364 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-adf707c6-bf25-4df3-8bf1-d54a412a7033 req-c3ceb08e-51ff-43ce-9a5c-c693243fe1e5 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0347865 Sep 18 08:40:09.129654 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41c9fff9-ca2a-45a9-b392-40a843e5d35d req-83b55367-77f7-4a69-a55d-d6a475b10510 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:09.131717 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-41c9fff9-ca2a-45a9-b392-40a843e5d35d req-83b55367-77f7-4a69-a55d-d6a475b10510 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0882924 Sep 18 08:40:09.165355 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dda70029-4b65-4bce-beb7-d25470b9e95d req-aa06c305-afdf-4102-a673-109eafce11ff tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:09.166880 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dda70029-4b65-4bce-beb7-d25470b9e95d req-aa06c305-afdf-4102-a673-109eafce11ff tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=ed593970-f617-452d-95b7-c2fd7615fd0a HTTP/1.1" status: 200 len: 945 time: 0.0851636 Sep 18 08:40:09.219146 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-41c9fff9-ca2a-45a9-b392-40a843e5d35d req-cbad9b1e-4fd8-4549-918a-da8079699148 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0683258 Sep 18 08:40:09.227932 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dda70029-4b65-4bce-beb7-d25470b9e95d req-55a885a4-2bef-4bbf-a784-01b2dad70b94 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0527136 Sep 18 08:40:09.543833 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f727a86e-3ac6-41e3-a61b-f40657533cf0 req-528a05a3-51da-40d9-8c87-f6bd233c8e99 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:09.554268 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f727a86e-3ac6-41e3-a61b-f40657533cf0 req-528a05a3-51da-40d9-8c87-f6bd233c8e99 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8949a467-d4ed-449f-be4b-3fe465e79fd7 HTTP/1.1" status: 200 len: 946 time: 0.0826144 Sep 18 08:40:09.609731 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f727a86e-3ac6-41e3-a61b-f40657533cf0 req-4fde5c90-c41d-4d3b-816e-ed65747e2b37 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0538895 Sep 18 08:40:10.112389 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 58434) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:10.212449 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-de2af1b0-fc7c-4335-85a7-6bafc78f6fbc admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:10.301025 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-de2af1b0-fc7c-4335-85a7-6bafc78f6fbc admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:10.310796 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-de2af1b0-fc7c-4335-85a7-6bafc78f6fbc admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:10.376867 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-de2af1b0-fc7c-4335-85a7-6bafc78f6fbc admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=ec554f93f43945b1b3efd0731f99c03f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2632651 Sep 18 08:40:10.379687 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 58440) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:10.381023 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de2af1b0-fc7c-4335-85a7-6bafc78f6fbc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=61b5bca2-ff30-4fa8-9077-139058d268dd,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:10.390774 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de2af1b0-fc7c-4335-85a7-6bafc78f6fbc admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:10.391122 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de2af1b0-fc7c-4335-85a7-6bafc78f6fbc admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:10.391465 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de2af1b0-fc7c-4335-85a7-6bafc78f6fbc admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:10.391798 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de2af1b0-fc7c-4335-85a7-6bafc78f6fbc admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:10.392132 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de2af1b0-fc7c-4335-85a7-6bafc78f6fbc admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:10.392459 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de2af1b0-fc7c-4335-85a7-6bafc78f6fbc admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:10.392784 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de2af1b0-fc7c-4335-85a7-6bafc78f6fbc admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:10.393108 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de2af1b0-fc7c-4335-85a7-6bafc78f6fbc admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:10.393457 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de2af1b0-fc7c-4335-85a7-6bafc78f6fbc admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:10.393777 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de2af1b0-fc7c-4335-85a7-6bafc78f6fbc admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:10.394100 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de2af1b0-fc7c-4335-85a7-6bafc78f6fbc admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:10.394414 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de2af1b0-fc7c-4335-85a7-6bafc78f6fbc admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:10.412899 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3820ac77-f78a-41b3-a5e4-7daab1de50f8 req-e1bc3760-40b5-423d-947a-6c142ceca59e tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:10.414420 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3820ac77-f78a-41b3-a5e4-7daab1de50f8 req-e1bc3760-40b5-423d-947a-6c142ceca59e tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=ed593970-f617-452d-95b7-c2fd7615fd0a HTTP/1.1" status: 200 len: 945 time: 0.1161757 Sep 18 08:40:10.441474 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-aed42fba-a332-473c-a4f1-6d34009090b9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:10.461864 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-aed42fba-a332-473c-a4f1-6d34009090b9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:10.476427 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3820ac77-f78a-41b3-a5e4-7daab1de50f8 req-eeaee505-97d9-475a-8643-64c05e563181 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0532506 Sep 18 08:40:10.488330 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f581ef43-8a2e-4212-9acc-4e4ac071a4ef req-faf3e9d1-63c1-4c33-9e8e-d574da6d2514 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:10.490020 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f581ef43-8a2e-4212-9acc-4e4ac071a4ef req-faf3e9d1-63c1-4c33-9e8e-d574da6d2514 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.13 "GET /v2.0/ports?device_id=8949a467-d4ed-449f-be4b-3fe465e79fd7 HTTP/1.1" status: 200 len: 946 time: 0.0746949 Sep 18 08:40:10.524814 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-aed42fba-a332-473c-a4f1-6d34009090b9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:10.527620 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-aed42fba-a332-473c-a4f1-6d34009090b9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:10.528793 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-aed42fba-a332-473c-a4f1-6d34009090b9 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/61b5bca2-ff30-4fa8-9077-139058d268dd HTTP/1.1" status: 204 len: 168 time: 0.1478539 Sep 18 08:40:10.536808 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aed42fba-a332-473c-a4f1-6d34009090b9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=61b5bca2-ff30-4fa8-9077-139058d268dd,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:10.606498 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-f581ef43-8a2e-4212-9acc-4e4ac071a4ef req-ecafadb1-8158-4576-9e7c-fdabadd80839 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Deleting port b7ffb91b-4d87-4a7b-9de9-7e947fb6d687 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:40:10.606846 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-f581ef43-8a2e-4212-9acc-4e4ac071a4ef req-ecafadb1-8158-4576-9e7c-fdabadd80839 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:10.792756 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-f581ef43-8a2e-4212-9acc-4e4ac071a4ef req-ecafadb1-8158-4576-9e7c-fdabadd80839 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] For port b7ffb91b-4d87-4a7b-9de9-7e947fb6d687, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=b7ffb91b-4d87-4a7b-9de9-7e947fb6d687,segment=NetworkSegment(4f8dffb0-f8d4-41b5-beed-53bcf370cb42),segment_id=4f8dffb0-f8d4-41b5-beed-53bcf370cb42)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:40:10.793268 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-f581ef43-8a2e-4212-9acc-4e4ac071a4ef req-ecafadb1-8158-4576-9e7c-fdabadd80839 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:10.802363 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83327a22-96da-487d-a9f1-cc62b565a7e9 req-f2c7aeb3-361a-4833-819d-c715f0d38a59 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:10.803959 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-83327a22-96da-487d-a9f1-cc62b565a7e9 req-f2c7aeb3-361a-4833-819d-c715f0d38a59 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8949a467-d4ed-449f-be4b-3fe465e79fd7 HTTP/1.1" status: 200 len: 946 time: 0.0747409 Sep 18 08:40:10.816917 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-f581ef43-8a2e-4212-9acc-4e4ac071a4ef req-ecafadb1-8158-4576-9e7c-fdabadd80839 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Calling delete_port for b7ffb91b-4d87-4a7b-9de9-7e947fb6d687 owned by compute:nova {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:40:10.892385 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-83327a22-96da-487d-a9f1-cc62b565a7e9 req-532b5bb5-e57f-4678-81e6-18a884a45551 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/security-groups?id=23af377c-f928-4574-b242-a5ed197d2bf9&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0770960 Sep 18 08:40:10.927336 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 1f9a3d54-fb75-4f0c-8013-46a939823a2e up at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:40:11.028671 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning for port 1f9a3d54-fb75-4f0c-8013-46a939823a2e completed by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 18 08:40:11.036782 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning complete for port 1f9a3d54-fb75-4f0c-8013-46a939823a2e triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:40:11.038227 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:11.044254 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-f581ef43-8a2e-4212-9acc-4e4ac071a4ef req-ecafadb1-8158-4576-9e7c-fdabadd80839 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:11.096343 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['b7ffb91b-4d87-4a7b-9de9-7e947fb6d687'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:40:11.113375 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecafadb1-8158-4576-9e7c-fdabadd80839 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Pushing event deleted for resources: {'Port': ['ID=b7ffb91b-4d87-4a7b-9de9-7e947fb6d687,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:11.172109 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-f581ef43-8a2e-4212-9acc-4e4ac071a4ef req-ecafadb1-8158-4576-9e7c-fdabadd80839 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] No DVR routers for this DVR port b7ffb91b-4d87-4a7b-9de9-7e947fb6d687 on host hv-cinder-80447 {{(pid=94347) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:40:11.174677 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-f581ef43-8a2e-4212-9acc-4e4ac071a4ef req-ecafadb1-8158-4576-9e7c-fdabadd80839 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:11.178020 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f581ef43-8a2e-4212-9acc-4e4ac071a4ef req-ecafadb1-8158-4576-9e7c-fdabadd80839 tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.13 "DELETE /v2.0/ports/b7ffb91b-4d87-4a7b-9de9-7e947fb6d687 HTTP/1.1" status: 204 len: 173 time: 0.6809554 Sep 18 08:40:11.178673 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8949a467-d4ed-449f-be4b-3fe465e79fd7', 'name': 'network-vif-deleted', 'tag': 'b7ffb91b-4d87-4a7b-9de9-7e947fb6d687'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:40:11.180930 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ff143d82-4fb2-4444-b994-b82c79a6318e" -d '{"events": [{"server_uuid": "8949a467-d4ed-449f-be4b-3fe465e79fd7", "name": "network-vif-deleted", "tag": "b7ffb91b-4d87-4a7b-9de9-7e947fb6d687"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:40:11.209954 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:11.231363 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:40:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e345e2f6-68b9-4730-987c-ba68a1dd6aa5 x-openstack-request-id: req-e345e2f6-68b9-4730-987c-ba68a1dd6aa5 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:40:11.232016 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8949a467-d4ed-449f-be4b-3fe465e79fd7", "name": "network-vif-deleted", "tag": "b7ffb91b-4d87-4a7b-9de9-7e947fb6d687", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:40:11.232378 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-e345e2f6-68b9-4730-987c-ba68a1dd6aa5 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:40:11.232992 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8949a467-d4ed-449f-be4b-3fe465e79fd7', 'name': 'network-vif-deleted', 'tag': 'b7ffb91b-4d87-4a7b-9de9-7e947fb6d687', 'status': 'completed', 'code': 200} Sep 18 08:40:11.251037 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ed593970-f617-452d-95b7-c2fd7615fd0a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1f9a3d54-fb75-4f0c-8013-46a939823a2e'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:40:11.253384 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1f6eca97-018a-46d2-8cb2-de5ab67c89f6" -d '{"events": [{"server_uuid": "ed593970-f617-452d-95b7-c2fd7615fd0a", "name": "network-vif-plugged", "status": "completed", "tag": "1f9a3d54-fb75-4f0c-8013-46a939823a2e"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:40:11.267974 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 1f9a3d54-fb75-4f0c-8013-46a939823a2e, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=1f9a3d54-fb75-4f0c-8013-46a939823a2e,segment=NetworkSegment(d1432479-9c27-42c4-87db-6905e7868675),segment_id=d1432479-9c27-42c4-87db-6905e7868675)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:40:11.273886 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:11.323664 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:40:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-258d7b33-59c8-4eaf-936a-662b11af4bcf x-openstack-request-id: req-258d7b33-59c8-4eaf-936a-662b11af4bcf {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:40:11.324198 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ed593970-f617-452d-95b7-c2fd7615fd0a", "name": "network-vif-plugged", "status": "completed", "tag": "1f9a3d54-fb75-4f0c-8013-46a939823a2e", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:40:11.324693 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-258d7b33-59c8-4eaf-936a-662b11af4bcf {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:40:11.325474 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ed593970-f617-452d-95b7-c2fd7615fd0a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1f9a3d54-fb75-4f0c-8013-46a939823a2e', 'code': 200} Sep 18 08:40:11.354913 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=1f9a3d54-fb75-4f0c-8013-46a939823a2e,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:11.361990 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:11.362342 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:11.362683 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:11.363023 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:11.363354 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:11.363686 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:11.364012 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:11.364344 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:11.364690 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:11.365641 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:11.365972 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:11.366325 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:11.610257 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f96306a-a7a6-4b77-be10-a422dfde58be req-bed60613-05d8-4588-b574-b2b1c14a193b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:11.611908 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1f96306a-a7a6-4b77-be10-a422dfde58be req-bed60613-05d8-4588-b574-b2b1c14a193b service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=ed593970-f617-452d-95b7-c2fd7615fd0a HTTP/1.1" status: 200 len: 1099 time: 0.0706036 Sep 18 08:40:11.622764 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00bf7ae7-2964-4e6d-a0dd-399a12108969 req-146b602b-c876-44e5-8b11-53779649e67c tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:11.624227 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-00bf7ae7-2964-4e6d-a0dd-399a12108969 req-146b602b-c876-44e5-8b11-53779649e67c tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=ed593970-f617-452d-95b7-c2fd7615fd0a HTTP/1.1" status: 200 len: 946 time: 0.0751512 Sep 18 08:40:11.671236 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1f96306a-a7a6-4b77-be10-a422dfde58be req-bbd41ee5-af10-4242-9759-06f4264b42f7 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458181 Sep 18 08:40:11.684759 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-00bf7ae7-2964-4e6d-a0dd-399a12108969 req-577d9ca9-9c71-4a06-8d07-3c3e7bf47235 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0534647 Sep 18 08:40:12.020227 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-93bbcac0-3856-4684-981f-0fcea2adce05 req-426f6b2a-5f06-4b46-a425-3d89e913c06d tempest-VolumesActionsTest-722669335 tempest-VolumesActionsTest-722669335-project] 10.222.0.35 "GET /v2.0/ports?device_id=8949a467-d4ed-449f-be4b-3fe465e79fd7 HTTP/1.1" status: 200 len: 210 time: 0.0375669 Sep 18 08:40:12.040959 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2481ade3-bc54-4c96-b0e2-4173f38addcb req-c390414c-8d55-428d-8e54-e82400230f01 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:12.042918 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2481ade3-bc54-4c96-b0e2-4173f38addcb req-c390414c-8d55-428d-8e54-e82400230f01 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0907531 Sep 18 08:40:12.082951 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2481ade3-bc54-4c96-b0e2-4173f38addcb req-255d9297-39e5-439d-a663-3e0dac1f84c6 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0335670 Sep 18 08:40:12.315926 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf4f826c-c760-4e62-9403-81bab010dc6b req-2303b3c9-66d0-4418-907a-49b83f39e6a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:12.317474 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cf4f826c-c760-4e62-9403-81bab010dc6b req-2303b3c9-66d0-4418-907a-49b83f39e6a4 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=f439efa4eed0456ab2a914377e490fad&device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 1098 time: 0.0787182 Sep 18 08:40:12.655407 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf4f826c-c760-4e62-9403-81bab010dc6b req-207a4d9a-f6e5-4770-a27b-211034a13d5b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:12.656906 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cf4f826c-c760-4e62-9403-81bab010dc6b req-207a4d9a-f6e5-4770-a27b-211034a13d5b service neutron] 10.222.0.13 "GET /v2.0/networks?id=fdcbc66e-323e-4b44-be97-566949f4f2ef HTTP/1.1" status: 200 len: 919 time: 0.3270729 Sep 18 08:40:12.702249 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cf4f826c-c760-4e62-9403-81bab010dc6b req-e5833062-e46a-4455-8ae7-d0c0eb62bfc6 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b03411eb-66ff-4691-88c8-2c570d78c323 HTTP/1.1" status: 200 len: 217 time: 0.0380280 Sep 18 08:40:12.755770 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf4f826c-c760-4e62-9403-81bab010dc6b req-c815e464-5468-44ec-a67f-f805f0367cd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:12.757191 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cf4f826c-c760-4e62-9403-81bab010dc6b req-c815e464-5468-44ec-a67f-f805f0367cd0 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=e5dc6eef-e778-41a2-a708-c7810ade97db HTTP/1.1" status: 200 len: 858 time: 0.0486057 Sep 18 08:40:12.803617 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cf4f826c-c760-4e62-9403-81bab010dc6b req-645aaf71-d6bf-40ee-8723-100c3522d88a service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fdcbc66e-323e-4b44-be97-566949f4f2ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0375810 Sep 18 08:40:12.830267 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfa059cf-583b-491c-9b5d-bd96b5af546f req-7981cfec-efe7-4eee-a999-f9c976aca264 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:12.831740 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dfa059cf-583b-491c-9b5d-bd96b5af546f req-7981cfec-efe7-4eee-a999-f9c976aca264 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=ed593970-f617-452d-95b7-c2fd7615fd0a HTTP/1.1" status: 200 len: 946 time: 0.0788519 Sep 18 08:40:12.914485 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dfa059cf-583b-491c-9b5d-bd96b5af546f req-087e754f-432c-4a40-ac9c-96cb17462f0c tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0696700 Sep 18 08:40:12.934321 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cf4f826c-c760-4e62-9403-81bab010dc6b req-ef73cb64-8d29-44e2-9cb1-57837d99e3cd service neutron] 10.222.0.13 "GET /v2.0/networks/fdcbc66e-323e-4b44-be97-566949f4f2ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1206007 Sep 18 08:40:13.031039 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cf4f826c-c760-4e62-9403-81bab010dc6b req-dbf1915e-910e-458c-8768-cf7a00a3423b service neutron] 10.222.0.13 "GET /v2.0/networks/fdcbc66e-323e-4b44-be97-566949f4f2ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0882721 Sep 18 08:40:13.223042 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-729ec81b-4a26-4c7e-99a9-ec8ddc94ecbe req-6d27312e-1d33-4c4c-893f-9d76795915ef tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:13.225074 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-729ec81b-4a26-4c7e-99a9-ec8ddc94ecbe req-6d27312e-1d33-4c4c-893f-9d76795915ef tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0597715 Sep 18 08:40:13.268673 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-729ec81b-4a26-4c7e-99a9-ec8ddc94ecbe req-0658e916-b6e7-4d9a-a901-4b92e72030ea tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0365639 Sep 18 08:40:14.025953 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f54640bf-2efe-4fed-bb57-15856c61513b req-f01cdc49-50f8-4b5d-9a65-0866500822c1 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:14.027441 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f54640bf-2efe-4fed-bb57-15856c61513b req-f01cdc49-50f8-4b5d-9a65-0866500822c1 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=ed593970-f617-452d-95b7-c2fd7615fd0a HTTP/1.1" status: 200 len: 946 time: 0.0477247 Sep 18 08:40:14.063590 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f54640bf-2efe-4fed-bb57-15856c61513b req-6f94d7f7-d8ff-4344-9265-5464ca35a4e6 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0303173 Sep 18 08:40:14.386233 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03373e3d-6fcd-4890-b659-c897875b9cb2 req-b058a7fb-0d2e-4021-8435-296549a737a4 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:14.387700 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-03373e3d-6fcd-4890-b659-c897875b9cb2 req-b058a7fb-0d2e-4021-8435-296549a737a4 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0514972 Sep 18 08:40:14.424671 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-03373e3d-6fcd-4890-b659-c897875b9cb2 req-3f18f8a1-c137-417c-a330-152dca65e0cf tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0311091 Sep 18 08:40:15.174309 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6001df7-f223-47ca-a379-7012cf8514b7 req-7046c887-423d-48e5-8c0a-fd843c99dc25 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:15.175785 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f6001df7-f223-47ca-a379-7012cf8514b7 req-7046c887-423d-48e5-8c0a-fd843c99dc25 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=ed593970-f617-452d-95b7-c2fd7615fd0a HTTP/1.1" status: 200 len: 946 time: 0.0472651 Sep 18 08:40:15.212870 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f6001df7-f223-47ca-a379-7012cf8514b7 req-1550a3be-e56f-4010-a5f7-62a339596f79 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0312235 Sep 18 08:40:15.538708 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4874874-90ac-49f8-967a-6a271d77eb4c req-e5600077-d316-480f-83ef-1c2ee69c5623 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:15.540127 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e4874874-90ac-49f8-967a-6a271d77eb4c req-e5600077-d316-480f-83ef-1c2ee69c5623 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0507185 Sep 18 08:40:15.577365 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e4874874-90ac-49f8-967a-6a271d77eb4c req-674082dd-429f-447d-acc9-8bb41eddd5d4 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0312643 Sep 18 08:40:15.887066 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device b7ffb91b-4d87-4a7b-9de9-7e947fb6d687 no longer exists at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:40:15.910850 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] No Port match for: b7ffb91b-4d87-4a7b-9de9-7e947fb6d687 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:40:15.911184 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device b7ffb91b-4d87-4a7b-9de9-7e947fb6d687 not bound to the agent host hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:40:16.324773 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e85829a-a471-4968-957a-c702eec1518d req-5ff2b571-3879-4845-be91-20ac9bf05f70 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:16.326250 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9e85829a-a471-4968-957a-c702eec1518d req-5ff2b571-3879-4845-be91-20ac9bf05f70 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=ed593970-f617-452d-95b7-c2fd7615fd0a HTTP/1.1" status: 200 len: 946 time: 0.0495243 Sep 18 08:40:16.362964 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9e85829a-a471-4968-957a-c702eec1518d req-7014b6d6-6941-4cb2-8384-100ac17f2a27 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0309048 Sep 18 08:40:16.686219 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a5424ff-e14c-4575-adf6-2aa2f235fe3e req-2f8f85e7-a8e3-464a-a3e2-5b30907cc574 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:16.687664 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1a5424ff-e14c-4575-adf6-2aa2f235fe3e req-2f8f85e7-a8e3-464a-a3e2-5b30907cc574 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0462773 Sep 18 08:40:16.724308 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1a5424ff-e14c-4575-adf6-2aa2f235fe3e req-d3dc29af-46bf-40aa-ba6b-dc848274e326 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0303547 Sep 18 08:40:17.479636 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37bfbabd-6756-48e0-8d6f-cf1d564f557a req-3efb345a-94da-42ae-ab2b-1061048cd8e0 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:17.481152 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-37bfbabd-6756-48e0-8d6f-cf1d564f557a req-3efb345a-94da-42ae-ab2b-1061048cd8e0 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=ed593970-f617-452d-95b7-c2fd7615fd0a HTTP/1.1" status: 200 len: 946 time: 0.0470269 Sep 18 08:40:17.519986 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-37bfbabd-6756-48e0-8d6f-cf1d564f557a req-2d76e2cd-48e0-4a0a-ab67-f78e28762381 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0328681 Sep 18 08:40:17.841730 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3583f9d3-0d74-41b7-8a0f-ca90aea05333 req-21b707a8-5da9-4c06-9c4a-1a7570e8f071 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:17.843216 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3583f9d3-0d74-41b7-8a0f-ca90aea05333 req-21b707a8-5da9-4c06-9c4a-1a7570e8f071 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0515521 Sep 18 08:40:17.880645 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3583f9d3-0d74-41b7-8a0f-ca90aea05333 req-3c59064e-d5d5-4d18-959d-365be75f1dd5 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0310547 Sep 18 08:40:18.634452 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2911fd06-51d9-4d0b-a0ee-6ba62049bc22 req-8055405d-cf26-4121-a8ee-710340fa6607 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:18.636044 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2911fd06-51d9-4d0b-a0ee-6ba62049bc22 req-8055405d-cf26-4121-a8ee-710340fa6607 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=ed593970-f617-452d-95b7-c2fd7615fd0a HTTP/1.1" status: 200 len: 946 time: 0.0481923 Sep 18 08:40:18.672611 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2911fd06-51d9-4d0b-a0ee-6ba62049bc22 req-92d5f447-aedd-4b45-8eae-c7c52562ab03 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0304344 Sep 18 08:40:18.997675 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d20b1a74-64d8-4fbe-87cb-a2c6a9330280 req-2a91b921-b075-4c61-acd9-7fd7ab2c7c58 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:18.999584 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d20b1a74-64d8-4fbe-87cb-a2c6a9330280 req-2a91b921-b075-4c61-acd9-7fd7ab2c7c58 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0499334 Sep 18 08:40:19.049444 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d20b1a74-64d8-4fbe-87cb-a2c6a9330280 req-0097bd2e-8230-4ff0-98be-3928b40bc566 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395508 Sep 18 08:40:19.601809 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-171f2594-1ead-41f0-addb-0c33e5fc4a55 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:19.889562 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:20.155425 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97851433-4b1f-447a-85b1-0e96a974cb83 req-31be7712-90ee-4661-8051-774f4c46e04b tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:20.156819 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-97851433-4b1f-447a-85b1-0e96a974cb83 req-31be7712-90ee-4661-8051-774f4c46e04b tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0499601 Sep 18 08:40:20.193180 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-97851433-4b1f-447a-85b1-0e96a974cb83 req-2e0f6e43-17b0-4ed8-bd0e-cf3bda3c13ce tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0306160 Sep 18 08:40:21.306287 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-172705d9-ceec-4f3e-8c7b-ee2ff2b64c7e req-9366a90f-b481-4093-a66e-5b0a740e8a93 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:21.307805 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-172705d9-ceec-4f3e-8c7b-ee2ff2b64c7e req-9366a90f-b481-4093-a66e-5b0a740e8a93 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0496025 Sep 18 08:40:21.344230 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-172705d9-ceec-4f3e-8c7b-ee2ff2b64c7e req-13c62ecd-b5c8-44ca-b291-2dd015379ed4 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0304146 Sep 18 08:40:22.399263 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-503403d9-39a9-4b3c-a90b-c41a46ad349b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:22.460774 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a282ffb-0222-4549-8a15-cf567b413bc3 req-afd2b0a2-c46d-4017-b352-075df7f150b3 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:22.463061 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7a282ffb-0222-4549-8a15-cf567b413bc3 req-afd2b0a2-c46d-4017-b352-075df7f150b3 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0493689 Sep 18 08:40:22.501814 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7a282ffb-0222-4549-8a15-cf567b413bc3 req-dd414604-7117-4002-9608-a7141bc03e21 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0328369 Sep 18 08:40:23.179106 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:23.327448 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:23.619347 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1629cbb1-faa5-4802-9c65-3bf9a53010a8 req-069a77ea-9ab6-4804-9c2f-2d281cbada6c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:23.620816 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1629cbb1-faa5-4802-9c65-3bf9a53010a8 req-069a77ea-9ab6-4804-9c2f-2d281cbada6c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0517116 Sep 18 08:40:23.657018 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1629cbb1-faa5-4802-9c65-3bf9a53010a8 req-2e679ccc-667a-4b04-8746-f44d890042a1 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0302308 Sep 18 08:40:24.203406 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c890996b-14e0-44ab-a051-c42062f4376e req-0e33385b-0a29-488c-b596-927c976914fd service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0460088 Sep 18 08:40:24.622353 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c890996b-14e0-44ab-a051-c42062f4376e req-c8ee9880-9acc-423d-a13f-62887f04eb0a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:24.623855 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c890996b-14e0-44ab-a051-c42062f4376e req-c8ee9880-9acc-423d-a13f-62887f04eb0a service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=38bd82e43ad3497aa14e8e4e68a29009&device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 1099 time: 0.0400887 Sep 18 08:40:24.769387 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c890996b-14e0-44ab-a051-c42062f4376e req-73ca829d-9f8f-4b44-bc55-7794c0bb9ff6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:24.770983 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c890996b-14e0-44ab-a051-c42062f4376e req-73ca829d-9f8f-4b44-bc55-7794c0bb9ff6 service neutron] 10.222.0.13 "GET /v2.0/networks?id=fe2753d3-7f3b-4739-adbf-6643a840c73e HTTP/1.1" status: 200 len: 916 time: 0.1197848 Sep 18 08:40:24.796315 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7ed7e31-ba09-4d58-aef0-f5fb651c1fcc req-b8abd88e-3f60-42f5-a69a-a4a112af8d51 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:24.797843 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b7ed7e31-ba09-4d58-aef0-f5fb651c1fcc req-b8abd88e-3f60-42f5-a69a-a4a112af8d51 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0723672 Sep 18 08:40:24.827197 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c890996b-14e0-44ab-a051-c42062f4376e req-55465343-889b-45ba-a94b-f9534732e46a service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=9a4f8ce9-f706-4c25-b3f4-05f2173cf516 HTTP/1.1" status: 200 len: 217 time: 0.0461197 Sep 18 08:40:24.853481 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:24.859708 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b7ed7e31-ba09-4d58-aef0-f5fb651c1fcc req-16fc3cd9-b8ac-415b-ae74-79aa0e5c21a6 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0352645 Sep 18 08:40:24.916275 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c890996b-14e0-44ab-a051-c42062f4376e req-85e402a4-f685-480d-a1fb-9b6a142d0d6a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:24.917737 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c890996b-14e0-44ab-a051-c42062f4376e req-85e402a4-f685-480d-a1fb-9b6a142d0d6a service neutron] 10.222.0.13 "GET /v2.0/subnets?id=b96e08ba-91b8-4c1f-bd27-4a1270ccbde2 HTTP/1.1" status: 200 len: 855 time: 0.0469565 Sep 18 08:40:24.949188 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c890996b-14e0-44ab-a051-c42062f4376e req-d9e6dc28-b0f0-473b-b7be-b46445035eb7 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fe2753d3-7f3b-4739-adbf-6643a840c73e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0227654 Sep 18 08:40:25.041830 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c890996b-14e0-44ab-a051-c42062f4376e req-9baa9698-1e7b-401b-ac22-1f47e1e8644c service neutron] 10.222.0.13 "GET /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0821748 Sep 18 08:40:25.146346 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c890996b-14e0-44ab-a051-c42062f4376e req-d35f216f-c263-458a-976b-f859579c2b68 service neutron] 10.222.0.13 "GET /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0829899 Sep 18 08:40:25.974763 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71d49da5-8968-47db-8c23-01dc4915b19d req-429b4f28-4884-4bf3-be49-d8588c6f61a6 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:25.976818 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-71d49da5-8968-47db-8c23-01dc4915b19d req-429b4f28-4884-4bf3-be49-d8588c6f61a6 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0477946 Sep 18 08:40:26.014168 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-71d49da5-8968-47db-8c23-01dc4915b19d req-69eacc6a-3d33-4b7c-9277-623ead539faa tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0314319 Sep 18 08:40:27.148310 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4f2e9f9-7580-42a3-af8f-d5d7ba412291 req-e4169fcf-6908-42dd-93ea-130298728641 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:27.149958 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b4f2e9f9-7580-42a3-af8f-d5d7ba412291 req-e4169fcf-6908-42dd-93ea-130298728641 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0592456 Sep 18 08:40:27.200573 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b4f2e9f9-7580-42a3-af8f-d5d7ba412291 req-fa47dfa2-0427-419e-ae5e-8401de3aad89 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413930 Sep 18 08:40:28.202712 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 58944) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:28.326083 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d18b01e7-7d13-4891-bafc-085810e73444 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:28.347902 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d0b8dd5-0862-428c-9639-4bcff4cfb605 req-f2d53ee9-d4cf-4fd2-b1b2-75ed25d0cf12 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:28.351631 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0d0b8dd5-0862-428c-9639-4bcff4cfb605 req-f2d53ee9-d4cf-4fd2-b1b2-75ed25d0cf12 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0784841 Sep 18 08:40:28.405517 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0d0b8dd5-0862-428c-9639-4bcff4cfb605 req-b7f2de58-6a48-4951-a747-d36ea6fc5209 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0481913 Sep 18 08:40:28.486801 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d18b01e7-7d13-4891-bafc-085810e73444 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:28.490320 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d18b01e7-7d13-4891-bafc-085810e73444 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:28.551102 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-d18b01e7-7d13-4891-bafc-085810e73444 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=cfb7fa8be95a42d78b8f61595a8608f3&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3427415 Sep 18 08:40:28.551408 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 58958) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:28.558185 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d18b01e7-7d13-4891-bafc-085810e73444 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f5175aaa-c3e0-4557-9af4-b9f71b9a7cbc,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:28.600746 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-012a6e57-3728-49c2-b6cf-44d44e6c749b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:28.625053 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-012a6e57-3728-49c2-b6cf-44d44e6c749b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:28.680300 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-012a6e57-3728-49c2-b6cf-44d44e6c749b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:28.682855 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-012a6e57-3728-49c2-b6cf-44d44e6c749b admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:28.687160 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-012a6e57-3728-49c2-b6cf-44d44e6c749b admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/f5175aaa-c3e0-4557-9af4-b9f71b9a7cbc HTTP/1.1" status: 204 len: 168 time: 0.1359389 Sep 18 08:40:28.697064 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-012a6e57-3728-49c2-b6cf-44d44e6c749b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f5175aaa-c3e0-4557-9af4-b9f71b9a7cbc,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:28.705230 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-012a6e57-3728-49c2-b6cf-44d44e6c749b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:28.705850 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-012a6e57-3728-49c2-b6cf-44d44e6c749b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:28.706627 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-012a6e57-3728-49c2-b6cf-44d44e6c749b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:28.707165 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-012a6e57-3728-49c2-b6cf-44d44e6c749b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:28.707705 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-012a6e57-3728-49c2-b6cf-44d44e6c749b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:28.708370 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-012a6e57-3728-49c2-b6cf-44d44e6c749b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:28.708922 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-012a6e57-3728-49c2-b6cf-44d44e6c749b admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:28.709506 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-012a6e57-3728-49c2-b6cf-44d44e6c749b admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:28.710033 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-012a6e57-3728-49c2-b6cf-44d44e6c749b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:28.710544 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-012a6e57-3728-49c2-b6cf-44d44e6c749b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:28.711062 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-012a6e57-3728-49c2-b6cf-44d44e6c749b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:28.711694 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-012a6e57-3728-49c2-b6cf-44d44e6c749b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:40:29.559048 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65b14917-8eff-4b85-a95e-6377dceb3d26 req-5a3352c6-8dde-4505-b21e-92bc2c4cd1b8 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:29.560602 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-65b14917-8eff-4b85-a95e-6377dceb3d26 req-5a3352c6-8dde-4505-b21e-92bc2c4cd1b8 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0568652 Sep 18 08:40:29.608097 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-65b14917-8eff-4b85-a95e-6377dceb3d26 req-081996c7-ae08-4c63-9fb0-8b4ef1d3e714 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413101 Sep 18 08:40:30.724412 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54bc4109-4506-4b5c-875a-f71881660477 req-f5be0a60-1f6b-4243-9f2e-583321f01a58 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:30.726450 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-54bc4109-4506-4b5c-875a-f71881660477 req-f5be0a60-1f6b-4243-9f2e-583321f01a58 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0475757 Sep 18 08:40:30.763007 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-54bc4109-4506-4b5c-875a-f71881660477 req-f55983f4-8843-43f2-a890-b4cb37191b4e tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0306637 Sep 18 08:40:31.879490 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-384b37fd-cbec-4311-b756-f320c2a1b643 req-4dfc6fc1-7b71-46e0-b2d7-e92bb9311efb tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:31.881761 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-384b37fd-cbec-4311-b756-f320c2a1b643 req-4dfc6fc1-7b71-46e0-b2d7-e92bb9311efb tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0507450 Sep 18 08:40:31.923352 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-384b37fd-cbec-4311-b756-f320c2a1b643 req-6357bb41-75c0-49cb-8d85-a29893b8b734 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0342808 Sep 18 08:40:33.068082 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9db0b5ee-5184-4961-9957-500b81ebe4d6 req-ae214dfb-ea32-4845-a9ad-92c748ef5ce4 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:33.070401 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9db0b5ee-5184-4961-9957-500b81ebe4d6 req-ae214dfb-ea32-4845-a9ad-92c748ef5ce4 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0618813 Sep 18 08:40:33.112314 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9db0b5ee-5184-4961-9957-500b81ebe4d6 req-4a7b25ca-4fb4-4f1e-9aea-42a3e4cf3d51 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0354116 Sep 18 08:40:33.709864 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:40:34.241919 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9ed0f2e-35c4-4817-bb83-a1851907b2af req-bac8953e-0298-48a7-9dd3-d1ccd204d5df tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:34.243771 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a9ed0f2e-35c4-4817-bb83-a1851907b2af req-bac8953e-0298-48a7-9dd3-d1ccd204d5df tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0525565 Sep 18 08:40:34.285260 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a9ed0f2e-35c4-4817-bb83-a1851907b2af req-bc6a101c-b0a5-4d3a-a9c3-36c7ed0c4692 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0352097 Sep 18 08:40:35.475292 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-8c04207e-274b-4c4e-ae28-3cc56a391a87 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:35.482443 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-8c04207e-274b-4c4e-ae28-3cc56a391a87 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/networks?id=fe2753d3-7f3b-4739-adbf-6643a840c73e HTTP/1.1" status: 200 len: 815 time: 0.1579146 Sep 18 08:40:35.494674 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-01943489-05e8-4525-90ba-774cae87e03c tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/quotas/38bd82e43ad3497aa14e8e4e68a29009 HTTP/1.1" status: 200 len: 375 time: 0.0114703 Sep 18 08:40:35.506889 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85fb25d6-2f35-4b1d-85a4-32c62d32dfbf req-eb3f34bf-fa86-4f84-bfa8-cb619832257a tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:35.509253 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-85fb25d6-2f35-4b1d-85a4-32c62d32dfbf req-eb3f34bf-fa86-4f84-bfa8-cb619832257a tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0887492 Sep 18 08:40:35.587978 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-85fb25d6-2f35-4b1d-85a4-32c62d32dfbf req-52ffc665-5a0c-430c-9568-ccea3fa34a59 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0466273 Sep 18 08:40:35.623119 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-4c9bb369-3c3c-4dea-9e12-d4d5c56fe79f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?tenant_id=38bd82e43ad3497aa14e8e4e68a29009&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1125195 Sep 18 08:40:35.770560 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-84f26e6a-c2e0-4da4-aa23-5eeb7475e9bc service neutron] 10.222.0.35 "GET /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1337044 Sep 18 08:40:35.898269 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-6e424abc-541a-448d-9004-958e70848b3e service neutron] 10.222.0.35 "GET /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1258368 Sep 18 08:40:36.058719 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e5e36dbf-7593-4326-a4e3-fb28eb84d176 req-19bcc17d-8f43-4ffe-8b29-c4a3644f83e8 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=a884b539-9c6e-40b3-87ef-28ca4a9daf7a HTTP/1.1" status: 200 len: 210 time: 0.0293319 Sep 18 08:40:36.731441 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cae5ff7e-9db5-468b-8b11-70ddb82fa90e req-2670e43c-9f2c-4784-9c2c-266611a11c21 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:36.733052 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cae5ff7e-9db5-468b-8b11-70ddb82fa90e req-2670e43c-9f2c-4784-9c2c-266611a11c21 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0619986 Sep 18 08:40:36.791447 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cae5ff7e-9db5-468b-8b11-70ddb82fa90e req-6c712360-b263-4d6e-8fbc-37fda47c6f7d tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0501814 Sep 18 08:40:37.110436 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 59200) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:37.158800 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_v2 [None req-1cf3508c-f600-46f1-a0b8-ac7280a09901 admin admin] Deleting subnet ae63bff3-75e7-4322-9b89-71ddb667d1bb {{(pid=94346) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 18 08:40:37.163270 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1cf3508c-f600-46f1-a0b8-ac7280a09901 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:37.168508 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-68cb0629-c6bc-49e6-b77c-5e70c1d787c8 req-4a06deb9-b3e6-403e-aabc-e667b337e2a2 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=a884b539-9c6e-40b3-87ef-28ca4a9daf7a HTTP/1.1" status: 200 len: 210 time: 0.0287461 Sep 18 08:40:37.204070 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1cf3508c-f600-46f1-a0b8-ac7280a09901 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14122726'] for subnet, precommit_delete_associations {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:37.245925 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1cf3508c-f600-46f1-a0b8-ac7280a09901 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1821528'] for subnet, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:37.299326 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1cf3508c-f600-46f1-a0b8-ac7280a09901 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1821519', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14290141', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14198653'] for subnet, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:37.325359 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cf3508c-f600-46f1-a0b8-ac7280a09901 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ae63bff3-75e7-4322-9b89-71ddb667d1bb,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:37.327322 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1cf3508c-f600-46f1-a0b8-ac7280a09901 admin admin] Notify callbacks [] for subnet, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:37.329153 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-1cf3508c-f600-46f1-a0b8-ac7280a09901 admin admin] 10.222.0.35 "DELETE /v2.0/subnets/ae63bff3-75e7-4322-9b89-71ddb667d1bb HTTP/1.1" status: 204 len: 168 time: 0.2176635 Sep 18 08:40:37.331560 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 59206) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:37.399731 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-5f7aac2b-8156-402b-9951-c2b176c6b01a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1861545'] for network, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:37.486675 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-5f7aac2b-8156-402b-9951-c2b176c6b01a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1806559', 'neutron.services.segments.db._delete_segments_for_network-8732885752733'] for network, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:37.505518 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-5f7aac2b-8156-402b-9951-c2b176c6b01a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b65d8cad-fd63-4b4e-9acf-f430f1925cb5']}} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:40:37.515571 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-5f7aac2b-8156-402b-9951-c2b176c6b01a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '423256e4-3aa4-4a93-b180-ed8d2baea524') {'for_net_delete': True} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:40:37.515876 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-5f7aac2b-8156-402b-9951-c2b176c6b01a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '423256e4-3aa4-4a93-b180-ed8d2baea524') {} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:40:37.525657 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-5f7aac2b-8156-402b-9951-c2b176c6b01a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732885753254', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14122733'] for segment, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:37.538868 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-5f7aac2b-8156-402b-9951-c2b176c6b01a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:37.546062 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5f7aac2b-8156-402b-9951-c2b176c6b01a admin admin] Releasing vlan 206 on physical network physnet1 to pool {{(pid=94346) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 18 08:40:37.546474 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-5f7aac2b-8156-402b-9951-c2b176c6b01a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14289667'] for segment, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: Traceback (most recent call last): Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: timer() Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: cb(*args, **kw) Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: return func(*args, **kwargs) Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: self._notify() Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: self.callback(batched_events) Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: event.method(event) Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: aggregate_uuid = self.p_client.list_aggregates( Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: return f(self, *a, **k) Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: return self._get(url).json() Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: return self.request(url, 'GET', **kwargs) Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: base_url = self.get_endpoint(auth, allow=allow, Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 18 08:40:37.548156 dv-cinder-804470-6-iscsi neutron-server[94346]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 18 08:40:37.615307 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-5f7aac2b-8156-402b-9951-c2b176c6b01a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1806534', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-784926'] for network, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:37.622728 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-5f7aac2b-8156-402b-9951-c2b176c6b01a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:37.628049 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-5f7aac2b-8156-402b-9951-c2b176c6b01a admin admin] 10.222.0.35 "DELETE /v2.0/networks/b65d8cad-fd63-4b4e-9acf-f430f1925cb5 HTTP/1.1" status: 204 len: 168 time: 0.2952948 Sep 18 08:40:37.628189 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 59212) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:37.638426 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f7aac2b-8156-402b-9951-c2b176c6b01a admin admin] Pushing event deleted for resources: {'Network': ['ID=b65d8cad-fd63-4b4e-9acf-f430f1925cb5,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:37.665131 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-458d2fee-1f09-47a9-977c-563f6430efaa tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:37.666661 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-458d2fee-1f09-47a9-977c-563f6430efaa tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.13 "GET /v2.0/networks?id=fe2753d3-7f3b-4739-adbf-6643a840c73e HTTP/1.1" status: 200 len: 815 time: 0.1497598 Sep 18 08:40:37.683974 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_v2 [None req-92714256-0a3d-4076-97b9-e1e43feb6044 admin admin] Deleting subnet e3207320-e62a-4b27-b843-164bb5c7629c {{(pid=94347) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 18 08:40:37.687056 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-92714256-0a3d-4076-97b9-e1e43feb6044 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:37.711114 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-c8946a45-8378-45ae-9844-570ed5e21d1f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Request body: {'port': {'device_id': 'a884b539-9c6e-40b3-87ef-28ca4a9daf7a', 'network_id': 'fe2753d3-7f3b-4739-adbf-6643a840c73e', 'admin_state_up': True, 'tenant_id': '38bd82e43ad3497aa14e8e4e68a29009'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:40:37.781020 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-92714256-0a3d-4076-97b9-e1e43feb6044 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-13659316'] for subnet, precommit_delete_associations {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:37.845012 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-92714256-0a3d-4076-97b9-e1e43feb6044 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1821528'] for subnet, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:37.930726 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-c8946a45-8378-45ae-9844-570ed5e21d1f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Made reservation on behalf of 38bd82e43ad3497aa14e8e4e68a29009 for: {'port': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:40:37.934486 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-c8946a45-8378-45ae-9844-570ed5e21d1f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:37.974328 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32da5014-423b-4198-8d90-ee8f586b98e3 req-6b571f99-8f88-415f-98d3-d5f3f3ed359f tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:37.975846 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-32da5014-423b-4198-8d90-ee8f586b98e3 req-6b571f99-8f88-415f-98d3-d5f3f3ed359f tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.1090794 Sep 18 08:40:37.996666 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-92714256-0a3d-4076-97b9-e1e43feb6044 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1821519', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15069100', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-13996283'] for subnet, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:38.105535 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92714256-0a3d-4076-97b9-e1e43feb6044 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e3207320-e62a-4b27-b843-164bb5c7629c,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:38.108027 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-92714256-0a3d-4076-97b9-e1e43feb6044 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for subnet, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:38.112416 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 59226) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:38.112986 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-92714256-0a3d-4076-97b9-e1e43feb6044 admin admin] 10.222.0.35 "DELETE /v2.0/subnets/e3207320-e62a-4b27-b843-164bb5c7629c HTTP/1.1" status: 204 len: 168 time: 0.4833736 Sep 18 08:40:38.152138 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-32da5014-423b-4198-8d90-ee8f586b98e3 req-33479757-36a4-4630-9d44-cdaf8f0ff9de tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1677434 Sep 18 08:40:38.161789 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68536abb-3d04-4f62-bc25-3b3212a9e6d6 req-4adc09a3-393b-492f-bc42-153a1ad77795 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:38.163344 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-68536abb-3d04-4f62-bc25-3b3212a9e6d6 req-4adc09a3-393b-492f-bc42-153a1ad77795 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 1098 time: 0.1805365 Sep 18 08:40:38.229694 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-24e3f428-e85e-4251-be54-d276244e1c97 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1861545'] for network, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:38.239592 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_common [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-c8946a45-8378-45ae-9844-570ed5e21d1f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Allocated IP 172.20.0.13 (fe2753d3-7f3b-4739-adbf-6643a840c73e/b96e08ba-91b8-4c1f-bd27-4a1270ccbde2/711ec98d-b2bf-4c0b-b015-9df1011dd8ce) {{(pid=94347) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:40:38.244526 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-68536abb-3d04-4f62-bc25-3b3212a9e6d6 req-7c525fa3-5b44-4342-a667-805b4fcfae85 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0604761 Sep 18 08:40:38.325833 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9e4a8901-eee6-4ece-8814-5cebc9373ff2 req-083f72a1-6c63-4f97-b66e-61f5c3bfad46 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=a884b539-9c6e-40b3-87ef-28ca4a9daf7a HTTP/1.1" status: 200 len: 210 time: 0.0382395 Sep 18 08:40:38.370777 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-24e3f428-e85e-4251-be54-d276244e1c97 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1806559', 'neutron.services.segments.db._delete_segments_for_network-8732885752733'] for network, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:38.394618 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-24e3f428-e85e-4251-be54-d276244e1c97 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['af22b74e-ec5b-418e-a9eb-b8a4203e2476']}} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:40:38.405496 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-24e3f428-e85e-4251-be54-d276244e1c97 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e842b13e-4180-46fb-817d-cffe43040763') {'for_net_delete': True} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:40:38.406109 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-24e3f428-e85e-4251-be54-d276244e1c97 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e842b13e-4180-46fb-817d-cffe43040763') {} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:40:38.416691 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-24e3f428-e85e-4251-be54-d276244e1c97 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732885753254', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14122733'] for segment, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:38.434511 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-24e3f428-e85e-4251-be54-d276244e1c97 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:38.442436 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-24e3f428-e85e-4251-be54-d276244e1c97 admin admin] Releasing vlan 228 on physical network physnet1 to pool {{(pid=94346) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 18 08:40:38.443214 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-24e3f428-e85e-4251-be54-d276244e1c97 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14289667'] for segment, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: Traceback (most recent call last): Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: timer() Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: cb(*args, **kw) Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: return func(*args, **kwargs) Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: self._notify() Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: self.callback(batched_events) Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: event.method(event) Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: aggregate_uuid = self.p_client.list_aggregates( Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: return f(self, *a, **k) Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: return self._get(url).json() Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: return self.request(url, 'GET', **kwargs) Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: base_url = self.get_endpoint(auth, allow=allow, Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 18 08:40:38.445976 dv-cinder-804470-6-iscsi neutron-server[94346]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 18 08:40:38.509569 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-c8946a45-8378-45ae-9844-570ed5e21d1f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks [] for port, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:38.531300 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-24e3f428-e85e-4251-be54-d276244e1c97 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1806534', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-784926'] for network, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:38.542223 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-24e3f428-e85e-4251-be54-d276244e1c97 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:38.547096 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-24e3f428-e85e-4251-be54-d276244e1c97 admin admin] 10.222.0.35 "DELETE /v2.0/networks/af22b74e-ec5b-418e-a9eb-b8a4203e2476 HTTP/1.1" status: 204 len: 168 time: 0.4328122 Sep 18 08:40:38.559253 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24e3f428-e85e-4251-be54-d276244e1c97 admin admin] Pushing event deleted for resources: {'Network': ['ID=af22b74e-ec5b-418e-a9eb-b8a4203e2476,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:38.583944 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-c8946a45-8378-45ae-9844-570ed5e21d1f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:38.630319 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-c8946a45-8378-45ae-9844-570ed5e21d1f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Network fe2753d3-7f3b-4739-adbf-6643a840c73e is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:40:38.634026 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-c8946a45-8378-45ae-9844-570ed5e21d1f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:40:38.637855 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-c8946a45-8378-45ae-9844-570ed5e21d1f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Received port after_create {{(pid=94347) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:40:38.651203 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['9a4f8ce9-f706-4c25-b3f4-05f2173cf516', '1f9a3d54-fb75-4f0c-8013-46a939823a2e'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:40:38.667491 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8946a45-8378-45ae-9844-570ed5e21d1f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Pushing event updated for resources: {'Port': ['ID=711ec98d-b2bf-4c0b-b015-9df1011dd8ce,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:38.718462 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-c8946a45-8378-45ae-9844-570ed5e21d1f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:38.719442 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-c8946a45-8378-45ae-9844-570ed5e21d1f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:38.754497 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-c8946a45-8378-45ae-9844-570ed5e21d1f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.0652730 Sep 18 08:40:38.804376 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 59240) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:38.852696 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-9d27968f-c4ec-4020-bfd7-82efadffde8b admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=f6c648eca8dd4001ae79ed3ee33c9944&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0458522 Sep 18 08:40:38.860760 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-a84af426-3d96-4f5b-a673-65ec602ccf47 service neutron] Request body: {'port': {'device_id': 'a884b539-9c6e-40b3-87ef-28ca4a9daf7a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80447'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:40:38.864946 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 59242) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:38.960555 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-a84af426-3d96-4f5b-a673-65ec602ccf47 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:39.026459 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-5112aef5-065c-4793-9265-7dce10844d6b admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:39.122044 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-5112aef5-065c-4793-9265-7dce10844d6b admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:39.463654 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68ea35e0-687c-4b53-a4da-6751b99ccc0d req-9fcaa6ff-0eb6-40ae-9f19-791f6162b8b3 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:39.470954 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-68ea35e0-687c-4b53-a4da-6751b99ccc0d req-9fcaa6ff-0eb6-40ae-9f19-791f6162b8b3 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.1998534 Sep 18 08:40:39.480940 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-5112aef5-065c-4793-9265-7dce10844d6b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:39.483396 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-5112aef5-065c-4793-9265-7dce10844d6b admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:39.487459 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-5112aef5-065c-4793-9265-7dce10844d6b admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/3805466d-8ade-4fc0-aaac-cef596cbc5c6 HTTP/1.1" status: 204 len: 168 time: 0.6211715 Sep 18 08:40:39.509406 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-a84af426-3d96-4f5b-a673-65ec602ccf47 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 711ec98d-b2bf-4c0b-b015-9df1011dd8ce {{(pid=94347) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:40:39.544601 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-a84af426-3d96-4f5b-a673-65ec602ccf47 service neutron] Notify callbacks [] for port, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:39.549788 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5112aef5-065c-4793-9265-7dce10844d6b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3805466d-8ade-4fc0-aaac-cef596cbc5c6,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:39.577544 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.provisioning_blocks [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-a84af426-3d96-4f5b-a673-65ec602ccf47 service neutron] Transition to ACTIVE for port object 711ec98d-b2bf-4c0b-b015-9df1011dd8ce will not be triggered until provisioned by entity L2. {{(pid=94347) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 18 08:40:39.588644 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95eb6ae2-31ef-4cee-a266-4ae344d4f23d req-48aa4415-826d-4d18-a585-1c3a7fe8e2c6 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:39.590280 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-95eb6ae2-31ef-4cee-a266-4ae344d4f23d req-48aa4415-826d-4d18-a585-1c3a7fe8e2c6 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=a884b539-9c6e-40b3-87ef-28ca4a9daf7a HTTP/1.1" status: 200 len: 932 time: 0.1605663 Sep 18 08:40:39.605728 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-68ea35e0-687c-4b53-a4da-6751b99ccc0d req-5adbaae6-bc40-4ba8-a53e-f852de4c42e4 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1281672 Sep 18 08:40:39.608503 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-a84af426-3d96-4f5b-a673-65ec602ccf47 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:39.784017 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 59280) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:39.946187 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a84af426-3d96-4f5b-a673-65ec602ccf47 service neutron] Pushing event updated for resources: {'Port': ['ID=711ec98d-b2bf-4c0b-b015-9df1011dd8ce,revision_number=2']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:40.007426 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-4c19182c-1c95-4335-abf2-006942724cdf admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:40.028424 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-95eb6ae2-31ef-4cee-a266-4ae344d4f23d req-72fd7116-60d0-4e32-bac9-c7f470ad9d65 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4211419 Sep 18 08:40:40.060824 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-a84af426-3d96-4f5b-a673-65ec602ccf47 service neutron] Attempting to bind port 711ec98d-b2bf-4c0b-b015-9df1011dd8ce on host hv-cinder-80447 for vnic_type normal with profile {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:40:40.061157 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-a84af426-3d96-4f5b-a673-65ec602ccf47 service neutron] Attempting to bind port 711ec98d-b2bf-4c0b-b015-9df1011dd8ce by drivers openvswitch,hyperv on host hv-cinder-80447 at level 0 using segments [{'id': 'd1432479-9c27-42c4-87db-6905e7868675', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 233, 'network_id': 'fe2753d3-7f3b-4739-adbf-6643a840c73e'}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:40:40.061520 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-a84af426-3d96-4f5b-a673-65ec602ccf47 service neutron] Attempting to bind port 711ec98d-b2bf-4c0b-b015-9df1011dd8ce on network fe2753d3-7f3b-4739-adbf-6643a840c73e {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:40:40.065849 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-a84af426-3d96-4f5b-a673-65ec602ccf47 service neutron] Port 711ec98d-b2bf-4c0b-b015-9df1011dd8ce on network fe2753d3-7f3b-4739-adbf-6643a840c73e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80447 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 18 08:40:40.066169 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-a84af426-3d96-4f5b-a673-65ec602ccf47 service neutron] Attempting to bind port 711ec98d-b2bf-4c0b-b015-9df1011dd8ce on network fe2753d3-7f3b-4739-adbf-6643a840c73e {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:40:40.072359 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-a84af426-3d96-4f5b-a673-65ec602ccf47 service neutron] Checking agent: {'id': '8d51fdc4-974b-4200-9c3f-5dddea60a869', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80447', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'started_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 40, 20), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:40:40.072718 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-a84af426-3d96-4f5b-a673-65ec602ccf47 service neutron] Checking segment: {'id': 'd1432479-9c27-42c4-87db-6905e7868675', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 233, 'network_id': 'fe2753d3-7f3b-4739-adbf-6643a840c73e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94347) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:40:40.073102 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-a84af426-3d96-4f5b-a673-65ec602ccf47 service neutron] Bound using segment: {'id': 'd1432479-9c27-42c4-87db-6905e7868675', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 233, 'network_id': 'fe2753d3-7f3b-4739-adbf-6643a840c73e'} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:40:40.073546 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-a84af426-3d96-4f5b-a673-65ec602ccf47 service neutron] Bound port: 711ec98d-b2bf-4c0b-b015-9df1011dd8ce, host: hv-cinder-80447, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd1432479-9c27-42c4-87db-6905e7868675', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 233, 'network_id': 'fe2753d3-7f3b-4739-adbf-6643a840c73e'}}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:40:40.073906 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-a84af426-3d96-4f5b-a673-65ec602ccf47 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:40.095577 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 59288) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:40.186229 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-a84af426-3d96-4f5b-a673-65ec602ccf47 service neutron] For port 711ec98d-b2bf-4c0b-b015-9df1011dd8ce, host hv-cinder-80447, cleared binding levels {{(pid=94347) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:40:40.193021 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-a84af426-3d96-4f5b-a673-65ec602ccf47 service neutron] For port 711ec98d-b2bf-4c0b-b015-9df1011dd8ce, host hv-cinder-80447, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=711ec98d-b2bf-4c0b-b015-9df1011dd8ce,segment=NetworkSegment(d1432479-9c27-42c4-87db-6905e7868675),segment_id=d1432479-9c27-42c4-87db-6905e7868675)] {{(pid=94347) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:40:40.199954 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-bec52302-d337-404c-af7d-216a4149345d admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=09965c611a924e2e8701a5f1fc6647c6&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1010151 Sep 18 08:40:40.200156 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 59290) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:40.208710 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-4c19182c-1c95-4335-abf2-006942724cdf admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:40.209370 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-a84af426-3d96-4f5b-a673-65ec602ccf47 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:40.222292 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-4c19182c-1c95-4335-abf2-006942724cdf admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:40.268020 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-a84af426-3d96-4f5b-a673-65ec602ccf47 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:40.268690 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-a84af426-3d96-4f5b-a673-65ec602ccf47 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:40.270546 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-a84af426-3d96-4f5b-a673-65ec602ccf47 service neutron] 10.222.0.13 "PUT /v2.0/ports/711ec98d-b2bf-4c0b-b015-9df1011dd8ce HTTP/1.1" status: 200 len: 1094 time: 1.4150817 Sep 18 08:40:40.270976 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a884b539-9c6e-40b3-87ef-28ca4a9daf7a', 'tag': '711ec98d-b2bf-4c0b-b015-9df1011dd8ce'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:40:40.274173 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-59083fbd-2797-4be1-bcd3-6d5e0ac34a26" -d '{"events": [{"name": "network-changed", "server_uuid": "a884b539-9c6e-40b3-87ef-28ca4a9daf7a", "tag": "711ec98d-b2bf-4c0b-b015-9df1011dd8ce"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:40:40.284248 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-4c19182c-1c95-4335-abf2-006942724cdf admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=0c2884b36c334283af9ccdc5b893919f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4980841 Sep 18 08:40:40.285232 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c19182c-1c95-4335-abf2-006942724cdf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=73f1e5b8-bcd9-4628-9870-09a5725d21e1,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:40.287968 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 59294) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:40.330453 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a84af426-3d96-4f5b-a673-65ec602ccf47 service neutron] Pushing event updated for resources: {'Port': ['ID=711ec98d-b2bf-4c0b-b015-9df1011dd8ce,revision_number=3']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:40.353325 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c1446016-dd68-45e6-8f31-3bf2b9f836be admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:40.383403 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-661dbcf2-8bb9-4eb3-8e24-126e7b10394d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:40.417689 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-661dbcf2-8bb9-4eb3-8e24-126e7b10394d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:40.418281 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:40:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1025d971-664a-44cf-9462-5bf85275f4eb x-openstack-request-id: req-1025d971-664a-44cf-9462-5bf85275f4eb {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:40:40.419555 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a884b539-9c6e-40b3-87ef-28ca4a9daf7a", "tag": "711ec98d-b2bf-4c0b-b015-9df1011dd8ce", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:40:40.420014 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-1025d971-664a-44cf-9462-5bf85275f4eb {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:40:40.420729 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a884b539-9c6e-40b3-87ef-28ca4a9daf7a', 'tag': '711ec98d-b2bf-4c0b-b015-9df1011dd8ce', 'status': 'completed', 'code': 200} Sep 18 08:40:40.457029 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c1446016-dd68-45e6-8f31-3bf2b9f836be admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:40.469292 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-8be8e48b-16bb-468d-9f05-de1e2896bf7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:40.471354 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-8be8e48b-16bb-468d-9f05-de1e2896bf7b service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=38bd82e43ad3497aa14e8e4e68a29009&device_id=a884b539-9c6e-40b3-87ef-28ca4a9daf7a HTTP/1.1" status: 200 len: 1097 time: 0.1029308 Sep 18 08:40:40.547174 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-05c54f0f-bcd7-4850-a9b2-37fec53c0ffb service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=711ec98d-b2bf-4c0b-b015-9df1011dd8ce HTTP/1.1" status: 200 len: 217 time: 0.0566890 Sep 18 08:40:40.598629 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-661dbcf2-8bb9-4eb3-8e24-126e7b10394d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:40.608807 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-661dbcf2-8bb9-4eb3-8e24-126e7b10394d admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:40.608807 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-661dbcf2-8bb9-4eb3-8e24-126e7b10394d admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/73f1e5b8-bcd9-4628-9870-09a5725d21e1 HTTP/1.1" status: 204 len: 168 time: 0.3046334 Sep 18 08:40:40.634583 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-661dbcf2-8bb9-4eb3-8e24-126e7b10394d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=73f1e5b8-bcd9-4628-9870-09a5725d21e1,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:40.672499 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-cf41f5cf-fe77-4bae-80b5-7541a7657005 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:40.674100 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-cf41f5cf-fe77-4bae-80b5-7541a7657005 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=b96e08ba-91b8-4c1f-bd27-4a1270ccbde2 HTTP/1.1" status: 200 len: 855 time: 0.1149924 Sep 18 08:40:40.712377 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-1bf138e7-6af5-41b2-a6c5-5853006ef838 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fe2753d3-7f3b-4739-adbf-6643a840c73e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0286899 Sep 18 08:40:40.724807 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c1446016-dd68-45e6-8f31-3bf2b9f836be admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:40.728233 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c1446016-dd68-45e6-8f31-3bf2b9f836be admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:40.731902 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-c1446016-dd68-45e6-8f31-3bf2b9f836be admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/f761100b-8596-4f9b-a3b8-e4d8a5f37b10 HTTP/1.1" status: 204 len: 168 time: 0.5282266 Sep 18 08:40:40.777997 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1446016-dd68-45e6-8f31-3bf2b9f836be admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f761100b-8596-4f9b-a3b8-e4d8a5f37b10,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:40.848173 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21e7646b-5511-4baf-8140-b8c1e40cbccc req-b24fa97c-76ef-4977-8447-3f2b5d60a641 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:40.855676 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-21e7646b-5511-4baf-8140-b8c1e40cbccc req-b24fa97c-76ef-4977-8447-3f2b5d60a641 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.1455538 Sep 18 08:40:40.888643 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-ea0b8b29-41f0-461d-9837-cb795c17bea9 service neutron] 10.222.0.13 "GET /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1580653 Sep 18 08:40:40.972510 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-21e7646b-5511-4baf-8140-b8c1e40cbccc req-b6a3a483-19d9-4b80-bfa0-128cc822dcd8 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1159678 Sep 18 08:40:41.065603 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7c832564-7e5a-4522-a199-9db3c9e6ce1c req-1f8cc084-fbf2-4a9f-b60a-3792c7535136 service neutron] 10.222.0.13 "GET /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1612236 Sep 18 08:40:41.209755 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80dbbc7b-08d2-4ca3-8401-005cb428a281 req-51873bfb-eb23-42b8-a663-eb9a3db533ac tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:41.234192 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-80dbbc7b-08d2-4ca3-8401-005cb428a281 req-51873bfb-eb23-42b8-a663-eb9a3db533ac tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=a884b539-9c6e-40b3-87ef-28ca4a9daf7a HTTP/1.1" status: 200 len: 944 time: 0.1052430 Sep 18 08:40:41.308842 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 59332) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:41.324665 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c4fd064a-8da0-4610-8413-2e3a84060df3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:41.343160 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-80dbbc7b-08d2-4ca3-8401-005cb428a281 req-c87fba1d-70ba-4e44-bc2f-f4d1b8fd376e tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0946572 Sep 18 08:40:41.375349 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59083fbd-2797-4be1-bcd3-6d5e0ac34a26 req-8796f2d2-0a13-4d5b-918d-eee191306f07 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:41.379871 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-59083fbd-2797-4be1-bcd3-6d5e0ac34a26 req-8796f2d2-0a13-4d5b-918d-eee191306f07 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=38bd82e43ad3497aa14e8e4e68a29009&device_id=a884b539-9c6e-40b3-87ef-28ca4a9daf7a HTTP/1.1" status: 200 len: 1097 time: 0.1129701 Sep 18 08:40:41.449192 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c4fd064a-8da0-4610-8413-2e3a84060df3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:41.462047 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c4fd064a-8da0-4610-8413-2e3a84060df3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:41.526343 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-c4fd064a-8da0-4610-8413-2e3a84060df3 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=7b8b84c636f14d22a657191aae184a38&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2151265 Sep 18 08:40:41.528409 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 59340) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:41.545575 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8674226b-0a7c-4ab3-b599-e3bc2290e0d9 req-447ea937-0b1e-415b-8cad-65a866f0e8db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:41.547482 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8674226b-0a7c-4ab3-b599-e3bc2290e0d9 req-447ea937-0b1e-415b-8cad-65a866f0e8db service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=f439efa4eed0456ab2a914377e490fad&device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 1098 time: 0.1655343 Sep 18 08:40:41.591738 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4fd064a-8da0-4610-8413-2e3a84060df3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ac8b73c9-802d-4feb-a0ad-99e440b9c8e5,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:41.616180 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1783aa95-5981-40ad-9e10-17ca37b6b44d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:41.619841 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3076308-a598-4c9a-baa7-bf1de39b44ee req-fd839aac-8669-459a-b86b-111bdb227172 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:41.627890 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d3076308-a598-4c9a-baa7-bf1de39b44ee req-fd839aac-8669-459a-b86b-111bdb227172 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.1630979 Sep 18 08:40:41.640938 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59083fbd-2797-4be1-bcd3-6d5e0ac34a26 req-aefb5994-c9d4-46d7-a652-cae008627b70 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:41.642603 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-59083fbd-2797-4be1-bcd3-6d5e0ac34a26 req-aefb5994-c9d4-46d7-a652-cae008627b70 service neutron] 10.222.0.13 "GET /v2.0/networks?id=fe2753d3-7f3b-4739-adbf-6643a840c73e HTTP/1.1" status: 200 len: 916 time: 0.2389345 Sep 18 08:40:41.643866 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1783aa95-5981-40ad-9e10-17ca37b6b44d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:41.715566 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1783aa95-5981-40ad-9e10-17ca37b6b44d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:41.718311 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1783aa95-5981-40ad-9e10-17ca37b6b44d admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:41.719729 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-1783aa95-5981-40ad-9e10-17ca37b6b44d admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/ac8b73c9-802d-4feb-a0ad-99e440b9c8e5 HTTP/1.1" status: 204 len: 168 time: 0.1901541 Sep 18 08:40:41.729489 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1783aa95-5981-40ad-9e10-17ca37b6b44d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ac8b73c9-802d-4feb-a0ad-99e440b9c8e5,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:41.740080 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-59083fbd-2797-4be1-bcd3-6d5e0ac34a26 req-0de596f7-65f8-4948-a15d-cbc4ddc497bb service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=711ec98d-b2bf-4c0b-b015-9df1011dd8ce HTTP/1.1" status: 200 len: 217 time: 0.0550461 Sep 18 08:40:41.762293 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d3076308-a598-4c9a-baa7-bf1de39b44ee req-efda10b8-f0d0-4003-96fd-39583864a9fe tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1313891 Sep 18 08:40:41.824410 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8674226b-0a7c-4ab3-b599-e3bc2290e0d9 req-492b9929-8c58-420d-a12f-8c8a7c1f027f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:41.826387 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8674226b-0a7c-4ab3-b599-e3bc2290e0d9 req-492b9929-8c58-420d-a12f-8c8a7c1f027f service neutron] 10.222.0.13 "GET /v2.0/networks?id=fdcbc66e-323e-4b44-be97-566949f4f2ef HTTP/1.1" status: 200 len: 919 time: 0.2699871 Sep 18 08:40:41.890118 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8674226b-0a7c-4ab3-b599-e3bc2290e0d9 req-5cac3e38-c08c-49fc-8e37-2a0c0ec5d5a4 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b03411eb-66ff-4691-88c8-2c570d78c323 HTTP/1.1" status: 200 len: 217 time: 0.0535171 Sep 18 08:40:41.934618 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59083fbd-2797-4be1-bcd3-6d5e0ac34a26 req-114e16a1-d365-4733-ad9a-0ea78793e5f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:41.937817 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-59083fbd-2797-4be1-bcd3-6d5e0ac34a26 req-114e16a1-d365-4733-ad9a-0ea78793e5f2 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=b96e08ba-91b8-4c1f-bd27-4a1270ccbde2 HTTP/1.1" status: 200 len: 855 time: 0.1877422 Sep 18 08:40:41.994237 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8674226b-0a7c-4ab3-b599-e3bc2290e0d9 req-06d0c995-fd1b-4b0c-8c48-1aad068cc032 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:41.996453 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8674226b-0a7c-4ab3-b599-e3bc2290e0d9 req-06d0c995-fd1b-4b0c-8c48-1aad068cc032 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=e5dc6eef-e778-41a2-a708-c7810ade97db HTTP/1.1" status: 200 len: 858 time: 0.0933905 Sep 18 08:40:42.026378 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-59083fbd-2797-4be1-bcd3-6d5e0ac34a26 req-61905e7e-bb5e-41b6-b7a2-ee1358065727 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fe2753d3-7f3b-4739-adbf-6643a840c73e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0289369 Sep 18 08:40:42.077844 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8674226b-0a7c-4ab3-b599-e3bc2290e0d9 req-d6625ec0-6644-4b6b-b9ed-9e88781c5d26 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fdcbc66e-323e-4b44-be97-566949f4f2ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0503371 Sep 18 08:40:42.255267 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-59083fbd-2797-4be1-bcd3-6d5e0ac34a26 req-f6e07e6a-790f-4c2a-bb44-230b12436952 service neutron] 10.222.0.13 "GET /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1797111 Sep 18 08:40:42.305176 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8674226b-0a7c-4ab3-b599-e3bc2290e0d9 req-87c3b3fc-13ef-4621-b2ee-0e6785561ddd service neutron] 10.222.0.13 "GET /v2.0/networks/fdcbc66e-323e-4b44-be97-566949f4f2ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1929014 Sep 18 08:40:42.497252 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-59083fbd-2797-4be1-bcd3-6d5e0ac34a26 req-ec566d1e-09fa-4976-a7ce-8cf1c4d11e7a service neutron] 10.222.0.13 "GET /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2320812 Sep 18 08:40:42.560099 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb0f141b-3902-4d7d-b255-b6a1bfdc91cf req-e428d970-630e-48f7-b679-4bad4ebb3448 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:42.562400 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-eb0f141b-3902-4d7d-b255-b6a1bfdc91cf req-e428d970-630e-48f7-b679-4bad4ebb3448 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=a884b539-9c6e-40b3-87ef-28ca4a9daf7a HTTP/1.1" status: 200 len: 944 time: 0.1057498 Sep 18 08:40:42.567438 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8674226b-0a7c-4ab3-b599-e3bc2290e0d9 req-cf90a9ae-7ec2-4504-986f-1ea08bf94327 service neutron] 10.222.0.13 "GET /v2.0/networks/fdcbc66e-323e-4b44-be97-566949f4f2ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2330949 Sep 18 08:40:42.622419 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-eb0f141b-3902-4d7d-b255-b6a1bfdc91cf req-5f3cfdfd-1954-43e2-9546-c1c5eaea7f8d tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0521762 Sep 18 08:40:42.914275 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69ebd3a5-15b0-4545-8c83-7dd8e6e061d9 req-28269a1d-fe4a-4081-9129-e8791802e103 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:42.922139 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-69ebd3a5-15b0-4545-8c83-7dd8e6e061d9 req-28269a1d-fe4a-4081-9129-e8791802e103 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0866783 Sep 18 08:40:42.977171 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-69ebd3a5-15b0-4545-8c83-7dd8e6e061d9 req-0e0ad1c7-35ed-482f-a640-9664c1fb0580 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492785 Sep 18 08:40:43.769177 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c84a67b-6c7f-46ac-9a10-f099f3e0b21e req-fc991065-0100-45a4-9a25-6d0f7c323d3d tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:43.777376 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5c84a67b-6c7f-46ac-9a10-f099f3e0b21e req-fc991065-0100-45a4-9a25-6d0f7c323d3d tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=a884b539-9c6e-40b3-87ef-28ca4a9daf7a HTTP/1.1" status: 200 len: 944 time: 0.0703573 Sep 18 08:40:43.825644 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5c84a67b-6c7f-46ac-9a10-f099f3e0b21e req-0461a0c8-51fd-43c8-bd9a-dc64a6ffa082 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437584 Sep 18 08:40:44.084973 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d77f7e3a-fbe2-4504-b562-11a2cc6c2c54 req-81fb668c-94b7-464a-9b77-0ce5699de959 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:44.087116 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d77f7e3a-fbe2-4504-b562-11a2cc6c2c54 req-81fb668c-94b7-464a-9b77-0ce5699de959 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0482519 Sep 18 08:40:44.123653 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d77f7e3a-fbe2-4504-b562-11a2cc6c2c54 req-a6f28682-37a8-43b8-9300-5b1cb3da114f tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0308115 Sep 18 08:40:44.967042 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f738c22c-9a2b-42cd-83bf-da1d7f5590c7 req-ba2462e9-a935-4217-b130-3bb0c01d17ed tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:44.968558 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f738c22c-9a2b-42cd-83bf-da1d7f5590c7 req-ba2462e9-a935-4217-b130-3bb0c01d17ed tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=a884b539-9c6e-40b3-87ef-28ca4a9daf7a HTTP/1.1" status: 200 len: 944 time: 0.0733585 Sep 18 08:40:45.012113 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f738c22c-9a2b-42cd-83bf-da1d7f5590c7 req-6d21e63d-5dff-4e67-8f9d-6ba0908c1cba tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0369391 Sep 18 08:40:45.249453 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e639494-6db8-4fa0-a33a-6bef9ed923fc req-3bf5b49b-b9c3-449a-a622-9c6369ecb0eb tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:45.251304 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3e639494-6db8-4fa0-a33a-6bef9ed923fc req-3bf5b49b-b9c3-449a-a622-9c6369ecb0eb tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0523992 Sep 18 08:40:45.293654 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3e639494-6db8-4fa0-a33a-6bef9ed923fc req-db7b3cda-cad5-467a-8e0c-1c3cdffa35e6 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0353942 Sep 18 08:40:45.484007 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 711ec98d-b2bf-4c0b-b015-9df1011dd8ce details requested by agent hyperv_hv-cinder-80447 with host hv-cinder-80447 {{(pid=94348) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 18 08:40:45.611334 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 711ec98d-b2bf-4c0b-b015-9df1011dd8ce, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=711ec98d-b2bf-4c0b-b015-9df1011dd8ce,segment=NetworkSegment(d1432479-9c27-42c4-87db-6905e7868675),segment_id=d1432479-9c27-42c4-87db-6905e7868675)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:40:45.626978 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Returning: {'device': '711ec98d-b2bf-4c0b-b015-9df1011dd8ce', 'network_id': 'fe2753d3-7f3b-4739-adbf-6643a840c73e', 'port_id': '711ec98d-b2bf-4c0b-b015-9df1011dd8ce', 'mac_address': 'fa:16:3e:c2:7b:c6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 233, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b96e08ba-91b8-4c1f-bd27-4a1270ccbde2', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94348) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 18 08:40:45.688310 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:45.702786 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 711ec98d-b2bf-4c0b-b015-9df1011dd8ce {{(pid=94348) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:40:45.728434 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 711ec98d-b2bf-4c0b-b015-9df1011dd8ce, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=711ec98d-b2bf-4c0b-b015-9df1011dd8ce,segment=NetworkSegment(d1432479-9c27-42c4-87db-6905e7868675),segment_id=d1432479-9c27-42c4-87db-6905e7868675)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:40:45.737761 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:45.798205 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=711ec98d-b2bf-4c0b-b015-9df1011dd8ce,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:46.140133 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51fff5e9-880c-47d7-85ea-d6c1a0ad617f req-471863bb-0955-4be5-9c09-f2f6e7dc4a8b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:46.142002 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-51fff5e9-880c-47d7-85ea-d6c1a0ad617f req-471863bb-0955-4be5-9c09-f2f6e7dc4a8b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=a884b539-9c6e-40b3-87ef-28ca4a9daf7a HTTP/1.1" status: 200 len: 945 time: 0.0539215 Sep 18 08:40:46.185650 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-51fff5e9-880c-47d7-85ea-d6c1a0ad617f req-559cbec6-ea25-47c4-9578-2f0073180a48 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0358734 Sep 18 08:40:46.451641 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b7aa257-f82c-4aef-a613-5c38f7b5accc req-51201694-d5a0-411b-b27f-50fda05b1a6b tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:46.453255 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2b7aa257-f82c-4aef-a613-5c38f7b5accc req-51201694-d5a0-411b-b27f-50fda05b1a6b tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0691247 Sep 18 08:40:46.499075 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2b7aa257-f82c-4aef-a613-5c38f7b5accc req-59f020bf-141a-4a8b-87d1-3bf4386b0cdc tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0329168 Sep 18 08:40:46.865331 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['711ec98d-b2bf-4c0b-b015-9df1011dd8ce'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:40:47.334783 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a203035-a79c-443f-a295-da0016e4c03c req-e0bacb19-0406-48d4-a75d-14398f121988 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:47.337688 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4a203035-a79c-443f-a295-da0016e4c03c req-e0bacb19-0406-48d4-a75d-14398f121988 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=a884b539-9c6e-40b3-87ef-28ca4a9daf7a HTTP/1.1" status: 200 len: 945 time: 0.0655348 Sep 18 08:40:47.393984 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4a203035-a79c-443f-a295-da0016e4c03c req-468383e3-3063-4159-b0d1-6eecd1820826 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492046 Sep 18 08:40:47.643347 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe16d63d-06cc-4594-b374-c6f41f73da1c req-41057f54-efd3-47e7-bd09-e1580b5349db tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:47.644890 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fe16d63d-06cc-4594-b374-c6f41f73da1c req-41057f54-efd3-47e7-bd09-e1580b5349db tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0643966 Sep 18 08:40:47.708315 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fe16d63d-06cc-4594-b374-c6f41f73da1c req-4b801bd7-a84f-4d00-9c1d-93c4705ef41e tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0523112 Sep 18 08:40:48.045695 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 59550) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:48.173057 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3e09e4ec-ecbe-4b09-959c-77cc576038f1 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:48.264653 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3e09e4ec-ecbe-4b09-959c-77cc576038f1 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:48.269061 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3e09e4ec-ecbe-4b09-959c-77cc576038f1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:48.314139 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-3e09e4ec-ecbe-4b09-959c-77cc576038f1 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=86d91c65ccdb43dbadb32290f3fae187&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2661922 Sep 18 08:40:48.314370 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 59554) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:48.315376 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e09e4ec-ecbe-4b09-959c-77cc576038f1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=05dc705e-7a54-459a-a0e6-2ba040612ae9,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:48.393386 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-93cf27e7-b81d-4f26-a067-3d5ab6b01ded admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:48.424847 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-93cf27e7-b81d-4f26-a067-3d5ab6b01ded admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:48.485082 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-93cf27e7-b81d-4f26-a067-3d5ab6b01ded admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:48.487945 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-93cf27e7-b81d-4f26-a067-3d5ab6b01ded admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:48.491317 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-93cf27e7-b81d-4f26-a067-3d5ab6b01ded admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/05dc705e-7a54-459a-a0e6-2ba040612ae9 HTTP/1.1" status: 204 len: 168 time: 0.1758702 Sep 18 08:40:48.532335 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93cf27e7-b81d-4f26-a067-3d5ab6b01ded admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=05dc705e-7a54-459a-a0e6-2ba040612ae9,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:48.586953 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be87ca53-3ee9-44e5-95b8-8dac0b2e7254 req-ad971d55-c1d3-4e3a-af9d-125a8671a748 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:48.597526 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-be87ca53-3ee9-44e5-95b8-8dac0b2e7254 req-ad971d55-c1d3-4e3a-af9d-125a8671a748 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=a884b539-9c6e-40b3-87ef-28ca4a9daf7a HTTP/1.1" status: 200 len: 945 time: 0.1236787 Sep 18 08:40:48.652151 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-be87ca53-3ee9-44e5-95b8-8dac0b2e7254 req-fb1c6fb6-065e-4d4f-876d-b775204837fe tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482447 Sep 18 08:40:48.849752 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-509e97b8-2f47-44cc-81c3-287520649156 req-9bdb0922-e6a2-4ca6-95fa-558bd5ad9212 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:48.852028 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-509e97b8-2f47-44cc-81c3-287520649156 req-9bdb0922-e6a2-4ca6-95fa-558bd5ad9212 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0663385 Sep 18 08:40:48.898486 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-509e97b8-2f47-44cc-81c3-287520649156 req-1147df80-20d9-46d5-b0c5-b29c5846c5ca tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0397186 Sep 18 08:40:49.065341 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 59586) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:49.089720 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-25afdf97-055b-423d-8c8b-b7691414524e admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:49.249440 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-25afdf97-055b-423d-8c8b-b7691414524e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:49.258770 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-25afdf97-055b-423d-8c8b-b7691414524e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:49.304755 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-25afdf97-055b-423d-8c8b-b7691414524e admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=0b47a0a1674b42e0b1b9daa3b31f4138&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2360592 Sep 18 08:40:49.304755 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25afdf97-055b-423d-8c8b-b7691414524e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=790b644b-a6e6-4dcd-9b7f-26fa7503ef1d,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:49.305336 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 59592) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:49.375036 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-9b6dea80-92b0-40dc-949a-297db1551df6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:49.397303 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-9b6dea80-92b0-40dc-949a-297db1551df6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:49.447785 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-9b6dea80-92b0-40dc-949a-297db1551df6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:49.450386 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-9b6dea80-92b0-40dc-949a-297db1551df6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:49.453919 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-9b6dea80-92b0-40dc-949a-297db1551df6 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/790b644b-a6e6-4dcd-9b7f-26fa7503ef1d HTTP/1.1" status: 204 len: 168 time: 0.1452546 Sep 18 08:40:49.462350 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b6dea80-92b0-40dc-949a-297db1551df6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=790b644b-a6e6-4dcd-9b7f-26fa7503ef1d,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:49.506703 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 711ec98d-b2bf-4c0b-b015-9df1011dd8ce up at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:40:49.560544 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning for port 711ec98d-b2bf-4c0b-b015-9df1011dd8ce completed by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 18 08:40:49.566171 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning complete for port 711ec98d-b2bf-4c0b-b015-9df1011dd8ce triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:40:49.566171 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:49.635821 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-7715acc9-137f-4bca-9d75-f1d12c206894 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:49.699518 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:49.751260 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a884b539-9c6e-40b3-87ef-28ca4a9daf7a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '711ec98d-b2bf-4c0b-b015-9df1011dd8ce'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:40:49.754135 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-034551c6-b6ed-40ea-acbd-b648a1c8cdba" -d '{"events": [{"server_uuid": "a884b539-9c6e-40b3-87ef-28ca4a9daf7a", "name": "network-vif-plugged", "status": "completed", "tag": "711ec98d-b2bf-4c0b-b015-9df1011dd8ce"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:40:49.769984 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 711ec98d-b2bf-4c0b-b015-9df1011dd8ce, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=711ec98d-b2bf-4c0b-b015-9df1011dd8ce,segment=NetworkSegment(d1432479-9c27-42c4-87db-6905e7868675),segment_id=d1432479-9c27-42c4-87db-6905e7868675)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:40:49.777331 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:49.808424 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b079e05e-2a4d-4b95-8cee-1602e2151243 req-744798bd-ca5a-4d34-ab76-7fbf88ac61f8 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:49.810776 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b079e05e-2a4d-4b95-8cee-1602e2151243 req-744798bd-ca5a-4d34-ab76-7fbf88ac61f8 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=a884b539-9c6e-40b3-87ef-28ca4a9daf7a HTTP/1.1" status: 200 len: 945 time: 0.0950394 Sep 18 08:40:49.830266 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:40:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-227edb02-01d8-432b-a2b0-ccb5ec20e8a5 x-openstack-request-id: req-227edb02-01d8-432b-a2b0-ccb5ec20e8a5 {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:40:49.830665 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a884b539-9c6e-40b3-87ef-28ca4a9daf7a", "name": "network-vif-plugged", "status": "completed", "tag": "711ec98d-b2bf-4c0b-b015-9df1011dd8ce", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:40:49.831088 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-227edb02-01d8-432b-a2b0-ccb5ec20e8a5 {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:40:49.831585 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a884b539-9c6e-40b3-87ef-28ca4a9daf7a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '711ec98d-b2bf-4c0b-b015-9df1011dd8ce', 'code': 200} Sep 18 08:40:49.872526 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b079e05e-2a4d-4b95-8cee-1602e2151243 req-fb50d55c-c613-4b40-b014-d2e2e309a2d1 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0547228 Sep 18 08:40:49.873543 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=711ec98d-b2bf-4c0b-b015-9df1011dd8ce,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:49.924668 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:50.101678 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caad983c-88af-4b90-b70e-f82987a9e6ff req-926942b3-8cc3-4ffa-bc79-8d2b5b3b1f70 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:50.103383 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-caad983c-88af-4b90-b70e-f82987a9e6ff req-926942b3-8cc3-4ffa-bc79-8d2b5b3b1f70 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=a884b539-9c6e-40b3-87ef-28ca4a9daf7a HTTP/1.1" status: 200 len: 1099 time: 0.0462265 Sep 18 08:40:50.160799 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-caad983c-88af-4b90-b70e-f82987a9e6ff req-9976cd31-e702-4a55-bbec-f79391c95d91 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493534 Sep 18 08:40:50.903398 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-f81a825f-4fc3-4927-a09c-2f82333314ca tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-217661707&fields=id&tenant_id=467aba0ce03e40a6927a5c05223dd512 HTTP/1.1" status: 200 len: 267 time: 0.0431430 Sep 18 08:40:51.037482 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-40409e2f-625f-4f10-a11f-ef2a4e287822 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:51.045030 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-40409e2f-625f-4f10-a11f-ef2a4e287822 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/networks?id=c81b2232-3aba-4f15-b8f1-a71826c8c1ca HTTP/1.1" status: 200 len: 808 time: 0.1314924 Sep 18 08:40:51.056176 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-d020c6de-50da-4c81-8220-836103668995 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/quotas/467aba0ce03e40a6927a5c05223dd512 HTTP/1.1" status: 200 len: 375 time: 0.0102427 Sep 18 08:40:51.129488 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-9e6aa49a-9836-4f1e-bfc1-29269ee323cd tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?tenant_id=467aba0ce03e40a6927a5c05223dd512&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0672553 Sep 18 08:40:51.290310 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-5ea7fc08-cb95-407c-bfb1-607c0a2ff4f0 service neutron] 10.222.0.35 "GET /v2.0/networks/c81b2232-3aba-4f15-b8f1-a71826c8c1ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1429956 Sep 18 08:40:51.293842 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abb3c7ac-51cd-43b6-9e8d-4630f91cc05a req-5d79c268-07bc-4233-aa99-eb84c5f0e85a tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:51.295772 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-abb3c7ac-51cd-43b6-9e8d-4630f91cc05a req-5d79c268-07bc-4233-aa99-eb84c5f0e85a tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=a884b539-9c6e-40b3-87ef-28ca4a9daf7a HTTP/1.1" status: 200 len: 946 time: 0.0727177 Sep 18 08:40:51.427575 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-abb3c7ac-51cd-43b6-9e8d-4630f91cc05a req-85e96b2d-f713-411c-b551-5387a2ef5702 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0969348 Sep 18 08:40:51.457835 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-d8dcfa97-1959-41c9-9a9e-072babc4c503 service neutron] 10.222.0.35 "GET /v2.0/networks/c81b2232-3aba-4f15-b8f1-a71826c8c1ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1542428 Sep 18 08:40:51.595671 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77c60000-118b-4c0c-b54e-fabd36a99b12 req-3bb3c15f-888c-4c59-8473-a24c4453f28b tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:51.597743 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-77c60000-118b-4c0c-b54e-fabd36a99b12 req-3bb3c15f-888c-4c59-8473-a24c4453f28b tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0606687 Sep 18 08:40:51.652867 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-77c60000-118b-4c0c-b54e-fabd36a99b12 req-99e0919c-16aa-43a7-9873-9a31c613f1f8 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0476241 Sep 18 08:40:52.014011 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d6fcdcdd-c432-4a8f-9e36-4cd0b9b8f719 req-b3e67698-f5a3-48e6-b2a7-3adeb5ad0b61 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 210 time: 0.0712607 Sep 18 08:40:52.404724 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-9b9b7c63-b625-4176-a737-b3928df9d20d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:52.560861 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfd65435-a2ce-4550-8ca6-e932ae8e34d3 req-a2a1bf9a-7a27-43cd-948d-71100d9b0521 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:52.562506 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cfd65435-a2ce-4550-8ca6-e932ae8e34d3 req-a2a1bf9a-7a27-43cd-948d-71100d9b0521 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=a884b539-9c6e-40b3-87ef-28ca4a9daf7a HTTP/1.1" status: 200 len: 946 time: 0.0543096 Sep 18 08:40:52.641858 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cfd65435-a2ce-4550-8ca6-e932ae8e34d3 req-8256d933-cc9d-49fc-9345-a0108e3679a1 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0725329 Sep 18 08:40:53.100548 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-798ba329-95c4-46d3-b41b-95633e27e0ee req-d3729917-307a-4f8d-a766-098f12e410d3 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 210 time: 0.0254862 Sep 18 08:40:53.182603 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:53.342743 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:53.658642 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-eb0fbbee-b9ad-4ca8-872c-7d5309758f17 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:53.660329 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-eb0fbbee-b9ad-4ca8-872c-7d5309758f17 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.13 "GET /v2.0/networks?id=c81b2232-3aba-4f15-b8f1-a71826c8c1ca HTTP/1.1" status: 200 len: 808 time: 0.2239830 Sep 18 08:40:53.781495 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-0ce1e7c4-55cf-46a7-aee5-e59e9f4f8afa tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.13 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=467aba0ce03e40a6927a5c05223dd512 HTTP/1.1" status: 200 len: 379 time: 0.0899427 Sep 18 08:40:53.794367 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-e571a34f-7ce4-432a-a567-5baed2fab0b1 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Request body: {'port': {'device_id': 'b6c407a6-4b6a-4479-911e-1c4620f28924', 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca', 'admin_state_up': True, 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'security_groups': ['4468335f-9dd9-4e13-b58c-f44e8d1615f2']}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:40:53.818569 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42cfeb23-1082-4434-b8c1-315a7f9ef653 req-56776b52-f530-4c8c-8b8e-24d37ffd167a tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:53.820591 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-42cfeb23-1082-4434-b8c1-315a7f9ef653 req-56776b52-f530-4c8c-8b8e-24d37ffd167a tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=a884b539-9c6e-40b3-87ef-28ca4a9daf7a HTTP/1.1" status: 200 len: 946 time: 0.0952041 Sep 18 08:40:53.911761 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-42cfeb23-1082-4434-b8c1-315a7f9ef653 req-45a255c2-5ad0-4095-ba35-beab189a0e2b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0806389 Sep 18 08:40:53.950187 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-e571a34f-7ce4-432a-a567-5baed2fab0b1 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Made reservation on behalf of 467aba0ce03e40a6927a5c05223dd512 for: {'port': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:40:53.953721 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-e571a34f-7ce4-432a-a567-5baed2fab0b1 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:54.096466 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_common [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-e571a34f-7ce4-432a-a567-5baed2fab0b1 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Allocated IP 172.20.0.9 (c81b2232-3aba-4f15-b8f1-a71826c8c1ca/58e9d53a-333d-4a2f-a575-92c9de3fb737/2f2f886e-b6d3-4d02-92de-a193d7d276f7) {{(pid=94347) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:40:54.262942 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e2c92f80-b047-48da-a514-3aa4e4c061b0 req-7c0f9f50-f457-486c-bbb6-6ca8896ad561 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 210 time: 0.0697095 Sep 18 08:40:54.323765 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-e571a34f-7ce4-432a-a567-5baed2fab0b1 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for port, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:54.366212 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-e571a34f-7ce4-432a-a567-5baed2fab0b1 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:54.417183 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-e571a34f-7ce4-432a-a567-5baed2fab0b1 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Network c81b2232-3aba-4f15-b8f1-a71826c8c1ca is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:40:54.420388 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-e571a34f-7ce4-432a-a567-5baed2fab0b1 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:40:54.437474 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-e571a34f-7ce4-432a-a567-5baed2fab0b1 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Received port after_create {{(pid=94347) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:40:54.451558 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e571a34f-7ce4-432a-a567-5baed2fab0b1 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Pushing event updated for resources: {'Port': ['ID=2f2f886e-b6d3-4d02-92de-a193d7d276f7,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:54.489919 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-e571a34f-7ce4-432a-a567-5baed2fab0b1 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:54.490770 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-e571a34f-7ce4-432a-a567-5baed2fab0b1 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:54.508197 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-e571a34f-7ce4-432a-a567-5baed2fab0b1 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7182350 Sep 18 08:40:54.530916 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-1cd74f51-3ddb-40e7-b6a4-2814ce3f0499 service neutron] Request body: {'port': {'device_id': 'b6c407a6-4b6a-4479-911e-1c4620f28924', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80447'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:40:54.597175 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-1cd74f51-3ddb-40e7-b6a4-2814ce3f0499 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:54.725438 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 59792) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:54.816727 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-f85fbbf0-fd81-44fd-b2fe-23cae254041c None None] Provisioning complete for port 2f2f886e-b6d3-4d02-92de-a193d7d276f7 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:40:54.817837 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-f85fbbf0-fd81-44fd-b2fe-23cae254041c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:54.864465 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-f85fbbf0-fd81-44fd-b2fe-23cae254041c None None] Port 2f2f886e-b6d3-4d02-92de-a193d7d276f7 cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:40:54.892673 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:54.941365 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f47ec0e8-ed41-4352-813c-eee43114a336 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:55.012671 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-1cd74f51-3ddb-40e7-b6a4-2814ce3f0499 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2f2f886e-b6d3-4d02-92de-a193d7d276f7 {{(pid=94347) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:40:55.024932 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-1cd74f51-3ddb-40e7-b6a4-2814ce3f0499 service neutron] Notify callbacks [] for port, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:55.040301 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.provisioning_blocks [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-1cd74f51-3ddb-40e7-b6a4-2814ce3f0499 service neutron] Transition to ACTIVE for port object 2f2f886e-b6d3-4d02-92de-a193d7d276f7 will not be triggered until provisioned by entity L2. {{(pid=94347) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 18 08:40:55.044549 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-1cd74f51-3ddb-40e7-b6a4-2814ce3f0499 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:55.073531 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f47ec0e8-ed41-4352-813c-eee43114a336 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:55.081735 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f47ec0e8-ed41-4352-813c-eee43114a336 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:55.119253 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cd74f51-3ddb-40e7-b6a4-2814ce3f0499 service neutron] Pushing event updated for resources: {'Port': ['ID=2f2f886e-b6d3-4d02-92de-a193d7d276f7,revision_number=2']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:55.140792 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f47ec0e8-ed41-4352-813c-eee43114a336 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=af4fc266-b703-4bbf-90ad-c6a968661c49,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:55.156881 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 59800) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:55.157498 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-f47ec0e8-ed41-4352-813c-eee43114a336 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=628da830912e45e9a98943b50ab43727&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4309812 Sep 18 08:40:55.233263 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-5c676d9e-a122-4db7-b9ac-e9823a982dd8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:55.249030 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-1cd74f51-3ddb-40e7-b6a4-2814ce3f0499 service neutron] Attempting to bind port 2f2f886e-b6d3-4d02-92de-a193d7d276f7 on host hv-cinder-80447 for vnic_type normal with profile {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:40:55.249403 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-1cd74f51-3ddb-40e7-b6a4-2814ce3f0499 service neutron] Attempting to bind port 2f2f886e-b6d3-4d02-92de-a193d7d276f7 by drivers openvswitch,hyperv on host hv-cinder-80447 at level 0 using segments [{'id': '6dfc82da-1689-40bb-a749-6245f29bfd89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 244, 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca'}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:40:55.249742 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-1cd74f51-3ddb-40e7-b6a4-2814ce3f0499 service neutron] Attempting to bind port 2f2f886e-b6d3-4d02-92de-a193d7d276f7 on network c81b2232-3aba-4f15-b8f1-a71826c8c1ca {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:40:55.553500 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-5c676d9e-a122-4db7-b9ac-e9823a982dd8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:55.566915 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-1cd74f51-3ddb-40e7-b6a4-2814ce3f0499 service neutron] Port 2f2f886e-b6d3-4d02-92de-a193d7d276f7 on network c81b2232-3aba-4f15-b8f1-a71826c8c1ca not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80447 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 18 08:40:55.567245 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-1cd74f51-3ddb-40e7-b6a4-2814ce3f0499 service neutron] Attempting to bind port 2f2f886e-b6d3-4d02-92de-a193d7d276f7 on network c81b2232-3aba-4f15-b8f1-a71826c8c1ca {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:40:55.582922 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-1cd74f51-3ddb-40e7-b6a4-2814ce3f0499 service neutron] Checking agent: {'id': '8d51fdc4-974b-4200-9c3f-5dddea60a869', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80447', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'started_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 40, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:40:55.583264 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-1cd74f51-3ddb-40e7-b6a4-2814ce3f0499 service neutron] Checking segment: {'id': '6dfc82da-1689-40bb-a749-6245f29bfd89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 244, 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94347) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:40:55.583649 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-1cd74f51-3ddb-40e7-b6a4-2814ce3f0499 service neutron] Bound using segment: {'id': '6dfc82da-1689-40bb-a749-6245f29bfd89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 244, 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca'} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:40:55.584084 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-1cd74f51-3ddb-40e7-b6a4-2814ce3f0499 service neutron] Bound port: 2f2f886e-b6d3-4d02-92de-a193d7d276f7, host: hv-cinder-80447, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '6dfc82da-1689-40bb-a749-6245f29bfd89', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 244, 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca'}}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:40:55.584431 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-1cd74f51-3ddb-40e7-b6a4-2814ce3f0499 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:55.631730 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2e90914-76bd-4c5e-a593-a4d633b2b983 req-b5f02dda-da0e-4ef8-a57b-42cd192b9828 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:55.633384 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d2e90914-76bd-4c5e-a593-a4d633b2b983 req-b5f02dda-da0e-4ef8-a57b-42cd192b9828 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 943 time: 0.0960104 Sep 18 08:40:55.696041 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-5c676d9e-a122-4db7-b9ac-e9823a982dd8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:55.698558 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-5c676d9e-a122-4db7-b9ac-e9823a982dd8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:55.699705 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-5c676d9e-a122-4db7-b9ac-e9823a982dd8 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/af4fc266-b703-4bbf-90ad-c6a968661c49 HTTP/1.1" status: 204 len: 168 time: 0.5416574 Sep 18 08:40:55.723615 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c676d9e-a122-4db7-b9ac-e9823a982dd8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=af4fc266-b703-4bbf-90ad-c6a968661c49,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:55.729943 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d2e90914-76bd-4c5e-a593-a4d633b2b983 req-c6104868-7c8e-4263-90cb-ad6b97bf835c tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0784261 Sep 18 08:40:55.730811 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-1cd74f51-3ddb-40e7-b6a4-2814ce3f0499 service neutron] For port 2f2f886e-b6d3-4d02-92de-a193d7d276f7, host hv-cinder-80447, cleared binding levels {{(pid=94347) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:40:55.764233 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-1cd74f51-3ddb-40e7-b6a4-2814ce3f0499 service neutron] For port 2f2f886e-b6d3-4d02-92de-a193d7d276f7, host hv-cinder-80447, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=2f2f886e-b6d3-4d02-92de-a193d7d276f7,segment=NetworkSegment(6dfc82da-1689-40bb-a749-6245f29bfd89),segment_id=6dfc82da-1689-40bb-a749-6245f29bfd89)] {{(pid=94347) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:40:55.770887 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-1cd74f51-3ddb-40e7-b6a4-2814ce3f0499 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:55.813084 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-1cd74f51-3ddb-40e7-b6a4-2814ce3f0499 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:55.813867 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-1cd74f51-3ddb-40e7-b6a4-2814ce3f0499 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:55.815127 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-1cd74f51-3ddb-40e7-b6a4-2814ce3f0499 service neutron] 10.222.0.13 "PUT /v2.0/ports/2f2f886e-b6d3-4d02-92de-a193d7d276f7 HTTP/1.1" status: 200 len: 1093 time: 1.2912524 Sep 18 08:40:55.815570 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b6c407a6-4b6a-4479-911e-1c4620f28924', 'tag': '2f2f886e-b6d3-4d02-92de-a193d7d276f7'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:40:55.817870 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6a95458b-6505-445f-b464-8be464c68ebc" -d '{"events": [{"name": "network-changed", "server_uuid": "b6c407a6-4b6a-4479-911e-1c4620f28924", "tag": "2f2f886e-b6d3-4d02-92de-a193d7d276f7"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:40:55.842944 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cd74f51-3ddb-40e7-b6a4-2814ce3f0499 service neutron] Pushing event updated for resources: {'Port': ['ID=2f2f886e-b6d3-4d02-92de-a193d7d276f7,revision_number=3']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:55.890995 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:40:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1a4c6d54-5346-4ffb-b07b-949f1b059ec8 x-openstack-request-id: req-1a4c6d54-5346-4ffb-b07b-949f1b059ec8 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:40:55.891448 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b6c407a6-4b6a-4479-911e-1c4620f28924", "tag": "2f2f886e-b6d3-4d02-92de-a193d7d276f7", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:40:55.891820 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-1a4c6d54-5346-4ffb-b07b-949f1b059ec8 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:40:55.892409 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b6c407a6-4b6a-4479-911e-1c4620f28924', 'tag': '2f2f886e-b6d3-4d02-92de-a193d7d276f7', 'status': 'completed', 'code': 200} Sep 18 08:40:55.973854 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-23030887-41e1-405e-8f52-c430968c0e2e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:55.975450 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-23030887-41e1-405e-8f52-c430968c0e2e service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=467aba0ce03e40a6927a5c05223dd512&device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 1096 time: 0.0636511 Sep 18 08:40:56.034324 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-1e5acf65-91a4-4537-af38-16d01d4f5201 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=2f2f886e-b6d3-4d02-92de-a193d7d276f7 HTTP/1.1" status: 200 len: 217 time: 0.0390940 Sep 18 08:40:56.072479 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 59846) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:56.085193 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ed39511c-7d24-47e9-8d16-800bd3972156 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:56.086902 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-50fbe720-7bc9-4dcc-a87b-702fc5805850 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:56.088371 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-50fbe720-7bc9-4dcc-a87b-702fc5805850 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=58e9d53a-333d-4a2f-a575-92c9de3fb737 HTTP/1.1" status: 200 len: 847 time: 0.0451820 Sep 18 08:40:56.134452 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-f345003a-6f7f-4317-bffc-daa1b7220f61 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:56.135969 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-f345003a-6f7f-4317-bffc-daa1b7220f61 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=c81b2232-3aba-4f15-b8f1-a71826c8c1ca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0404088 Sep 18 08:40:56.179838 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ed39511c-7d24-47e9-8d16-800bd3972156 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:56.184041 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ed39511c-7d24-47e9-8d16-800bd3972156 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:56.219599 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed39511c-7d24-47e9-8d16-800bd3972156 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=27a5e6e4-b40f-4b8b-8d75-5b10960e4414,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:56.226568 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-ed39511c-7d24-47e9-8d16-800bd3972156 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=12d18ed71b5b443faf4cb4ef27445e6b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1502287 Sep 18 08:40:56.226905 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 59848) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:56.236099 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-a3446625-05cf-4378-9e34-5ea9d805b5db service neutron] 10.222.0.13 "GET /v2.0/networks/c81b2232-3aba-4f15-b8f1-a71826c8c1ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0923805 Sep 18 08:40:56.274700 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0db38312-bd26-4df6-87a5-1f6e42932339 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:56.295311 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0db38312-bd26-4df6-87a5-1f6e42932339 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:56.324493 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ee30578d-5e84-450a-ac1d-26ad1aa933ab req-8267056a-a2e3-4764-b87e-895babfc78f0 service neutron] 10.222.0.13 "GET /v2.0/networks/c81b2232-3aba-4f15-b8f1-a71826c8c1ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0811720 Sep 18 08:40:56.341842 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0db38312-bd26-4df6-87a5-1f6e42932339 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:56.344566 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0db38312-bd26-4df6-87a5-1f6e42932339 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:56.348113 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-0db38312-bd26-4df6-87a5-1f6e42932339 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/27a5e6e4-b40f-4b8b-8d75-5b10960e4414 HTTP/1.1" status: 204 len: 168 time: 0.1181788 Sep 18 08:40:56.354819 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0db38312-bd26-4df6-87a5-1f6e42932339 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=27a5e6e4-b40f-4b8b-8d75-5b10960e4414,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:56.449669 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a95458b-6505-445f-b464-8be464c68ebc req-648f7237-3f51-4b54-b139-28c8cee128c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:56.451154 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6a95458b-6505-445f-b464-8be464c68ebc req-648f7237-3f51-4b54-b139-28c8cee128c7 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=467aba0ce03e40a6927a5c05223dd512&device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 1096 time: 0.0399613 Sep 18 08:40:56.558304 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a95458b-6505-445f-b464-8be464c68ebc req-7e2fe18d-a3b6-42f6-8a6d-dd15b68c1ca0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:56.558304 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6a95458b-6505-445f-b464-8be464c68ebc req-7e2fe18d-a3b6-42f6-8a6d-dd15b68c1ca0 service neutron] 10.222.0.13 "GET /v2.0/networks?id=c81b2232-3aba-4f15-b8f1-a71826c8c1ca HTTP/1.1" status: 200 len: 909 time: 0.0947545 Sep 18 08:40:56.595815 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6a95458b-6505-445f-b464-8be464c68ebc req-e589afed-2c64-4a61-841d-6c310eac59ff service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=2f2f886e-b6d3-4d02-92de-a193d7d276f7 HTTP/1.1" status: 200 len: 217 time: 0.0340776 Sep 18 08:40:56.649748 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a95458b-6505-445f-b464-8be464c68ebc req-d9f98d32-98b8-4cbb-b117-d432dd7f9511 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:56.651266 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6a95458b-6505-445f-b464-8be464c68ebc req-d9f98d32-98b8-4cbb-b117-d432dd7f9511 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=58e9d53a-333d-4a2f-a575-92c9de3fb737 HTTP/1.1" status: 200 len: 847 time: 0.0474765 Sep 18 08:40:56.700024 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a95458b-6505-445f-b464-8be464c68ebc req-4c37a745-8856-4c9f-9673-26b35d6506f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:56.701677 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6a95458b-6505-445f-b464-8be464c68ebc req-4c37a745-8856-4c9f-9673-26b35d6506f3 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=c81b2232-3aba-4f15-b8f1-a71826c8c1ca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0427382 Sep 18 08:40:56.808817 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6a95458b-6505-445f-b464-8be464c68ebc req-49efc579-2fa2-490f-ae65-5d410f0227d7 service neutron] 10.222.0.13 "GET /v2.0/networks/c81b2232-3aba-4f15-b8f1-a71826c8c1ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0981207 Sep 18 08:40:56.918123 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dc295cd-4e02-461e-818b-c1694850f930 req-c8c94942-98bf-4f21-98d1-20646a940061 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:56.919931 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6dc295cd-4e02-461e-818b-c1694850f930 req-c8c94942-98bf-4f21-98d1-20646a940061 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 943 time: 0.1059256 Sep 18 08:40:56.959064 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6a95458b-6505-445f-b464-8be464c68ebc req-151c0653-c9b2-4d34-8969-3bafa69ce658 service neutron] 10.222.0.13 "GET /v2.0/networks/c81b2232-3aba-4f15-b8f1-a71826c8c1ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1348081 Sep 18 08:40:56.977517 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6dc295cd-4e02-461e-818b-c1694850f930 req-4e292d9c-5c64-4e84-8b88-6f66cb514e43 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0517008 Sep 18 08:40:58.090670 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ea6ad2d-9b6d-432c-b590-7f4279abb348 req-83b74d12-69db-49a3-a173-7a157740bce6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:58.092158 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5ea6ad2d-9b6d-432c-b590-7f4279abb348 req-83b74d12-69db-49a3-a173-7a157740bce6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 943 time: 0.0478046 Sep 18 08:40:58.097368 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 59958) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:58.130458 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5ea6ad2d-9b6d-432c-b590-7f4279abb348 req-7ffd4b35-fedd-45ac-a5d2-c67a471337da tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0319884 Sep 18 08:40:58.200450 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8b85e25b-5142-42b4-8478-e2b785b1424b admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:58.292686 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8b85e25b-5142-42b4-8478-e2b785b1424b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:58.296423 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-8b85e25b-5142-42b4-8478-e2b785b1424b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:58.333747 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-8b85e25b-5142-42b4-8478-e2b785b1424b admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=b9f02b545b3e471381ff8a118c9456e0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2353635 Sep 18 08:40:58.334824 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b85e25b-5142-42b4-8478-e2b785b1424b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1e23a599-516f-4d47-b55b-7d5a4ecd7aa9,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:58.336432 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 59964) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:58.386982 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8edbd462-fbc2-4cff-98f9-2f95f73f1dd2 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:58.407002 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8edbd462-fbc2-4cff-98f9-2f95f73f1dd2 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:58.455296 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8edbd462-fbc2-4cff-98f9-2f95f73f1dd2 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:58.458273 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8edbd462-fbc2-4cff-98f9-2f95f73f1dd2 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:58.459634 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-8edbd462-fbc2-4cff-98f9-2f95f73f1dd2 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/1e23a599-516f-4d47-b55b-7d5a4ecd7aa9 HTTP/1.1" status: 204 len: 168 time: 0.1220760 Sep 18 08:40:58.467646 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8edbd462-fbc2-4cff-98f9-2f95f73f1dd2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1e23a599-516f-4d47-b55b-7d5a4ecd7aa9,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:58.704260 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 59980) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:58.747945 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 59982) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:58.766916 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a9d52c58-a8ec-4164-a8a3-348915c35f91 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:58.776304 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_v2 [None req-12eb4f2a-e09a-4120-a0fc-c4450e0be199 admin admin] Deleting subnet 10680649-3557-49d0-9377-0d9cdb4efe69 {{(pid=94347) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 18 08:40:58.781417 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-12eb4f2a-e09a-4120-a0fc-c4450e0be199 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:58.826446 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-12eb4f2a-e09a-4120-a0fc-c4450e0be199 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-13659316'] for subnet, precommit_delete_associations {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:58.883510 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-12eb4f2a-e09a-4120-a0fc-c4450e0be199 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1821528'] for subnet, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:58.965682 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a9d52c58-a8ec-4164-a8a3-348915c35f91 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:58.969787 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a9d52c58-a8ec-4164-a8a3-348915c35f91 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:58.981131 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-12eb4f2a-e09a-4120-a0fc-c4450e0be199 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1821519', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15069100', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-13996283'] for subnet, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:59.032084 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12eb4f2a-e09a-4120-a0fc-c4450e0be199 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=10680649-3557-49d0-9377-0d9cdb4efe69,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:59.035111 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-12eb4f2a-e09a-4120-a0fc-c4450e0be199 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for subnet, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:59.037004 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-12eb4f2a-e09a-4120-a0fc-c4450e0be199 admin admin] 10.222.0.35 "DELETE /v2.0/subnets/10680649-3557-49d0-9377-0d9cdb4efe69 HTTP/1.1" status: 204 len: 168 time: 0.3317363 Sep 18 08:40:59.040364 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 59986) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:59.040596 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-a9d52c58-a8ec-4164-a8a3-348915c35f91 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=f3c38f7cbc5d4a9b8237c90844f61741&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2915428 Sep 18 08:40:59.041399 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9d52c58-a8ec-4164-a8a3-348915c35f91 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0814f5d4-8fe8-458a-9695-d135ae51ce24,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:59.043585 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 59988) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:59.092216 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-4f5de079-c244-470b-8308-f27494a594b8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:59.108006 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-64e16856-d240-4792-8f93-6459a393e9c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1861545'] for network, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:59.113478 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-4f5de079-c244-470b-8308-f27494a594b8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:59.165751 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-4f5de079-c244-470b-8308-f27494a594b8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:59.168686 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-4f5de079-c244-470b-8308-f27494a594b8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:59.169931 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-4f5de079-c244-470b-8308-f27494a594b8 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/0814f5d4-8fe8-458a-9695-d135ae51ce24 HTTP/1.1" status: 204 len: 168 time: 0.1254306 Sep 18 08:40:59.181876 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f5de079-c244-470b-8308-f27494a594b8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0814f5d4-8fe8-458a-9695-d135ae51ce24,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:59.271661 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d74b7ef7-0da0-472c-8c64-87eb87acae40 req-3d3efe03-8119-4ffb-8c52-c19bfa3ad45e tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:40:59.273821 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d74b7ef7-0da0-472c-8c64-87eb87acae40 req-3d3efe03-8119-4ffb-8c52-c19bfa3ad45e tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 943 time: 0.0567861 Sep 18 08:40:59.319314 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d74b7ef7-0da0-472c-8c64-87eb87acae40 req-d1562228-e208-47e8-958f-a05d980536b1 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0380559 Sep 18 08:40:59.381587 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-64e16856-d240-4792-8f93-6459a393e9c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1806559', 'neutron.services.segments.db._delete_segments_for_network-8732885752733'] for network, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:59.401352 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-64e16856-d240-4792-8f93-6459a393e9c8 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5e2d06a6-7f04-4134-8004-d5639986c75e']}} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:40:59.410320 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-64e16856-d240-4792-8f93-6459a393e9c8 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4f8dffb0-f8d4-41b5-beed-53bcf370cb42') {'for_net_delete': True} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:40:59.410614 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-64e16856-d240-4792-8f93-6459a393e9c8 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4f8dffb0-f8d4-41b5-beed-53bcf370cb42') {} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:40:59.419605 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-64e16856-d240-4792-8f93-6459a393e9c8 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732885753254', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14122733'] for segment, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:59.432340 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-64e16856-d240-4792-8f93-6459a393e9c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:59.438123 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-64e16856-d240-4792-8f93-6459a393e9c8 admin admin] Releasing vlan 213 on physical network physnet1 to pool {{(pid=94346) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 18 08:40:59.438507 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-64e16856-d240-4792-8f93-6459a393e9c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14289667'] for segment, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: Traceback (most recent call last): Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: timer() Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: cb(*args, **kw) Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: return func(*args, **kwargs) Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: self._notify() Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: self.callback(batched_events) Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: event.method(event) Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: aggregate_uuid = self.p_client.list_aggregates( Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: return f(self, *a, **k) Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: return self._get(url).json() Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: return self.request(url, 'GET', **kwargs) Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: base_url = self.get_endpoint(auth, allow=allow, Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 18 08:40:59.440288 dv-cinder-804470-6-iscsi neutron-server[94346]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 18 08:40:59.497114 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-64e16856-d240-4792-8f93-6459a393e9c8 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1806534', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-784926'] for network, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:59.502312 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-64e16856-d240-4792-8f93-6459a393e9c8 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:59.504134 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-64e16856-d240-4792-8f93-6459a393e9c8 admin admin] 10.222.0.35 "DELETE /v2.0/networks/5e2d06a6-7f04-4134-8004-d5639986c75e HTTP/1.1" status: 204 len: 168 time: 0.4626868 Sep 18 08:40:59.515114 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64e16856-d240-4792-8f93-6459a393e9c8 admin admin] Pushing event deleted for resources: {'Network': ['ID=5e2d06a6-7f04-4134-8004-d5639986c75e,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:40:59.622617 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 60008) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:59.662133 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-873e8f02-1ebc-4c0d-8888-c04feb9eca9d admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=fb9519a4056a4e2ebbe5200ff83d0a1e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0383539 Sep 18 08:40:59.664592 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 60010) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:40:59.712848 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ff775d87-8f6c-4cd4-bbc7-9a6b8c29f1af admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:59.735458 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ff775d87-8f6c-4cd4-bbc7-9a6b8c29f1af admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:59.787881 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ff775d87-8f6c-4cd4-bbc7-9a6b8c29f1af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:59.790766 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ff775d87-8f6c-4cd4-bbc7-9a6b8c29f1af admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:40:59.794249 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-ff775d87-8f6c-4cd4-bbc7-9a6b8c29f1af admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/23af377c-f928-4574-b242-a5ed197d2bf9 HTTP/1.1" status: 204 len: 168 time: 0.1264582 Sep 18 08:40:59.807010 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff775d87-8f6c-4cd4-bbc7-9a6b8c29f1af admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=23af377c-f928-4574-b242-a5ed197d2bf9,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:00.444680 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b3fe29c-06ba-4c17-a935-6982e1cac607 req-56bd955d-31ff-4f30-aca0-0a65048d7ba0 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:00.446360 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4b3fe29c-06ba-4c17-a935-6982e1cac607 req-56bd955d-31ff-4f30-aca0-0a65048d7ba0 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 943 time: 0.0502198 Sep 18 08:41:00.478135 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 60060) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:41:00.491469 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4b3fe29c-06ba-4c17-a935-6982e1cac607 req-31c87e49-4ce5-48e7-b952-13afc9f0648b tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0385826 Sep 18 08:41:00.587795 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0600d10f-9e28-4523-ad1e-d804048f8b8b admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:00.677699 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0600d10f-9e28-4523-ad1e-d804048f8b8b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:00.681405 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0600d10f-9e28-4523-ad1e-d804048f8b8b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:00.718259 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-0600d10f-9e28-4523-ad1e-d804048f8b8b admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=f5bb4c93c9fb45bea8653df802033fce&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2390175 Sep 18 08:41:00.719450 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0600d10f-9e28-4523-ad1e-d804048f8b8b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bb011a08-57cf-49fe-8d81-5ca45736302d,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:00.721290 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 60066) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:41:00.773671 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8c440e55-291c-4d2c-af83-35d607384c09 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:00.797108 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8c440e55-291c-4d2c-af83-35d607384c09 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:00.849817 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8c440e55-291c-4d2c-af83-35d607384c09 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:00.852544 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8c440e55-291c-4d2c-af83-35d607384c09 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:00.855894 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-8c440e55-291c-4d2c-af83-35d607384c09 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/bb011a08-57cf-49fe-8d81-5ca45736302d HTTP/1.1" status: 204 len: 168 time: 0.1312866 Sep 18 08:41:00.862879 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c440e55-291c-4d2c-af83-35d607384c09 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bb011a08-57cf-49fe-8d81-5ca45736302d,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:01.604053 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3faf3e62-64be-4be3-877a-86c235844c55 req-9d756c22-b0bc-4936-8617-d2416b700d63 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:01.605627 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3faf3e62-64be-4be3-877a-86c235844c55 req-9d756c22-b0bc-4936-8617-d2416b700d63 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 943 time: 0.0476975 Sep 18 08:41:01.645475 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3faf3e62-64be-4be3-877a-86c235844c55 req-5ad0db5c-b1c2-4030-8f8a-e7047b306c1d tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0338805 Sep 18 08:41:02.758516 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f9f5cac-9b38-4919-baa2-500470c77e41 req-c015dd23-c90f-43ec-9366-86ff7c0d001d tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:02.759972 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3f9f5cac-9b38-4919-baa2-500470c77e41 req-c015dd23-c90f-43ec-9366-86ff7c0d001d tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 943 time: 0.0498066 Sep 18 08:41:02.795949 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3f9f5cac-9b38-4919-baa2-500470c77e41 req-7cea835a-9650-4512-bcff-2122485358e6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0300629 Sep 18 08:41:03.908789 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0440759f-38d1-46c1-a677-7013d472a61e req-5d333a54-2423-46cc-b9ca-cd1afe3d87cf tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:03.910347 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0440759f-38d1-46c1-a677-7013d472a61e req-5d333a54-2423-46cc-b9ca-cd1afe3d87cf tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 943 time: 0.0474942 Sep 18 08:41:03.952669 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0440759f-38d1-46c1-a677-7013d472a61e req-3aada449-5011-44c6-a96c-0210490f8dbe tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0354972 Sep 18 08:41:05.068221 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0006c6c0-10d2-4952-8cc6-d6a45b3e9df9 req-0e572c90-455e-4f87-89d2-310696de36b8 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:05.069788 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0006c6c0-10d2-4952-8cc6-d6a45b3e9df9 req-0e572c90-455e-4f87-89d2-310696de36b8 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 943 time: 0.0478752 Sep 18 08:41:05.108105 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0006c6c0-10d2-4952-8cc6-d6a45b3e9df9 req-bd230e3d-189d-4d25-ac2d-b0cdd187dfc6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0317407 Sep 18 08:41:05.508678 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50e6caa1-3f7f-4f87-b261-478bb444ea61 req-5aa5f42f-863c-4340-afe4-f4772fddd07b tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:05.510166 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-50e6caa1-3f7f-4f87-b261-478bb444ea61 req-5aa5f42f-863c-4340-afe4-f4772fddd07b tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0900211 Sep 18 08:41:05.516413 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7d551bb-0a88-4399-ac1c-3aeafe8b8019 req-6b8418a6-8006-4b40-8f3a-160d03a213f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:05.517909 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b7d551bb-0a88-4399-ac1c-3aeafe8b8019 req-6b8418a6-8006-4b40-8f3a-160d03a213f4 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=f439efa4eed0456ab2a914377e490fad&device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 1098 time: 0.0582590 Sep 18 08:41:05.567318 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-50e6caa1-3f7f-4f87-b261-478bb444ea61 req-e758756a-e9a1-48d1-b108-73180dcbae43 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0484626 Sep 18 08:41:05.668396 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7d551bb-0a88-4399-ac1c-3aeafe8b8019 req-6165648a-0d79-44f0-972e-8c145b084f9a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:05.670022 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b7d551bb-0a88-4399-ac1c-3aeafe8b8019 req-6165648a-0d79-44f0-972e-8c145b084f9a service neutron] 10.222.0.13 "GET /v2.0/networks?id=fdcbc66e-323e-4b44-be97-566949f4f2ef HTTP/1.1" status: 200 len: 919 time: 0.1318493 Sep 18 08:41:05.744507 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b7d551bb-0a88-4399-ac1c-3aeafe8b8019 req-60e19212-a339-42d5-9b0c-b58d9b10d1d9 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b03411eb-66ff-4691-88c8-2c570d78c323 HTTP/1.1" status: 200 len: 217 time: 0.0372624 Sep 18 08:41:05.829149 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7d551bb-0a88-4399-ac1c-3aeafe8b8019 req-eab757a5-41e5-4db5-92c4-12feefcfdf0b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:05.830612 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b7d551bb-0a88-4399-ac1c-3aeafe8b8019 req-eab757a5-41e5-4db5-92c4-12feefcfdf0b service neutron] 10.222.0.13 "GET /v2.0/subnets?id=e5dc6eef-e778-41a2-a708-c7810ade97db HTTP/1.1" status: 200 len: 858 time: 0.0447674 Sep 18 08:41:05.863114 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b7d551bb-0a88-4399-ac1c-3aeafe8b8019 req-fa0667c8-aad9-4921-9c8a-5d99d8b54fa9 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fdcbc66e-323e-4b44-be97-566949f4f2ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0236528 Sep 18 08:41:05.962150 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b7d551bb-0a88-4399-ac1c-3aeafe8b8019 req-012e66c6-464f-4cb6-bf5d-4bd40f8548b9 service neutron] 10.222.0.13 "GET /v2.0/networks/fdcbc66e-323e-4b44-be97-566949f4f2ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0910287 Sep 18 08:41:06.059143 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b7d551bb-0a88-4399-ac1c-3aeafe8b8019 req-93e9e27c-70fc-4518-a5a3-4594032de740 service neutron] 10.222.0.13 "GET /v2.0/networks/fdcbc66e-323e-4b44-be97-566949f4f2ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0887847 Sep 18 08:41:06.220046 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c4c1b11-f917-433e-94a9-2f49e13ada3c req-ba63534f-308f-4fde-94fd-9278860ff17e tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:06.221581 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9c4c1b11-f917-433e-94a9-2f49e13ada3c req-ba63534f-308f-4fde-94fd-9278860ff17e tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 943 time: 0.0478504 Sep 18 08:41:06.259375 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9c4c1b11-f917-433e-94a9-2f49e13ada3c req-e0c6caf1-4b0f-4e47-99c4-898f138b350b tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0319700 Sep 18 08:41:06.687573 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45d0be91-7c58-45e5-8b5b-6d17954ec6ff req-0af6a968-e526-4f8f-a07c-b3a22b98f903 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:06.689182 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-45d0be91-7c58-45e5-8b5b-6d17954ec6ff req-0af6a968-e526-4f8f-a07c-b3a22b98f903 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0496738 Sep 18 08:41:06.729005 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-45d0be91-7c58-45e5-8b5b-6d17954ec6ff req-3840202f-219c-4399-85d9-3179c2b1ad83 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0336308 Sep 18 08:41:06.737359 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 60276) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:41:06.850972 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ea33d264-e208-4a23-b94f-7959ac1d6fb4 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:06.950612 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ea33d264-e208-4a23-b94f-7959ac1d6fb4 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:06.954610 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ea33d264-e208-4a23-b94f-7959ac1d6fb4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:06.964575 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 60284) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:41:07.012485 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-ea33d264-e208-4a23-b94f-7959ac1d6fb4 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=07de472a3e8b4800b3dc345e2437d8b4&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2736921 Sep 18 08:41:07.013577 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea33d264-e208-4a23-b94f-7959ac1d6fb4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6a6928ac-8564-43ce-a4aa-aee6fcfd03c5,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:07.015122 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 60288) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:41:07.062981 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7dad0d5a-afe5-4873-86c5-282e7e6cbf81 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:07.089347 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-61208a55-5f32-444e-b54e-360a4d784c99 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:07.104584 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7dad0d5a-afe5-4873-86c5-282e7e6cbf81 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:07.181201 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7dad0d5a-afe5-4873-86c5-282e7e6cbf81 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:07.183587 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7dad0d5a-afe5-4873-86c5-282e7e6cbf81 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:07.184714 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-7dad0d5a-afe5-4873-86c5-282e7e6cbf81 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/6a6928ac-8564-43ce-a4aa-aee6fcfd03c5 HTTP/1.1" status: 204 len: 168 time: 0.1686480 Sep 18 08:41:07.197133 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dad0d5a-afe5-4873-86c5-282e7e6cbf81 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6a6928ac-8564-43ce-a4aa-aee6fcfd03c5,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:07.233093 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-61208a55-5f32-444e-b54e-360a4d784c99 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:07.237021 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-61208a55-5f32-444e-b54e-360a4d784c99 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:07.274382 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61208a55-5f32-444e-b54e-360a4d784c99 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ea220a05-c689-4c03-8895-9fe4472d0c13,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:07.281416 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-61208a55-5f32-444e-b54e-360a4d784c99 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=6a95950d125a4132a2b7c65a92740572&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3156033 Sep 18 08:41:07.282092 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 60296) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:41:07.353194 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-e764cb81-921a-4654-94f2-898a75340011 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:07.377573 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-e764cb81-921a-4654-94f2-898a75340011 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:07.405840 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea83f7d2-bd4d-4655-bc62-fc9c669d5651 req-c4a34459-42a3-431d-8194-df6669b6859a tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:07.407491 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ea83f7d2-bd4d-4655-bc62-fc9c669d5651 req-c4a34459-42a3-431d-8194-df6669b6859a tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 943 time: 0.0513172 Sep 18 08:41:07.429677 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-e764cb81-921a-4654-94f2-898a75340011 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:07.433255 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-e764cb81-921a-4654-94f2-898a75340011 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:07.438033 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-e764cb81-921a-4654-94f2-898a75340011 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/ea220a05-c689-4c03-8895-9fe4472d0c13 HTTP/1.1" status: 204 len: 168 time: 0.1546559 Sep 18 08:41:07.449492 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e764cb81-921a-4654-94f2-898a75340011 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ea220a05-c689-4c03-8895-9fe4472d0c13,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:07.481371 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ea83f7d2-bd4d-4655-bc62-fc9c669d5651 req-5c99ab97-3824-4b31-bb35-6b6511e9b758 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0656137 Sep 18 08:41:07.884278 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f08e3af-aec0-48da-b643-54b181a45860 req-add9561f-63ed-40f7-a2cb-b767d2ca99e6 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:07.886062 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2f08e3af-aec0-48da-b643-54b181a45860 req-add9561f-63ed-40f7-a2cb-b767d2ca99e6 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0801415 Sep 18 08:41:07.926367 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2f08e3af-aec0-48da-b643-54b181a45860 req-b75d75f2-e4d1-41e9-be5a-2aa6489359fa tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0342968 Sep 18 08:41:08.238639 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 60374) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:41:08.338739 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-6d5ca49f-4c9c-447f-8361-e9d5b81abe28 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-2061029967-network', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:41:08.368243 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6d5ca49f-4c9c-447f-8361-e9d5b81abe28 admin admin] Made reservation on behalf of 62a8d3b5ed4d4fe085db724f264e25c4 for: {'network': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:41:08.370815 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6d5ca49f-4c9c-447f-8361-e9d5b81abe28 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for network, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:08.379647 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6d5ca49f-4c9c-447f-8361-e9d5b81abe28 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:08.473351 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6d5ca49f-4c9c-447f-8361-e9d5b81abe28 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:08.477741 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6d5ca49f-4c9c-447f-8361-e9d5b81abe28 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:08.513374 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6d5ca49f-4c9c-447f-8361-e9d5b81abe28 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 238} {{(pid=94346) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 18 08:41:08.524937 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d5ca49f-4c9c-447f-8361-e9d5b81abe28 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=207d68f0-4931-4c69-8d7d-61006b3de552,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:08.537868 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6d5ca49f-4c9c-447f-8361-e9d5b81abe28 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:08.538583 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.db.segments_db [None req-6d5ca49f-4c9c-447f-8361-e9d5b81abe28 admin admin] Added segment 5d556fd8-f02d-4c49-9c67-863cea39ec4a of type vlan for network 48bd9423-5b85-4344-9434-17e10e227731 Sep 18 08:41:08.603527 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6d5ca49f-4c9c-447f-8361-e9d5b81abe28 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732885226527'] for network, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:08.631507 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6d5ca49f-4c9c-447f-8361-e9d5b81abe28 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for network, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:08.632504 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6d5ca49f-4c9c-447f-8361-e9d5b81abe28 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:08.633734 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6d5ca49f-4c9c-447f-8361-e9d5b81abe28 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:08.641912 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-681fda88-7225-467c-9824-0ecd59729bdd req-dcd9a75f-fd15-445a-82f7-e00429c3dc8e tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:08.643515 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-681fda88-7225-467c-9824-0ecd59729bdd req-dcd9a75f-fd15-445a-82f7-e00429c3dc8e tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 943 time: 0.0533378 Sep 18 08:41:08.666732 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-6d5ca49f-4c9c-447f-8361-e9d5b81abe28 admin admin] 10.222.0.35 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.4269738 Sep 18 08:41:08.670182 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 60396) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:41:08.680429 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-28001245-845a-4157-96fc-ecd658192b43 admin admin] Request body: {'subnet': {'network_id': '48bd9423-5b85-4344-9434-17e10e227731', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-2061029967-subnet', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'ip_version': 4}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:41:08.695091 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-681fda88-7225-467c-9824-0ecd59729bdd req-5fd13e5b-3a51-4d9e-baab-a894d83ba833 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448496 Sep 18 08:41:08.701598 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d5ca49f-4c9c-447f-8361-e9d5b81abe28 admin admin] Pushing event updated for resources: {'Network': ['ID=48bd9423-5b85-4344-9434-17e10e227731,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:08.713724 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-28001245-845a-4157-96fc-ecd658192b43 admin admin] Made reservation on behalf of 62a8d3b5ed4d4fe085db724f264e25c4 for: {'subnet': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:41:08.717095 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-28001245-845a-4157-96fc-ecd658192b43 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-13996252'] for subnet, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:08.719836 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Network 48bd9423-5b85-4344-9434-17e10e227731 details requested by agent ovs-agent-dv-cinder-804470-6-iscsi with host dv-cinder-804470-6-iscsi {{(pid=94348) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 18 08:41:08.883612 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-28001245-845a-4157-96fc-ecd658192b43 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-15069167', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-13996274'] for subnet, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:08.940179 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28001245-845a-4157-96fc-ecd658192b43 admin admin] Pushing event updated for resources: {'Subnet': ['ID=95fb2797-9ac9-40f9-9ea9-56d2c5a16291,revision_number=0']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:08.944848 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-28001245-845a-4157-96fc-ecd658192b43 admin admin] Checking segment: {'id': '5d556fd8-f02d-4c49-9c67-863cea39ec4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 238, 'network_id': '48bd9423-5b85-4344-9434-17e10e227731'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94347) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:41:08.945792 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-28001245-845a-4157-96fc-ecd658192b43 admin admin] Network hostable DHCP agents. Network: 48bd9423-5b85-4344-9434-17e10e227731, hostable agents: ['6aaa6222-6d04-44a7-b807-bfc2cbd3e99f'], hosted agents: [] {{(pid=94347) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 18 08:41:08.970751 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-28001245-845a-4157-96fc-ecd658192b43 admin admin] Network 48bd9423-5b85-4344-9434-17e10e227731 is scheduled to be hosted by DHCP agent 6aaa6222-6d04-44a7-b807-bfc2cbd3e99f with binding_index 1 {{(pid=94347) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 18 08:41:08.983717 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [None req-28001245-845a-4157-96fc-ecd658192b43 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804470-6-iscsi, 48bd9423-5b85-4344-9434-17e10e227731) {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:41:08.991886 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28001245-845a-4157-96fc-ecd658192b43 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:08.992481 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-28001245-845a-4157-96fc-ecd658192b43 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for subnet, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:08.992590 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b9cbc3a4-e5a1-4db3-a54e-e2014c005475 None None] Network 48bd9423-5b85-4344-9434-17e10e227731 requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:41:09.019972 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-28001245-845a-4157-96fc-ecd658192b43 admin admin] 10.222.0.35 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.3487139 Sep 18 08:41:09.024061 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 60414) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:41:09.029892 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-31425f10-2b9c-4359-8346-54132b3068b4 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-2061029967-router', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:41:09.091692 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f340872c-f2ee-4230-956f-8dd113ea72a0 req-776886e8-d3f1-43fa-ba42-a0dfd334e666 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:09.093432 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f340872c-f2ee-4230-956f-8dd113ea72a0 req-776886e8-d3f1-43fa-ba42-a0dfd334e666 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0706882 Sep 18 08:41:09.095395 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-31425f10-2b9c-4359-8346-54132b3068b4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-784001', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2995'] for router, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:09.096648 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-31425f10-2b9c-4359-8346-54132b3068b4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-782353', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-784513', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-710924', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2984'] for router, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:09.168371 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0652c48a-a0ec-40db-b95c-7edb117364cc None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp22fa9bf9-2738-5c16-87a3-3f58ee5e2dc2-48bd9423-5b85-4344-9434-17e10e227731', 'network_id': '48bd9423-5b85-4344-9434-17e10e227731', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'fixed_ips': [{'subnet_id': '95fb2797-9ac9-40f9-9ea9-56d2c5a16291'}]}} from dv-cinder-804470-6-iscsi. {{(pid=94348) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 18 08:41:09.169273 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-0652c48a-a0ec-40db-b95c-7edb117364cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:09.175488 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-31425f10-2b9c-4359-8346-54132b3068b4 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:09.179416 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f340872c-f2ee-4230-956f-8dd113ea72a0 req-28004579-e352-4ff0-823f-4c07c8f05c24 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0737467 Sep 18 08:41:09.321888 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-31425f10-2b9c-4359-8346-54132b3068b4 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:09.332659 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.db_base_plugin_common [None req-0652c48a-a0ec-40db-b95c-7edb117364cc None None] Allocated IP 172.20.0.2 (48bd9423-5b85-4344-9434-17e10e227731/95fb2797-9ac9-40f9-9ea9-56d2c5a16291/a9c99c8c-4dde-4346-b7bd-8d87a5e9c9d3) {{(pid=94348) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:41:09.483861 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-0652c48a-a0ec-40db-b95c-7edb117364cc None None] Notify callbacks [] for port, precommit_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:09.489399 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-0652c48a-a0ec-40db-b95c-7edb117364cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528'] for port, after_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:09.530223 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-31425f10-2b9c-4359-8346-54132b3068b4 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:09.551154 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-31425f10-2b9c-4359-8346-54132b3068b4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:09.648443 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0652c48a-a0ec-40db-b95c-7edb117364cc None None] Network 48bd9423-5b85-4344-9434-17e10e227731 is already hosted by enough agents. {{(pid=94348) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:41:09.651277 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.scheduler.base_scheduler [None req-0652c48a-a0ec-40db-b95c-7edb117364cc None None] Resources bound (agent type, host, resource id): {{(pid=94348) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:41:09.654452 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0652c48a-a0ec-40db-b95c-7edb117364cc None None] Received port after_create {{(pid=94348) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:41:09.669509 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0652c48a-a0ec-40db-b95c-7edb117364cc None None] Pushing event updated for resources: {'Port': ['ID=a9c99c8c-4dde-4346-b7bd-8d87a5e9c9d3,revision_number=1']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:09.670998 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_common [None req-31425f10-2b9c-4359-8346-54132b3068b4 admin admin] Allocated IP 172.27.1.137 (2e3b3f85-63e4-4380-917a-8c90c80b3e38/cd525bb9-7f93-490c-a5d6-a08911817e54/1c451dba-c399-4ceb-a969-412896a38aec) {{(pid=94347) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:41:09.718841 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-0652c48a-a0ec-40db-b95c-7edb117364cc None None] Attempting to bind port a9c99c8c-4dde-4346-b7bd-8d87a5e9c9d3 on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:41:09.719598 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-0652c48a-a0ec-40db-b95c-7edb117364cc None None] Attempting to bind port a9c99c8c-4dde-4346-b7bd-8d87a5e9c9d3 by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': '5d556fd8-f02d-4c49-9c67-863cea39ec4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 238, 'network_id': '48bd9423-5b85-4344-9434-17e10e227731'}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:41:09.720088 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0652c48a-a0ec-40db-b95c-7edb117364cc None None] Attempting to bind port a9c99c8c-4dde-4346-b7bd-8d87a5e9c9d3 on network 48bd9423-5b85-4344-9434-17e10e227731 {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:41:09.725379 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0652c48a-a0ec-40db-b95c-7edb117364cc None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 40, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:41:09.725902 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0652c48a-a0ec-40db-b95c-7edb117364cc None None] Checking segment: {'id': '5d556fd8-f02d-4c49-9c67-863cea39ec4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 238, 'network_id': '48bd9423-5b85-4344-9434-17e10e227731'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94348) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:41:09.726640 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-0652c48a-a0ec-40db-b95c-7edb117364cc None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:09.727143 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0652c48a-a0ec-40db-b95c-7edb117364cc None None] Bound using segment: {'id': '5d556fd8-f02d-4c49-9c67-863cea39ec4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 238, 'network_id': '48bd9423-5b85-4344-9434-17e10e227731'} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:41:09.727715 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-0652c48a-a0ec-40db-b95c-7edb117364cc None None] Bound port: a9c99c8c-4dde-4346-b7bd-8d87a5e9c9d3, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5d556fd8-f02d-4c49-9c67-863cea39ec4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 238, 'network_id': '48bd9423-5b85-4344-9434-17e10e227731'}}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:41:09.728291 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-0652c48a-a0ec-40db-b95c-7edb117364cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:09.815599 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-31425f10-2b9c-4359-8346-54132b3068b4 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:09.822402 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-0652c48a-a0ec-40db-b95c-7edb117364cc None None] For port a9c99c8c-4dde-4346-b7bd-8d87a5e9c9d3, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94348) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:41:09.825953 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-0652c48a-a0ec-40db-b95c-7edb117364cc None None] For port a9c99c8c-4dde-4346-b7bd-8d87a5e9c9d3, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=a9c99c8c-4dde-4346-b7bd-8d87a5e9c9d3,segment=NetworkSegment(5d556fd8-f02d-4c49-9c67-863cea39ec4a),segment_id=5d556fd8-f02d-4c49-9c67-863cea39ec4a)] {{(pid=94348) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:41:09.830508 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-0652c48a-a0ec-40db-b95c-7edb117364cc None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:09.850176 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf6dd78d-b27d-48b0-a6c2-c05ce5ff06d9 req-e290a208-014f-4ff6-b388-cd5cc207ffc2 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:09.851720 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cf6dd78d-b27d-48b0-a6c2-c05ce5ff06d9 req-e290a208-014f-4ff6-b388-cd5cc207ffc2 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 943 time: 0.0802312 Sep 18 08:41:09.888778 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0652c48a-a0ec-40db-b95c-7edb117364cc None None] Pushing event updated for resources: {'Port': ['ID=a9c99c8c-4dde-4346-b7bd-8d87a5e9c9d3,revision_number=2']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:09.898835 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-31425f10-2b9c-4359-8346-54132b3068b4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:09.913734 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cf6dd78d-b27d-48b0-a6c2-c05ce5ff06d9 req-8265a21f-3e28-4efb-a902-d607152405b7 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0551112 Sep 18 08:41:09.950352 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31425f10-2b9c-4359-8346-54132b3068b4 admin admin] Network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:41:09.955604 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [None req-31425f10-2b9c-4359-8346-54132b3068b4 admin admin] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:41:09.958945 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31425f10-2b9c-4359-8346-54132b3068b4 admin admin] Received port after_create {{(pid=94347) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:41:09.984387 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31425f10-2b9c-4359-8346-54132b3068b4 admin admin] Pushing event updated for resources: {'Port': ['ID=1c451dba-c399-4ceb-a969-412896a38aec,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:10.487203 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-31425f10-2b9c-4359-8346-54132b3068b4 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:10.570255 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f3532da-fde7-4a44-8cbf-0f3dad9416e6 req-798660df-1559-4cce-a580-ffd0898972cd tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:10.571864 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3f3532da-fde7-4a44-8cbf-0f3dad9416e6 req-798660df-1559-4cce-a580-ffd0898972cd tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0986919 Sep 18 08:41:10.683092 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3f3532da-fde7-4a44-8cbf-0f3dad9416e6 req-c2c6f405-92ce-40b7-96cf-03e853c221f8 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0821915 Sep 18 08:41:10.708547 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:41:10.769460 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-31425f10-2b9c-4359-8346-54132b3068b4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-782366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-784982'] for router, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:10.833015 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-02d5ffe7-f607-4672-9023-11ff889bf088 None None] Network 48bd9423-5b85-4344-9434-17e10e227731 requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:41:10.897072 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-e2a58f75-3489-4b71-a50d-4bbcbc74dd3b None None] Provisioning complete for port a9c99c8c-4dde-4346-b7bd-8d87a5e9c9d3 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:10.897483 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-e2a58f75-3489-4b71-a50d-4bbcbc74dd3b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:10.898859 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-31425f10-2b9c-4359-8346-54132b3068b4 admin admin] Router 2406a855-e08c-4bcc-974c-cd88788039b3 is scheduled to L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a with binding_index 1 {{(pid=94347) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 18 08:41:11.044753 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-e2a58f75-3489-4b71-a50d-4bbcbc74dd3b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:11.049763 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-31425f10-2b9c-4359-8346-54132b3068b4 admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94347) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:41:11.061360 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] Sync routers for ids ['2406a855-e08c-4bcc-974c-cd88788039b3'] in dv-cinder-804470-6-iscsi {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:41:11.070976 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] Routers {'2406a855-e08c-4bcc-974c-cd88788039b3'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:41:11.071599 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:40:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['2406a855-e08c-4bcc-974c-cd88788039b3'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:41:11.083548 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-e2a58f75-3489-4b71-a50d-4bbcbc74dd3b None None] For port a9c99c8c-4dde-4346-b7bd-8d87a5e9c9d3, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=a9c99c8c-4dde-4346-b7bd-8d87a5e9c9d3,segment=NetworkSegment(5d556fd8-f02d-4c49-9c67-863cea39ec4a),segment_id=5d556fd8-f02d-4c49-9c67-863cea39ec4a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:41:11.089483 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-e2a58f75-3489-4b71-a50d-4bbcbc74dd3b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:11.090683 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6f3486e-7430-4d67-8912-92947880759d req-f94943f9-a0f5-4cdf-8969-827b560a7e51 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:11.099596 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c6f3486e-7430-4d67-8912-92947880759d req-f94943f9-a0f5-4cdf-8969-827b560a7e51 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 943 time: 0.0883420 Sep 18 08:41:11.106424 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-31425f10-2b9c-4359-8346-54132b3068b4 admin admin] Notify callbacks [] for router, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:11.107586 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-31425f10-2b9c-4359-8346-54132b3068b4 admin admin] 10.222.0.35 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 2.0810592 Sep 18 08:41:11.110640 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 60438) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:41:11.143361 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c6f3486e-7430-4d67-8912-92947880759d req-f15fde63-df78-4eda-b45b-598418769a4a tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428960 Sep 18 08:41:11.150356 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2a58f75-3489-4b71-a50d-4bbcbc74dd3b None None] Pushing event updated for resources: {'Port': ['ID=a9c99c8c-4dde-4346-b7bd-8d87a5e9c9d3,revision_number=3']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:11.295001 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] Set router 2406a855-e08c-4bcc-974c-cd88788039b3 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:41:11.423420 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-334b4a00-e137-4fcf-a7c9-26363b462942 None None] Provisioning complete for port a9c99c8c-4dde-4346-b7bd-8d87a5e9c9d3 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:11.424098 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-334b4a00-e137-4fcf-a7c9-26363b462942 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:11.458651 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device a9c99c8c-4dde-4346-b7bd-8d87a5e9c9d3 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:41:11.527069 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'name': 'tempest-TestMinimumBasicScenario-2061029967-router', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '1c451dba-c399-4ceb-a969-412896a38aec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:10Z', 'revision_number': 3, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'gw_port': {'id': '1c451dba-c399-4ceb-a969-412896a38aec', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:c3:fe', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 441, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:09Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:41:11.561771 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port a9c99c8c-4dde-4346-b7bd-8d87a5e9c9d3 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:11.562177 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:11.562408 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] Checking router: 2406a855-e08c-4bcc-974c-cd88788039b3 for host: dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:41:11.563006 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] Updating router 2406a855-e08c-4bcc-974c-cd88788039b3 port 1c451dba-c399-4ceb-a969-412896a38aec binding host dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 18 08:41:11.590982 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0f612d98-aef2-43f2-a66a-de1da1795b91 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:11.595236 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:11.757005 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_common [None req-0f612d98-aef2-43f2-a66a-de1da1795b91 admin admin] Allocated IP 172.20.0.1 (48bd9423-5b85-4344-9434-17e10e227731/95fb2797-9ac9-40f9-9ea9-56d2c5a16291/cda97d8d-7e99-46b1-937f-0a3ae975c076) {{(pid=94346) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:41:11.819629 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13e0eb3a-a733-4a79-bdc6-1ac9e79562d2 req-f285039a-c85b-4f06-9d6c-9ca4380fea43 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:11.825904 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-13e0eb3a-a733-4a79-bdc6-1ac9e79562d2 req-f285039a-c85b-4f06-9d6c-9ca4380fea43 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0641851 Sep 18 08:41:11.869741 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-13e0eb3a-a733-4a79-bdc6-1ac9e79562d2 req-8d437d8c-c414-419c-89cf-b0b198012d75 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421364 Sep 18 08:41:11.892420 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0f612d98-aef2-43f2-a66a-de1da1795b91 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:11.899971 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] Notify callbacks [] for port, precommit_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:11.906008 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:11.921413 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0f612d98-aef2-43f2-a66a-de1da1795b91 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:11.963514 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ddb5bbc-8c82-4d05-ade5-eaa1c76e2919 None None] Pushing event updated for resources: {'Port': ['ID=1c451dba-c399-4ceb-a969-412896a38aec,revision_number=2']} {{(pid=94349) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:11.964656 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f612d98-aef2-43f2-a66a-de1da1795b91 admin admin] Network 48bd9423-5b85-4344-9434-17e10e227731 is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:41:11.966647 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] Attempting to bind port 1c451dba-c399-4ceb-a969-412896a38aec on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:41:11.967615 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] Attempting to bind port 1c451dba-c399-4ceb-a969-412896a38aec by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}] {{(pid=94349) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:41:11.967615 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] Attempting to bind port 1c451dba-c399-4ceb-a969-412896a38aec on network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:41:11.968190 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-0f612d98-aef2-43f2-a66a-de1da1795b91 admin admin] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:41:11.974571 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f612d98-aef2-43f2-a66a-de1da1795b91 admin admin] Received port after_create {{(pid=94346) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:41:11.977499 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ddb5bbc-8c82-4d05-ade5-eaa1c76e2919 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:11.977857 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ddb5bbc-8c82-4d05-ade5-eaa1c76e2919 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:11.978204 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ddb5bbc-8c82-4d05-ade5-eaa1c76e2919 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:11.978610 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ddb5bbc-8c82-4d05-ade5-eaa1c76e2919 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:11.978863 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ddb5bbc-8c82-4d05-ade5-eaa1c76e2919 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:11.979195 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ddb5bbc-8c82-4d05-ade5-eaa1c76e2919 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:11.979527 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ddb5bbc-8c82-4d05-ade5-eaa1c76e2919 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:11.979853 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ddb5bbc-8c82-4d05-ade5-eaa1c76e2919 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:11.980205 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ddb5bbc-8c82-4d05-ade5-eaa1c76e2919 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:11.980532 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ddb5bbc-8c82-4d05-ade5-eaa1c76e2919 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:11.980860 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ddb5bbc-8c82-4d05-ade5-eaa1c76e2919 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:11.981182 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2ddb5bbc-8c82-4d05-ade5-eaa1c76e2919 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:11.984447 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 40, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:41:11.984822 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] Checking segment: {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94349) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:41:11.985236 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:11.985628 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] Bound using segment: {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'} {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:41:11.986095 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] Bound port: 1c451dba-c399-4ceb-a969-412896a38aec, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}}] {{(pid=94349) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:41:11.986488 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:12.008815 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f612d98-aef2-43f2-a66a-de1da1795b91 admin admin] Pushing event updated for resources: {'Port': ['ID=cda97d8d-7e99-46b1-937f-0a3ae975c076,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:12.028814 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0f612d98-aef2-43f2-a66a-de1da1795b91 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-785025'] for router_interface, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:12.043071 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.db [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] For port 1c451dba-c399-4ceb-a969-412896a38aec, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94349) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:41:12.046419 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.db [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] For port 1c451dba-c399-4ceb-a969-412896a38aec, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=1c451dba-c399-4ceb-a969-412896a38aec,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94349) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:41:12.051391 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:12.109185 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] Routers {'2406a855-e08c-4bcc-974c-cd88788039b3'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:41:12.109844 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:40:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['2406a855-e08c-4bcc-974c-cd88788039b3'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:41:12.145579 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ddb5bbc-8c82-4d05-ade5-eaa1c76e2919 None None] Pushing event updated for resources: {'Port': ['ID=1c451dba-c399-4ceb-a969-412896a38aec,revision_number=3']} {{(pid=94349) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:12.162993 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0f612d98-aef2-43f2-a66a-de1da1795b91 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:12.237898 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] Set router 2406a855-e08c-4bcc-974c-cd88788039b3 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:41:12.290876 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-cf754c32-0813-43c0-a312-f4a1cdf3867b None None] Provisioning complete for port cda97d8d-7e99-46b1-937f-0a3ae975c076 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:12.291441 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-cf754c32-0813-43c0-a312-f4a1cdf3867b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:12.300322 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98458b75-1727-477c-8964-1022d95d70b6 req-f9529b4f-8163-4234-93df-ebf0e8ec0a41 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:12.303940 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-98458b75-1727-477c-8964-1022d95d70b6 req-f9529b4f-8163-4234-93df-ebf0e8ec0a41 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 943 time: 0.0587792 Sep 18 08:41:12.347396 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0f612d98-aef2-43f2-a66a-de1da1795b91 admin admin] Notify callbacks [] for port, precommit_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:12.350001 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-cf754c32-0813-43c0-a312-f4a1cdf3867b None None] Port cda97d8d-7e99-46b1-937f-0a3ae975c076 cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:41:12.356981 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-98458b75-1727-477c-8964-1022d95d70b6 req-54a30145-1023-4121-8caa-3c4bf8cfb5b6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0347958 Sep 18 08:41:12.358279 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0f612d98-aef2-43f2-a66a-de1da1795b91 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14290155'] for port, after_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:12.427012 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f612d98-aef2-43f2-a66a-de1da1795b91 admin admin] Pushing event updated for resources: {'Port': ['ID=cda97d8d-7e99-46b1-937f-0a3ae975c076,revision_number=2']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:12.430702 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0f612d98-aef2-43f2-a66a-de1da1795b91 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-580051', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-783377'] for router_interface, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:12.457045 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'name': 'tempest-TestMinimumBasicScenario-2061029967-router', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '1c451dba-c399-4ceb-a969-412896a38aec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:10Z', 'revision_number': 3, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'gw_port': {'id': '1c451dba-c399-4ceb-a969-412896a38aec', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:c3:fe', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 441, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:41:12.487953 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a575b577-6d5a-431f-bc0f-c9d40f82fa80 None None] The sync data for ids ['2406a855-e08c-4bcc-974c-cd88788039b3'] in dv-cinder-804470-6-iscsi is: [{'id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'name': 'tempest-TestMinimumBasicScenario-2061029967-router', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '1c451dba-c399-4ceb-a969-412896a38aec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:10Z', 'revision_number': 3, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'gw_port': {'id': '1c451dba-c399-4ceb-a969-412896a38aec', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:c3:fe', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 441, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:12Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}] {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:41:12.530731 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f612d98-aef2-43f2-a66a-de1da1795b91 admin admin] Network 48bd9423-5b85-4344-9434-17e10e227731 is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:41:12.532337 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-0f612d98-aef2-43f2-a66a-de1da1795b91 admin admin] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:41:12.687281 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0f612d98-aef2-43f2-a66a-de1da1795b91 admin admin] Router 2406a855-e08c-4bcc-974c-cd88788039b3 has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94346) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:41:12.774766 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-9d8818bb-a222-4383-97ac-8623b04d6c4a None None] Provisioning complete for port cda97d8d-7e99-46b1-937f-0a3ae975c076 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:12.775025 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-9d8818bb-a222-4383-97ac-8623b04d6c4a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:12.798968 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0f612d98-aef2-43f2-a66a-de1da1795b91 admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94346) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:41:12.805375 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-0f612d98-aef2-43f2-a66a-de1da1795b91 admin admin] 10.222.0.35 "PUT /v2.0/routers/2406a855-e08c-4bcc-974c-cd88788039b3/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6920841 Sep 18 08:41:12.825537 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-9d8818bb-a222-4383-97ac-8623b04d6c4a None None] Port cda97d8d-7e99-46b1-937f-0a3ae975c076 cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:41:13.060541 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0faf1c12-1d6c-4e11-a528-956b77fa0b28 req-88b691c4-3b77-47d9-a7fd-96e1fa2c97f6 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:13.060541 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0faf1c12-1d6c-4e11-a528-956b77fa0b28 req-88b691c4-3b77-47d9-a7fd-96e1fa2c97f6 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.1047592 Sep 18 08:41:13.108263 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0faf1c12-1d6c-4e11-a528-956b77fa0b28 req-3bc6ab3c-59e8-4457-b42a-503e88a4ff17 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400875 Sep 18 08:41:13.423151 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 1c451dba-c399-4ceb-a969-412896a38aec up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:41:13.496909 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 60492) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:41:13.501872 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-49647378-80ad-45f9-861f-8395d6ffd627 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-2027707586-network', 'tenant_id': 'e5499776ba4b4ca1a60a858539853303'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:41:13.513470 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 1c451dba-c399-4ceb-a969-412896a38aec triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:13.513470 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:13.534612 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-49647378-80ad-45f9-861f-8395d6ffd627 admin admin] Made reservation on behalf of e5499776ba4b4ca1a60a858539853303 for: {'network': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:41:13.536323 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69f63651-7799-47bc-852d-8962cfbe34b5 req-382c1eda-59e3-4d3d-8616-883c1da259d0 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:13.538397 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-49647378-80ad-45f9-861f-8395d6ffd627 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for network, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:13.538543 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-69f63651-7799-47bc-852d-8962cfbe34b5 req-382c1eda-59e3-4d3d-8616-883c1da259d0 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 943 time: 0.0626600 Sep 18 08:41:13.551688 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-49647378-80ad-45f9-861f-8395d6ffd627 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:13.584690 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-69f63651-7799-47bc-852d-8962cfbe34b5 req-221aacb8-4502-457e-8c97-cb59ce175216 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399535 Sep 18 08:41:13.635850 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:13.677262 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-536c997d-2873-442a-81bf-9fe918803742 None None] For port 1c451dba-c399-4ceb-a969-412896a38aec, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=1c451dba-c399-4ceb-a969-412896a38aec,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:41:13.687148 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:13.706037 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-49647378-80ad-45f9-861f-8395d6ffd627 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:13.715780 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-49647378-80ad-45f9-861f-8395d6ffd627 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:13.729891 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-49647378-80ad-45f9-861f-8395d6ffd627 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 247} {{(pid=94346) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 18 08:41:13.748938 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-49647378-80ad-45f9-861f-8395d6ffd627 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:13.749442 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.db.segments_db [None req-49647378-80ad-45f9-861f-8395d6ffd627 admin admin] Added segment 6b776d8d-2b4b-44ff-bc79-dee6b1f71cff of type vlan for network dcbcf1bc-d782-4448-8e94-4151a8b0647f Sep 18 08:41:13.772603 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Pushing event updated for resources: {'Port': ['ID=1c451dba-c399-4ceb-a969-412896a38aec,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:13.781483 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:13.781913 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:13.782343 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:13.782756 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:13.783098 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:13.784634 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:13.785594 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:13.785991 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:13.786510 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:13.786895 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:13.787256 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:13.787808 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:13.807766 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49647378-80ad-45f9-861f-8395d6ffd627 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=222216ae-d03d-409b-b2d1-4611285b541d,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:13.829844 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-49647378-80ad-45f9-861f-8395d6ffd627 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732885226527'] for network, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:13.858554 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-49647378-80ad-45f9-861f-8395d6ffd627 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for network, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:13.859756 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-49647378-80ad-45f9-861f-8395d6ffd627 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:13.860451 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-49647378-80ad-45f9-861f-8395d6ffd627 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:13.896169 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-49647378-80ad-45f9-861f-8395d6ffd627 admin admin] 10.222.0.35 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.3979793 Sep 18 08:41:13.898716 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 60502) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:41:13.928358 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-66848f9a-659b-4dba-a3dc-f3f7a4771b98 admin admin] Request body: {'subnet': {'network_id': 'dcbcf1bc-d782-4448-8e94-4151a8b0647f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-2027707586-subnet', 'tenant_id': 'e5499776ba4b4ca1a60a858539853303', 'ip_version': 4}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:41:13.939340 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49647378-80ad-45f9-861f-8395d6ffd627 admin admin] Pushing event updated for resources: {'Network': ['ID=dcbcf1bc-d782-4448-8e94-4151a8b0647f,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:13.955454 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Network dcbcf1bc-d782-4448-8e94-4151a8b0647f details requested by agent ovs-agent-dv-cinder-804470-6-iscsi with host dv-cinder-804470-6-iscsi {{(pid=94348) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 18 08:41:13.973197 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-66848f9a-659b-4dba-a3dc-f3f7a4771b98 admin admin] Made reservation on behalf of e5499776ba4b4ca1a60a858539853303 for: {'subnet': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:41:13.976083 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-66848f9a-659b-4dba-a3dc-f3f7a4771b98 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14198618'] for subnet, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:14.185556 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-66848f9a-659b-4dba-a3dc-f3f7a4771b98 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-14290078', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14198644'] for subnet, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:14.242670 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-826cb269-a6f2-4af8-b5a0-758494e68b00 req-0b75483c-8f1f-487a-8855-639a8225e684 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:14.244249 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-826cb269-a6f2-4af8-b5a0-758494e68b00 req-0b75483c-8f1f-487a-8855-639a8225e684 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0546114 Sep 18 08:41:14.248937 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66848f9a-659b-4dba-a3dc-f3f7a4771b98 admin admin] Pushing event updated for resources: {'Subnet': ['ID=55d4aec3-9a5a-49a9-a580-2748bcb64e49,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:14.268410 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-66848f9a-659b-4dba-a3dc-f3f7a4771b98 admin admin] Checking segment: {'id': '6b776d8d-2b4b-44ff-bc79-dee6b1f71cff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 247, 'network_id': 'dcbcf1bc-d782-4448-8e94-4151a8b0647f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94346) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:41:14.268925 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-66848f9a-659b-4dba-a3dc-f3f7a4771b98 admin admin] Network hostable DHCP agents. Network: dcbcf1bc-d782-4448-8e94-4151a8b0647f, hostable agents: ['6aaa6222-6d04-44a7-b807-bfc2cbd3e99f'], hosted agents: [] {{(pid=94346) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 18 08:41:14.286174 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-826cb269-a6f2-4af8-b5a0-758494e68b00 req-dc89cb7a-79a6-4b5e-beda-7587fca77d18 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0347133 Sep 18 08:41:14.287945 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-66848f9a-659b-4dba-a3dc-f3f7a4771b98 admin admin] Network dcbcf1bc-d782-4448-8e94-4151a8b0647f is scheduled to be hosted by DHCP agent 6aaa6222-6d04-44a7-b807-bfc2cbd3e99f with binding_index 1 {{(pid=94346) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 18 08:41:14.297957 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-66848f9a-659b-4dba-a3dc-f3f7a4771b98 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804470-6-iscsi, dcbcf1bc-d782-4448-8e94-4151a8b0647f) {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:41:14.304108 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-66848f9a-659b-4dba-a3dc-f3f7a4771b98 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:14.304320 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-66848f9a-659b-4dba-a3dc-f3f7a4771b98 admin admin] Notify callbacks [] for subnet, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:14.307306 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-20b7f2dd-c0b9-485f-8a47-9b2ebb41c743 None None] Network dcbcf1bc-d782-4448-8e94-4151a8b0647f requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:41:14.320337 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-66848f9a-659b-4dba-a3dc-f3f7a4771b98 admin admin] 10.222.0.35 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.4203448 Sep 18 08:41:14.324156 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 60508) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:41:14.327220 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-f7ae1773-9f53-418e-988b-9ed50c7baa29 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-2027707586-router', 'tenant_id': 'e5499776ba4b4ca1a60a858539853303', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:41:14.349444 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f7ae1773-9f53-418e-988b-9ed50c7baa29 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-784001', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2995'] for router, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:14.350422 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f7ae1773-9f53-418e-988b-9ed50c7baa29 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-782353', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-784513', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-710924', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2984'] for router, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:14.373577 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] Sync routers for ids ['2406a855-e08c-4bcc-974c-cd88788039b3'] in dv-cinder-804470-6-iscsi {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:41:14.394486 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] Routers {'2406a855-e08c-4bcc-974c-cd88788039b3'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:41:14.395022 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:40:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['2406a855-e08c-4bcc-974c-cd88788039b3'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:41:14.400561 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f7ae1773-9f53-418e-988b-9ed50c7baa29 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:14.542660 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f7ae1773-9f53-418e-988b-9ed50c7baa29 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:14.555226 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0f4f32e7-439f-4769-8a76-166b0602e13f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp22fa9bf9-2738-5c16-87a3-3f58ee5e2dc2-dcbcf1bc-d782-4448-8e94-4151a8b0647f', 'network_id': 'dcbcf1bc-d782-4448-8e94-4151a8b0647f', 'tenant_id': 'e5499776ba4b4ca1a60a858539853303', 'fixed_ips': [{'subnet_id': '55d4aec3-9a5a-49a9-a580-2748bcb64e49'}]}} from dv-cinder-804470-6-iscsi. {{(pid=94348) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 18 08:41:14.556086 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-0f4f32e7-439f-4769-8a76-166b0602e13f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:14.570610 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] Set router 2406a855-e08c-4bcc-974c-cd88788039b3 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:41:14.734063 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ee289eb-099a-46ce-8ce1-10626ba2cc60 req-2d12a63d-c00e-4a66-b4e5-a3166972fb66 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:14.735988 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3ee289eb-099a-46ce-8ce1-10626ba2cc60 req-2d12a63d-c00e-4a66-b4e5-a3166972fb66 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 943 time: 0.0560646 Sep 18 08:41:14.775560 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f7ae1773-9f53-418e-988b-9ed50c7baa29 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:14.789342 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3ee289eb-099a-46ce-8ce1-10626ba2cc60 req-ebed557e-e1aa-46fd-bb6e-ee2c4f060a44 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432985 Sep 18 08:41:14.805402 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f7ae1773-9f53-418e-988b-9ed50c7baa29 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:14.863681 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.db_base_plugin_common [None req-0f4f32e7-439f-4769-8a76-166b0602e13f None None] Allocated IP 172.20.0.2 (dcbcf1bc-d782-4448-8e94-4151a8b0647f/55d4aec3-9a5a-49a9-a580-2748bcb64e49/f4151bdd-91ac-4e48-872e-d060b4b6ad29) {{(pid=94348) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:41:14.925687 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_common [None req-f7ae1773-9f53-418e-988b-9ed50c7baa29 admin admin] Allocated IP 172.27.1.196 (2e3b3f85-63e4-4380-917a-8c90c80b3e38/cd525bb9-7f93-490c-a5d6-a08911817e54/0bfc635e-76c9-4d59-8312-62cb4d0c808d) {{(pid=94346) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:41:14.985186 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'name': 'tempest-TestMinimumBasicScenario-2061029967-router', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '1c451dba-c399-4ceb-a969-412896a38aec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:12Z', 'revision_number': 4, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'gw_port': {'id': '1c451dba-c399-4ceb-a969-412896a38aec', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:c3:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 441, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': 'cda97d8d-7e99-46b1-937f-0a3ae975c076', 'name': '', 'network_id': '48bd9423-5b85-4344-9434-17e10e227731', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'mac_address': 'fa:16:3e:f2:78:1e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': '95fb2797-9ac9-40f9-9ea9-56d2c5a16291', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:11Z', 'updated_at': '2021-09-18T08:41:12Z', 'revision_number': 2, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'subnets': [{'id': '95fb2797-9ac9-40f9-9ea9-56d2c5a16291', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:41:15.021862 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] Checking router: 2406a855-e08c-4bcc-974c-cd88788039b3 for host: dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:41:15.022229 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] Updating router 2406a855-e08c-4bcc-974c-cd88788039b3 port cda97d8d-7e99-46b1-937f-0a3ae975c076 binding host dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 18 08:41:15.046250 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f7ae1773-9f53-418e-988b-9ed50c7baa29 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:15.073930 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:15.086225 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f7ae1773-9f53-418e-988b-9ed50c7baa29 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:15.126216 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-0f4f32e7-439f-4769-8a76-166b0602e13f None None] Notify callbacks [] for port, precommit_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:15.129490 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f7ae1773-9f53-418e-988b-9ed50c7baa29 admin admin] Network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:41:15.132606 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-f7ae1773-9f53-418e-988b-9ed50c7baa29 admin admin] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:41:15.136466 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f7ae1773-9f53-418e-988b-9ed50c7baa29 admin admin] Received port after_create {{(pid=94346) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:41:15.138659 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-0f4f32e7-439f-4769-8a76-166b0602e13f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528'] for port, after_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:15.183287 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7ae1773-9f53-418e-988b-9ed50c7baa29 admin admin] Pushing event updated for resources: {'Port': ['ID=0bfc635e-76c9-4d59-8312-62cb4d0c808d,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:15.349134 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f4f32e7-439f-4769-8a76-166b0602e13f None None] Network dcbcf1bc-d782-4448-8e94-4151a8b0647f is already hosted by enough agents. {{(pid=94348) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:41:15.364921 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.scheduler.base_scheduler [None req-0f4f32e7-439f-4769-8a76-166b0602e13f None None] Resources bound (agent type, host, resource id): {{(pid=94348) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:41:15.369333 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f4f32e7-439f-4769-8a76-166b0602e13f None None] Received port after_create {{(pid=94348) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:41:15.371322 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f4f32e7-439f-4769-8a76-166b0602e13f None None] Pushing event updated for resources: {'Port': ['ID=f4151bdd-91ac-4e48-872e-d060b4b6ad29,revision_number=1']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:15.418052 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f7ae1773-9f53-418e-988b-9ed50c7baa29 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:15.441961 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a5b9274-e4e3-427d-b835-e6fd5485dd00 req-1492810c-b63d-403d-a71b-2fda393f0b13 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:15.444338 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9a5b9274-e4e3-427d-b835-e6fd5485dd00 req-1492810c-b63d-403d-a71b-2fda393f0b13 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0600002 Sep 18 08:41:15.452866 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 1c451dba-c399-4ceb-a969-412896a38aec up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:41:15.494446 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-0f4f32e7-439f-4769-8a76-166b0602e13f None None] Attempting to bind port f4151bdd-91ac-4e48-872e-d060b4b6ad29 on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:41:15.494825 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-0f4f32e7-439f-4769-8a76-166b0602e13f None None] Attempting to bind port f4151bdd-91ac-4e48-872e-d060b4b6ad29 by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': '6b776d8d-2b4b-44ff-bc79-dee6b1f71cff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 247, 'network_id': 'dcbcf1bc-d782-4448-8e94-4151a8b0647f'}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:41:15.495198 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f4f32e7-439f-4769-8a76-166b0602e13f None None] Attempting to bind port f4151bdd-91ac-4e48-872e-d060b4b6ad29 on network dcbcf1bc-d782-4448-8e94-4151a8b0647f {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:41:15.502579 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9a5b9274-e4e3-427d-b835-e6fd5485dd00 req-1dab94e7-565a-4f85-8c9e-f558a2023af5 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404165 Sep 18 08:41:15.538214 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f4f32e7-439f-4769-8a76-166b0602e13f None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 40, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:41:15.538594 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f4f32e7-439f-4769-8a76-166b0602e13f None None] Checking segment: {'id': '6b776d8d-2b4b-44ff-bc79-dee6b1f71cff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 247, 'network_id': 'dcbcf1bc-d782-4448-8e94-4151a8b0647f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94348) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:41:15.539035 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-0f4f32e7-439f-4769-8a76-166b0602e13f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:15.539468 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f4f32e7-439f-4769-8a76-166b0602e13f None None] Bound using segment: {'id': '6b776d8d-2b4b-44ff-bc79-dee6b1f71cff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 247, 'network_id': 'dcbcf1bc-d782-4448-8e94-4151a8b0647f'} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:41:15.540098 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-0f4f32e7-439f-4769-8a76-166b0602e13f None None] Bound port: f4151bdd-91ac-4e48-872e-d060b4b6ad29, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6b776d8d-2b4b-44ff-bc79-dee6b1f71cff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 247, 'network_id': 'dcbcf1bc-d782-4448-8e94-4151a8b0647f'}}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:41:15.540495 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-0f4f32e7-439f-4769-8a76-166b0602e13f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:15.592058 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 2f2f886e-b6d3-4d02-92de-a193d7d276f7 details requested by agent hyperv_hv-cinder-80447 with host hv-cinder-80447 {{(pid=94348) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 18 08:41:15.619785 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 1c451dba-c399-4ceb-a969-412896a38aec triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:15.620161 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:15.718376 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-0f4f32e7-439f-4769-8a76-166b0602e13f None None] For port f4151bdd-91ac-4e48-872e-d060b4b6ad29, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94348) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:41:15.796255 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-0f4f32e7-439f-4769-8a76-166b0602e13f None None] For port f4151bdd-91ac-4e48-872e-d060b4b6ad29, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=f4151bdd-91ac-4e48-872e-d060b4b6ad29,segment=NetworkSegment(6b776d8d-2b4b-44ff-bc79-dee6b1f71cff),segment_id=6b776d8d-2b4b-44ff-bc79-dee6b1f71cff)] {{(pid=94348) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:41:15.807673 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-0f4f32e7-439f-4769-8a76-166b0602e13f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:15.846809 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f7ae1773-9f53-418e-988b-9ed50c7baa29 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-782366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-784982'] for router, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:15.875056 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] Notify callbacks [] for port, precommit_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:15.913035 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 2f2f886e-b6d3-4d02-92de-a193d7d276f7, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=2f2f886e-b6d3-4d02-92de-a193d7d276f7,segment=NetworkSegment(6dfc82da-1689-40bb-a749-6245f29bfd89),segment_id=6dfc82da-1689-40bb-a749-6245f29bfd89)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:41:15.927057 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:15.960379 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Returning: {'device': '2f2f886e-b6d3-4d02-92de-a193d7d276f7', 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca', 'port_id': '2f2f886e-b6d3-4d02-92de-a193d7d276f7', 'mac_address': 'fa:16:3e:a6:2f:3c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 244, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '58e9d53a-333d-4a2f-a575-92c9de3fb737', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94348) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 18 08:41:16.006445 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f4f32e7-439f-4769-8a76-166b0602e13f None None] Pushing event updated for resources: {'Port': ['ID=f4151bdd-91ac-4e48-872e-d060b4b6ad29,revision_number=2']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:16.031708 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-884fa13f-3241-47f9-9bb6-e42dc47c398b req-5b3b22e9-734e-444d-877a-7e0032098bf0 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:16.036022 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-884fa13f-3241-47f9-9bb6-e42dc47c398b req-5b3b22e9-734e-444d-877a-7e0032098bf0 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 943 time: 0.1599171 Sep 18 08:41:16.083686 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f7ae1773-9f53-418e-988b-9ed50c7baa29 admin admin] Router d2c00031-a918-482a-ab17-bf2b1058f4a4 is scheduled to L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a with binding_index 1 {{(pid=94346) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 18 08:41:16.129186 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-884fa13f-3241-47f9-9bb6-e42dc47c398b req-ba76000e-6665-4941-86bf-ee648f2ef879 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0869398 Sep 18 08:41:16.150074 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:16.171249 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2f2f886e-b6d3-4d02-92de-a193d7d276f7 {{(pid=94348) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:41:16.211706 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 2f2f886e-b6d3-4d02-92de-a193d7d276f7, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=2f2f886e-b6d3-4d02-92de-a193d7d276f7,segment=NetworkSegment(6dfc82da-1689-40bb-a749-6245f29bfd89),segment_id=6dfc82da-1689-40bb-a749-6245f29bfd89)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:41:16.250803 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:16.254452 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51bb18af-5743-4098-8b76-380a694c8d2d None None] Pushing event updated for resources: {'Port': ['ID=cda97d8d-7e99-46b1-937f-0a3ae975c076,revision_number=3']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:16.291193 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f7ae1773-9f53-418e-988b-9ed50c7baa29 admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94346) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:41:16.301580 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] Sync routers for ids ['d2c00031-a918-482a-ab17-bf2b1058f4a4'] in dv-cinder-804470-6-iscsi {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:41:16.323481 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] Routers {'d2c00031-a918-482a-ab17-bf2b1058f4a4'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:41:16.324200 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:40:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['d2c00031-a918-482a-ab17-bf2b1058f4a4'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:41:16.331635 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f7ae1773-9f53-418e-988b-9ed50c7baa29 admin admin] Notify callbacks [] for router, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:16.333193 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-f7ae1773-9f53-418e-988b-9ed50c7baa29 admin admin] 10.222.0.35 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 2.0091925 Sep 18 08:41:16.335658 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 60542) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:41:16.366304 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] Attempting to bind port cda97d8d-7e99-46b1-937f-0a3ae975c076 on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:41:16.367751 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] Attempting to bind port cda97d8d-7e99-46b1-937f-0a3ae975c076 by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': '5d556fd8-f02d-4c49-9c67-863cea39ec4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 238, 'network_id': '48bd9423-5b85-4344-9434-17e10e227731'}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:41:16.367751 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] Attempting to bind port cda97d8d-7e99-46b1-937f-0a3ae975c076 on network 48bd9423-5b85-4344-9434-17e10e227731 {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:41:16.389769 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 40, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:41:16.390177 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] Checking segment: {'id': '5d556fd8-f02d-4c49-9c67-863cea39ec4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 238, 'network_id': '48bd9423-5b85-4344-9434-17e10e227731'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94348) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:41:16.390594 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:16.390998 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] Bound using segment: {'id': '5d556fd8-f02d-4c49-9c67-863cea39ec4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 238, 'network_id': '48bd9423-5b85-4344-9434-17e10e227731'} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:41:16.392810 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] Bound port: cda97d8d-7e99-46b1-937f-0a3ae975c076, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5d556fd8-f02d-4c49-9c67-863cea39ec4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 238, 'network_id': '48bd9423-5b85-4344-9434-17e10e227731'}}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:41:16.393232 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:16.412509 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=2f2f886e-b6d3-4d02-92de-a193d7d276f7,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:16.428580 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-f8759cba-e6c0-44d0-ad4c-d799be8bc9fc None None] Provisioning complete for port cda97d8d-7e99-46b1-937f-0a3ae975c076 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:16.428580 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-f8759cba-e6c0-44d0-ad4c-d799be8bc9fc None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:16.460571 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] Set router d2c00031-a918-482a-ab17-bf2b1058f4a4 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:41:16.500716 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-f8759cba-e6c0-44d0-ad4c-d799be8bc9fc None None] Port cda97d8d-7e99-46b1-937f-0a3ae975c076 cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:41:16.521850 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] For port cda97d8d-7e99-46b1-937f-0a3ae975c076, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94348) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:41:16.526773 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] For port cda97d8d-7e99-46b1-937f-0a3ae975c076, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=cda97d8d-7e99-46b1-937f-0a3ae975c076,segment=NetworkSegment(5d556fd8-f02d-4c49-9c67-863cea39ec4a),segment_id=5d556fd8-f02d-4c49-9c67-863cea39ec4a)] {{(pid=94348) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:41:16.548238 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:16.611818 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] Routers {'2406a855-e08c-4bcc-974c-cd88788039b3'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:41:16.612479 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:40:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['2406a855-e08c-4bcc-974c-cd88788039b3'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:41:16.656836 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51bb18af-5743-4098-8b76-380a694c8d2d None None] Pushing event updated for resources: {'Port': ['ID=cda97d8d-7e99-46b1-937f-0a3ae975c076,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:16.687302 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd2c00031-a918-482a-ab17-bf2b1058f4a4', 'name': 'tempest-TestMinimumBasicScenario-2027707586-router', 'tenant_id': 'e5499776ba4b4ca1a60a858539853303', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': '0bfc635e-76c9-4d59-8312-62cb4d0c808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:14Z', 'updated_at': '2021-09-18T08:41:15Z', 'revision_number': 3, 'project_id': 'e5499776ba4b4ca1a60a858539853303', 'gw_port': {'id': '0bfc635e-76c9-4d59-8312-62cb4d0c808d', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:0a:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd2c00031-a918-482a-ab17-bf2b1058f4a4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 453, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:14Z', 'updated_at': '2021-09-18T08:41:14Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:41:16.728846 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] Checking router: d2c00031-a918-482a-ab17-bf2b1058f4a4 for host: dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:41:16.729373 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] Updating router d2c00031-a918-482a-ab17-bf2b1058f4a4 port 0bfc635e-76c9-4d59-8312-62cb4d0c808d binding host dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 18 08:41:16.754776 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] Set router 2406a855-e08c-4bcc-974c-cd88788039b3 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:41:16.763407 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db48ce43-9b04-4e50-9da2-9dc890bcda35 req-94a1f737-3f62-4bed-979e-6fbb6eb33166 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:16.764159 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:16.765020 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-db48ce43-9b04-4e50-9da2-9dc890bcda35 req-94a1f737-3f62-4bed-979e-6fbb6eb33166 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.1222103 Sep 18 08:41:16.810602 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-db48ce43-9b04-4e50-9da2-9dc890bcda35 req-0105e36e-c8aa-43ec-94da-82825c7fa066 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388958 Sep 18 08:41:16.824750 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['2f2f886e-b6d3-4d02-92de-a193d7d276f7'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:41:16.954899 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-751e5fa5-1a0e-45c9-b58c-c0426e99d839 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:17.030349 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-93e1295d-2a28-453d-b5ab-3c0c68c7965a None None] Provisioning complete for port cda97d8d-7e99-46b1-937f-0a3ae975c076 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:17.030798 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-93e1295d-2a28-453d-b5ab-3c0c68c7965a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:17.159886 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_common [None req-751e5fa5-1a0e-45c9-b58c-c0426e99d839 admin admin] Allocated IP 172.20.0.1 (dcbcf1bc-d782-4448-8e94-4151a8b0647f/55d4aec3-9a5a-49a9-a580-2748bcb64e49/52d7871c-2f26-4048-bd50-331024fd3e4c) {{(pid=94346) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:41:17.270689 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] Notify callbacks [] for port, precommit_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:17.279327 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:17.331543 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9796f5ab-8750-4127-b8cc-a3039388b616 req-e8a2b299-b32e-4817-a89f-ef3626eb5243 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:17.334838 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5beab083-3673-4948-a13c-70551f6bca74 None None] Network dcbcf1bc-d782-4448-8e94-4151a8b0647f requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:41:17.335394 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-751e5fa5-1a0e-45c9-b58c-c0426e99d839 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:17.335938 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9796f5ab-8750-4127-b8cc-a3039388b616 req-e8a2b299-b32e-4817-a89f-ef3626eb5243 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 944 time: 0.0984781 Sep 18 08:41:17.345067 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa249075-3111-4d41-8ca6-ab1f4e8caf09 None None] Pushing event updated for resources: {'Port': ['ID=0bfc635e-76c9-4d59-8312-62cb4d0c808d,revision_number=2']} {{(pid=94349) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:17.365960 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] Attempting to bind port 0bfc635e-76c9-4d59-8312-62cb4d0c808d on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:41:17.366337 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] Attempting to bind port 0bfc635e-76c9-4d59-8312-62cb4d0c808d by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}] {{(pid=94349) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:41:17.366705 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] Attempting to bind port 0bfc635e-76c9-4d59-8312-62cb4d0c808d on network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:41:17.372612 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 40, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:41:17.372961 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] Checking segment: {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94349) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:41:17.373536 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:17.373797 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] Bound using segment: {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'} {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:41:17.374267 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] Bound port: 0bfc635e-76c9-4d59-8312-62cb4d0c808d, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}}] {{(pid=94349) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:41:17.374677 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:17.380118 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-93e1295d-2a28-453d-b5ab-3c0c68c7965a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:17.400890 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9796f5ab-8750-4127-b8cc-a3039388b616 req-9c7c5d68-745b-4ed0-b0fb-8c7519304eb9 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0577693 Sep 18 08:41:17.426418 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-751e5fa5-1a0e-45c9-b58c-c0426e99d839 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:17.431460 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-93e1295d-2a28-453d-b5ab-3c0c68c7965a None None] For port cda97d8d-7e99-46b1-937f-0a3ae975c076, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=cda97d8d-7e99-46b1-937f-0a3ae975c076,segment=NetworkSegment(5d556fd8-f02d-4c49-9c67-863cea39ec4a),segment_id=5d556fd8-f02d-4c49-9c67-863cea39ec4a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:41:17.435158 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'name': 'tempest-TestMinimumBasicScenario-2061029967-router', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '1c451dba-c399-4ceb-a969-412896a38aec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:12Z', 'revision_number': 4, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'gw_port': {'id': '1c451dba-c399-4ceb-a969-412896a38aec', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:c3:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 441, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': 'cda97d8d-7e99-46b1-937f-0a3ae975c076', 'name': '', 'network_id': '48bd9423-5b85-4344-9434-17e10e227731', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'mac_address': 'fa:16:3e:f2:78:1e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': '95fb2797-9ac9-40f9-9ea9-56d2c5a16291', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:11Z', 'updated_at': '2021-09-18T08:41:16Z', 'revision_number': 4, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'subnets': [{'id': '95fb2797-9ac9-40f9-9ea9-56d2c5a16291', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:41:17.471570 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-751e5fa5-1a0e-45c9-b58c-c0426e99d839 admin admin] Network dcbcf1bc-d782-4448-8e94-4151a8b0647f is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:41:17.477153 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-751e5fa5-1a0e-45c9-b58c-c0426e99d839 admin admin] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:41:17.481499 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [None req-751e5fa5-1a0e-45c9-b58c-c0426e99d839 admin admin] Received port after_create {{(pid=94346) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:41:17.483217 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.db [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] For port 0bfc635e-76c9-4d59-8312-62cb4d0c808d, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94349) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:41:17.486678 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.db [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] For port 0bfc635e-76c9-4d59-8312-62cb4d0c808d, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=0bfc635e-76c9-4d59-8312-62cb4d0c808d,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94349) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:41:17.488960 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-59ec5df9-9541-4ad0-8b99-71bb975e30b2 None None] The sync data for ids ['2406a855-e08c-4bcc-974c-cd88788039b3'] in dv-cinder-804470-6-iscsi is: [{'id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'name': 'tempest-TestMinimumBasicScenario-2061029967-router', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '1c451dba-c399-4ceb-a969-412896a38aec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:12Z', 'revision_number': 4, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'gw_port': {'id': '1c451dba-c399-4ceb-a969-412896a38aec', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:c3:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 441, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': 'cda97d8d-7e99-46b1-937f-0a3ae975c076', 'name': '', 'network_id': '48bd9423-5b85-4344-9434-17e10e227731', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'mac_address': 'fa:16:3e:f2:78:1e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': '95fb2797-9ac9-40f9-9ea9-56d2c5a16291', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:11Z', 'updated_at': '2021-09-18T08:41:16Z', 'revision_number': 4, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'subnets': [{'id': '95fb2797-9ac9-40f9-9ea9-56d2c5a16291', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:41:17.496060 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:17.512653 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-751e5fa5-1a0e-45c9-b58c-c0426e99d839 admin admin] Pushing event updated for resources: {'Port': ['ID=52d7871c-2f26-4048-bd50-331024fd3e4c,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:17.538436 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-751e5fa5-1a0e-45c9-b58c-c0426e99d839 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-785025'] for router_interface, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:17.569351 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] Routers {'d2c00031-a918-482a-ab17-bf2b1058f4a4'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:41:17.579537 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:40:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['d2c00031-a918-482a-ab17-bf2b1058f4a4'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:41:17.657335 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa249075-3111-4d41-8ca6-ab1f4e8caf09 None None] Pushing event updated for resources: {'Port': ['ID=0bfc635e-76c9-4d59-8312-62cb4d0c808d,revision_number=3']} {{(pid=94349) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:17.711284 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device f4151bdd-91ac-4e48-872e-d060b4b6ad29 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:41:17.712721 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-93e1295d-2a28-453d-b5ab-3c0c68c7965a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:17.761123 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] Set router d2c00031-a918-482a-ab17-bf2b1058f4a4 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:41:17.785017 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-751e5fa5-1a0e-45c9-b58c-c0426e99d839 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:17.840859 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93e1295d-2a28-453d-b5ab-3c0c68c7965a None None] Pushing event updated for resources: {'Port': ['ID=cda97d8d-7e99-46b1-937f-0a3ae975c076,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:17.904946 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-8825c705-d67d-47af-bb94-9d55137d73b2 None None] Provisioning complete for port f4151bdd-91ac-4e48-872e-d060b4b6ad29 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:17.905361 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-8825c705-d67d-47af-bb94-9d55137d73b2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:17.924382 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33075f0b-99e6-4d2a-bb90-39ed62d5c9f5 req-8e7834b3-ba1f-4c92-aa7b-daa1ec9012c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:17.925973 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-33075f0b-99e6-4d2a-bb90-39ed62d5c9f5 req-8e7834b3-ba1f-4c92-aa7b-daa1ec9012c5 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=f439efa4eed0456ab2a914377e490fad&device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 1098 time: 0.1133723 Sep 18 08:41:18.008948 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd2c00031-a918-482a-ab17-bf2b1058f4a4', 'name': 'tempest-TestMinimumBasicScenario-2027707586-router', 'tenant_id': 'e5499776ba4b4ca1a60a858539853303', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': '0bfc635e-76c9-4d59-8312-62cb4d0c808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:14Z', 'updated_at': '2021-09-18T08:41:15Z', 'revision_number': 3, 'project_id': 'e5499776ba4b4ca1a60a858539853303', 'gw_port': {'id': '0bfc635e-76c9-4d59-8312-62cb4d0c808d', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:0a:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd2c00031-a918-482a-ab17-bf2b1058f4a4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 453, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:14Z', 'updated_at': '2021-09-18T08:41:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:41:18.018092 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port f4151bdd-91ac-4e48-872e-d060b4b6ad29 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:18.018092 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:18.053628 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-751e5fa5-1a0e-45c9-b58c-c0426e99d839 admin admin] Notify callbacks [] for port, precommit_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:18.059269 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-751e5fa5-1a0e-45c9-b58c-c0426e99d839 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14290155'] for port, after_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:18.067751 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ca5e30e-e555-454a-bc63-2b9899e179e2 None None] The sync data for ids ['d2c00031-a918-482a-ab17-bf2b1058f4a4'] in dv-cinder-804470-6-iscsi is: [{'id': 'd2c00031-a918-482a-ab17-bf2b1058f4a4', 'name': 'tempest-TestMinimumBasicScenario-2027707586-router', 'tenant_id': 'e5499776ba4b4ca1a60a858539853303', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': '0bfc635e-76c9-4d59-8312-62cb4d0c808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:14Z', 'updated_at': '2021-09-18T08:41:15Z', 'revision_number': 3, 'project_id': 'e5499776ba4b4ca1a60a858539853303', 'gw_port': {'id': '0bfc635e-76c9-4d59-8312-62cb4d0c808d', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:0a:e2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd2c00031-a918-482a-ab17-bf2b1058f4a4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 453, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:14Z', 'updated_at': '2021-09-18T08:41:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}] {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:41:18.153562 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-751e5fa5-1a0e-45c9-b58c-c0426e99d839 admin admin] Pushing event updated for resources: {'Port': ['ID=52d7871c-2f26-4048-bd50-331024fd3e4c,revision_number=2']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:18.168718 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-751e5fa5-1a0e-45c9-b58c-c0426e99d839 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-580051', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-783377'] for router_interface, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:18.169656 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33075f0b-99e6-4d2a-bb90-39ed62d5c9f5 req-dea2d568-d0fc-43f9-822b-930546492892 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:18.172005 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-33075f0b-99e6-4d2a-bb90-39ed62d5c9f5 req-dea2d568-d0fc-43f9-822b-930546492892 service neutron] 10.222.0.13 "GET /v2.0/networks?id=fdcbc66e-323e-4b44-be97-566949f4f2ef HTTP/1.1" status: 200 len: 919 time: 0.2216287 Sep 18 08:41:18.197507 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-216080a4-8ac6-45ec-8805-885e50203791 req-a6b42d23-4333-4e75-bfc7-425f1009359c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:18.206445 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-216080a4-8ac6-45ec-8805-885e50203791 req-a6b42d23-4333-4e75-bfc7-425f1009359c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.2214465 Sep 18 08:41:18.279851 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-751e5fa5-1a0e-45c9-b58c-c0426e99d839 admin admin] Network dcbcf1bc-d782-4448-8e94-4151a8b0647f is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:41:18.281575 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-751e5fa5-1a0e-45c9-b58c-c0426e99d839 admin admin] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:41:18.289969 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-33075f0b-99e6-4d2a-bb90-39ed62d5c9f5 req-55138e31-16d2-440f-a996-fceaeb3d7102 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b03411eb-66ff-4691-88c8-2c570d78c323 HTTP/1.1" status: 200 len: 217 time: 0.0918036 Sep 18 08:41:18.315762 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-8825c705-d67d-47af-bb94-9d55137d73b2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:18.399463 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:18.430700 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-216080a4-8ac6-45ec-8805-885e50203791 req-098209d3-0ad1-4947-8b64-7dc7345a662a tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2229097 Sep 18 08:41:18.463214 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33075f0b-99e6-4d2a-bb90-39ed62d5c9f5 req-e946ae55-b790-4fdc-8257-3e0e0083ff7b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:18.465260 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-33075f0b-99e6-4d2a-bb90-39ed62d5c9f5 req-e946ae55-b790-4fdc-8257-3e0e0083ff7b service neutron] 10.222.0.13 "GET /v2.0/subnets?id=e5dc6eef-e778-41a2-a708-c7810ade97db HTTP/1.1" status: 200 len: 858 time: 0.1734340 Sep 18 08:41:18.466094 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-8825c705-d67d-47af-bb94-9d55137d73b2 None None] For port f4151bdd-91ac-4e48-872e-d060b4b6ad29, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=f4151bdd-91ac-4e48-872e-d060b4b6ad29,segment=NetworkSegment(6b776d8d-2b4b-44ff-bc79-dee6b1f71cff),segment_id=6b776d8d-2b4b-44ff-bc79-dee6b1f71cff)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:41:18.474045 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-8825c705-d67d-47af-bb94-9d55137d73b2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:18.491449 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-751e5fa5-1a0e-45c9-b58c-c0426e99d839 admin admin] Router d2c00031-a918-482a-ab17-bf2b1058f4a4 has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94346) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:41:18.545414 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-33075f0b-99e6-4d2a-bb90-39ed62d5c9f5 req-c76bfb6d-4f21-487e-b8d7-c82484cde42d service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fdcbc66e-323e-4b44-be97-566949f4f2ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0721958 Sep 18 08:41:18.596988 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.db.api [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=94348) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Sep 18 08:41:18.597383 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG oslo_db.api [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Sep 18 08:41:18.598034 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8825c705-d67d-47af-bb94-9d55137d73b2 None None] Pushing event updated for resources: {'Port': ['ID=f4151bdd-91ac-4e48-872e-d060b4b6ad29,revision_number=3']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:18.705383 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-816ee759-75f6-4355-b257-c03b9d772a04 None None] Provisioning complete for port 52d7871c-2f26-4048-bd50-331024fd3e4c triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:18.705848 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-816ee759-75f6-4355-b257-c03b9d772a04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:18.773570 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-816ee759-75f6-4355-b257-c03b9d772a04 None None] Port 52d7871c-2f26-4048-bd50-331024fd3e4c cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:41:18.774252 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9c237db-bf13-4252-8d8e-6a858f5b3642 req-fd015958-814c-474b-aad9-be4df8333474 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:18.780759 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-751e5fa5-1a0e-45c9-b58c-c0426e99d839 admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94346) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:41:18.782461 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d9c237db-bf13-4252-8d8e-6a858f5b3642 req-fd015958-814c-474b-aad9-be4df8333474 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 944 time: 0.2331772 Sep 18 08:41:18.801433 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-751e5fa5-1a0e-45c9-b58c-c0426e99d839 admin admin] 10.222.0.35 "PUT /v2.0/routers/d2c00031-a918-482a-ab17-bf2b1058f4a4/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4559410 Sep 18 08:41:18.811010 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-816ee759-75f6-4355-b257-c03b9d772a04 None None] Provisioning complete for port f4151bdd-91ac-4e48-872e-d060b4b6ad29 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:18.811393 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-816ee759-75f6-4355-b257-c03b9d772a04 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:18.820105 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-33075f0b-99e6-4d2a-bb90-39ed62d5c9f5 req-b3d1f493-e47b-41ff-84d7-fa56cd631860 service neutron] 10.222.0.13 "GET /v2.0/networks/fdcbc66e-323e-4b44-be97-566949f4f2ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2600555 Sep 18 08:41:18.882102 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d9c237db-bf13-4252-8d8e-6a858f5b3642 req-8d0001a8-554f-42ae-b63f-1ea84fd418c4 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0987515 Sep 18 08:41:19.038753 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-33075f0b-99e6-4d2a-bb90-39ed62d5c9f5 req-1ed2930a-0915-4a4c-a14b-fa75b97e4261 service neutron] 10.222.0.13 "GET /v2.0/networks/fdcbc66e-323e-4b44-be97-566949f4f2ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1966174 Sep 18 08:41:19.085117 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-959f1ba3-4693-4599-94c0-5d85e415f1c2 None None] Provisioning complete for port 52d7871c-2f26-4048-bd50-331024fd3e4c triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:19.085527 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-959f1ba3-4693-4599-94c0-5d85e415f1c2 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:19.172234 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-959f1ba3-4693-4599-94c0-5d85e415f1c2 None None] Port 52d7871c-2f26-4048-bd50-331024fd3e4c cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:41:19.292354 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-e7848790-a96f-4f43-990f-1792f45854f7 None None] Provisioning complete for port 52d7871c-2f26-4048-bd50-331024fd3e4c triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:19.292743 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-e7848790-a96f-4f43-990f-1792f45854f7 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:19.331285 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-e7848790-a96f-4f43-990f-1792f45854f7 None None] Port 52d7871c-2f26-4048-bd50-331024fd3e4c cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:41:19.510860 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device f4151bdd-91ac-4e48-872e-d060b4b6ad29 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:41:19.555324 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06115087-1d20-488f-9ef8-d7e5de7bb9da req-9b9628f4-eab5-45c9-aa1a-b67c5c141726 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:19.556852 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-06115087-1d20-488f-9ef8-d7e5de7bb9da req-9b9628f4-eab5-45c9-aa1a-b67c5c141726 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0508549 Sep 18 08:41:19.565448 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port f4151bdd-91ac-4e48-872e-d060b4b6ad29 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:19.565868 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:19.620336 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-06115087-1d20-488f-9ef8-d7e5de7bb9da req-2b027860-969d-4cc5-b1ab-37fa59fb13b5 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0554039 Sep 18 08:41:19.623283 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-4880cd7e-8c1c-45b4-af0e-b65ac2fcb1e2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:19.668035 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device cda97d8d-7e99-46b1-937f-0a3ae975c076 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:41:19.713022 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port cda97d8d-7e99-46b1-937f-0a3ae975c076 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:19.713441 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:19.796887 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 0bfc635e-76c9-4d59-8312-62cb4d0c808d up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:41:19.842498 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 0bfc635e-76c9-4d59-8312-62cb4d0c808d triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:19.842790 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:19.930961 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:19.932058 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:19.953705 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-536c997d-2873-442a-81bf-9fe918803742 None None] For port 0bfc635e-76c9-4d59-8312-62cb4d0c808d, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=0bfc635e-76c9-4d59-8312-62cb4d0c808d,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:41:19.958693 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:20.017917 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Pushing event updated for resources: {'Port': ['ID=0bfc635e-76c9-4d59-8312-62cb4d0c808d,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:20.035688 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a6c975c-5f10-40b8-8e9a-adede03ef8ef req-3fc00640-4ad2-49e0-8c4f-4c6e43bbd651 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:20.037286 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3a6c975c-5f10-40b8-8e9a-adede03ef8ef req-3fc00640-4ad2-49e0-8c4f-4c6e43bbd651 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 944 time: 0.0559947 Sep 18 08:41:20.074218 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3a6c975c-5f10-40b8-8e9a-adede03ef8ef req-1b44abc4-acb5-4153-bb45-adcc72970226 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0306969 Sep 18 08:41:20.397984 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] Sync routers for ids ['d2c00031-a918-482a-ab17-bf2b1058f4a4'] in dv-cinder-804470-6-iscsi {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:41:20.406979 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] Routers {'d2c00031-a918-482a-ab17-bf2b1058f4a4'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:41:20.407597 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:40:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['d2c00031-a918-482a-ab17-bf2b1058f4a4'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:41:20.514946 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] Set router d2c00031-a918-482a-ab17-bf2b1058f4a4 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:41:20.712198 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd2c00031-a918-482a-ab17-bf2b1058f4a4', 'name': 'tempest-TestMinimumBasicScenario-2027707586-router', 'tenant_id': 'e5499776ba4b4ca1a60a858539853303', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': '0bfc635e-76c9-4d59-8312-62cb4d0c808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:14Z', 'updated_at': '2021-09-18T08:41:17Z', 'revision_number': 4, 'project_id': 'e5499776ba4b4ca1a60a858539853303', 'gw_port': {'id': '0bfc635e-76c9-4d59-8312-62cb4d0c808d', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:0a:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2c00031-a918-482a-ab17-bf2b1058f4a4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 453, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:14Z', 'updated_at': '2021-09-18T08:41:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '52d7871c-2f26-4048-bd50-331024fd3e4c', 'name': '', 'network_id': 'dcbcf1bc-d782-4448-8e94-4151a8b0647f', 'tenant_id': 'e5499776ba4b4ca1a60a858539853303', 'mac_address': 'fa:16:3e:07:2f:af', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd2c00031-a918-482a-ab17-bf2b1058f4a4', 'device_owner': 'network:router_interface', 'standard_attr_id': 454, 'fixed_ips': [{'subnet_id': '55d4aec3-9a5a-49a9-a580-2748bcb64e49', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:16Z', 'updated_at': '2021-09-18T08:41:17Z', 'revision_number': 2, 'project_id': 'e5499776ba4b4ca1a60a858539853303', 'subnets': [{'id': '55d4aec3-9a5a-49a9-a580-2748bcb64e49', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:41:20.738480 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cecf3d4-8926-444a-853f-70c22082babc req-3dc4e495-4d66-4398-8095-68d3f9f609e8 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:20.739980 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9cecf3d4-8926-444a-853f-70c22082babc req-3dc4e495-4d66-4398-8095-68d3f9f609e8 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0559962 Sep 18 08:41:20.746343 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] Checking router: d2c00031-a918-482a-ab17-bf2b1058f4a4 for host: dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:41:20.746710 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] Updating router d2c00031-a918-482a-ab17-bf2b1058f4a4 port 52d7871c-2f26-4048-bd50-331024fd3e4c binding host dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 18 08:41:20.772051 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:20.780383 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9cecf3d4-8926-444a-853f-70c22082babc req-2c487b5b-52dd-458b-a7c5-6950884990ba tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319083 Sep 18 08:41:21.028190 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] Notify callbacks [] for port, precommit_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:21.033196 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:21.086411 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b63df72c-4ea5-48fa-8d76-82d7a8ea0456 None None] Pushing event updated for resources: {'Port': ['ID=52d7871c-2f26-4048-bd50-331024fd3e4c,revision_number=3']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:21.134993 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] Attempting to bind port 52d7871c-2f26-4048-bd50-331024fd3e4c on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:41:21.135366 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] Attempting to bind port 52d7871c-2f26-4048-bd50-331024fd3e4c by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': '6b776d8d-2b4b-44ff-bc79-dee6b1f71cff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 247, 'network_id': 'dcbcf1bc-d782-4448-8e94-4151a8b0647f'}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:41:21.135915 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] Attempting to bind port 52d7871c-2f26-4048-bd50-331024fd3e4c on network dcbcf1bc-d782-4448-8e94-4151a8b0647f {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:41:21.141484 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 40, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:41:21.141860 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] Checking segment: {'id': '6b776d8d-2b4b-44ff-bc79-dee6b1f71cff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 247, 'network_id': 'dcbcf1bc-d782-4448-8e94-4151a8b0647f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94348) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:41:21.142262 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:21.142655 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] Bound using segment: {'id': '6b776d8d-2b4b-44ff-bc79-dee6b1f71cff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 247, 'network_id': 'dcbcf1bc-d782-4448-8e94-4151a8b0647f'} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:41:21.143127 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] Bound port: 52d7871c-2f26-4048-bd50-331024fd3e4c, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '6b776d8d-2b4b-44ff-bc79-dee6b1f71cff', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 247, 'network_id': 'dcbcf1bc-d782-4448-8e94-4151a8b0647f'}}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:41:21.143506 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:21.195032 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c60585f2-9cce-4b9e-94f4-53dd4a31d2f1 req-28e16623-8e10-4aa2-a8dc-f3d65d55e045 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:21.196685 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c60585f2-9cce-4b9e-94f4-53dd4a31d2f1 req-28e16623-8e10-4aa2-a8dc-f3d65d55e045 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 944 time: 0.0523646 Sep 18 08:41:21.224544 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] For port 52d7871c-2f26-4048-bd50-331024fd3e4c, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94348) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:41:21.233677 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] For port 52d7871c-2f26-4048-bd50-331024fd3e4c, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=52d7871c-2f26-4048-bd50-331024fd3e4c,segment=NetworkSegment(6b776d8d-2b4b-44ff-bc79-dee6b1f71cff),segment_id=6b776d8d-2b4b-44ff-bc79-dee6b1f71cff)] {{(pid=94348) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:41:21.238080 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c60585f2-9cce-4b9e-94f4-53dd4a31d2f1 req-4dd7a850-fd47-4bca-9819-cf24681ef6c1 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0353239 Sep 18 08:41:21.241360 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:21.329869 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b63df72c-4ea5-48fa-8d76-82d7a8ea0456 None None] Pushing event updated for resources: {'Port': ['ID=52d7871c-2f26-4048-bd50-331024fd3e4c,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:21.332483 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] Routers {'d2c00031-a918-482a-ab17-bf2b1058f4a4'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:41:21.333048 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:40:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['d2c00031-a918-482a-ab17-bf2b1058f4a4'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:41:21.334932 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-5da681de-fe04-4676-ba28-903f761f19b3 None None] Provisioning complete for port 52d7871c-2f26-4048-bd50-331024fd3e4c triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:21.335433 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-5da681de-fe04-4676-ba28-903f761f19b3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:21.422657 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 0bfc635e-76c9-4d59-8312-62cb4d0c808d up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:41:21.520504 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] Set router d2c00031-a918-482a-ab17-bf2b1058f4a4 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:41:21.677807 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 2f2f886e-b6d3-4d02-92de-a193d7d276f7 up at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:41:21.758239 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-5da681de-fe04-4676-ba28-903f761f19b3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:21.779333 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 0bfc635e-76c9-4d59-8312-62cb4d0c808d triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:21.779632 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:21.899683 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c611459-5e71-4735-a075-9a09d97ef350 req-e4797075-6a53-49db-b3d4-6121ad0637e0 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:21.901899 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning for port 2f2f886e-b6d3-4d02-92de-a193d7d276f7 completed by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 18 08:41:21.905533 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-5da681de-fe04-4676-ba28-903f761f19b3 None None] For port 52d7871c-2f26-4048-bd50-331024fd3e4c, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=52d7871c-2f26-4048-bd50-331024fd3e4c,segment=NetworkSegment(6b776d8d-2b4b-44ff-bc79-dee6b1f71cff),segment_id=6b776d8d-2b4b-44ff-bc79-dee6b1f71cff)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:41:21.905813 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9c611459-5e71-4735-a075-9a09d97ef350 req-e4797075-6a53-49db-b3d4-6121ad0637e0 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0558865 Sep 18 08:41:21.917599 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning complete for port 2f2f886e-b6d3-4d02-92de-a193d7d276f7 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:21.917961 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:21.919378 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-5da681de-fe04-4676-ba28-903f761f19b3 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:21.940563 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9c611459-5e71-4735-a075-9a09d97ef350 req-9fbbef93-249b-4259-bba8-9885c24a6371 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0322943 Sep 18 08:41:22.076022 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5da681de-fe04-4676-ba28-903f761f19b3 None None] Pushing event updated for resources: {'Port': ['ID=52d7871c-2f26-4048-bd50-331024fd3e4c,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:22.089145 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-269ff64f-a017-4959-8cb3-abfeb813ac9c None None] Provisioning complete for port 52d7871c-2f26-4048-bd50-331024fd3e4c triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:22.089558 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-269ff64f-a017-4959-8cb3-abfeb813ac9c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:22.160249 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:22.163049 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd2c00031-a918-482a-ab17-bf2b1058f4a4', 'name': 'tempest-TestMinimumBasicScenario-2027707586-router', 'tenant_id': 'e5499776ba4b4ca1a60a858539853303', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': '0bfc635e-76c9-4d59-8312-62cb4d0c808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:14Z', 'updated_at': '2021-09-18T08:41:17Z', 'revision_number': 4, 'project_id': 'e5499776ba4b4ca1a60a858539853303', 'gw_port': {'id': '0bfc635e-76c9-4d59-8312-62cb4d0c808d', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:0a:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2c00031-a918-482a-ab17-bf2b1058f4a4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 453, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:14Z', 'updated_at': '2021-09-18T08:41:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '52d7871c-2f26-4048-bd50-331024fd3e4c', 'name': '', 'network_id': 'dcbcf1bc-d782-4448-8e94-4151a8b0647f', 'tenant_id': 'e5499776ba4b4ca1a60a858539853303', 'mac_address': 'fa:16:3e:07:2f:af', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd2c00031-a918-482a-ab17-bf2b1058f4a4', 'device_owner': 'network:router_interface', 'standard_attr_id': 454, 'fixed_ips': [{'subnet_id': '55d4aec3-9a5a-49a9-a580-2748bcb64e49', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:16Z', 'updated_at': '2021-09-18T08:41:21Z', 'revision_number': 4, 'project_id': 'e5499776ba4b4ca1a60a858539853303', 'subnets': [{'id': '55d4aec3-9a5a-49a9-a580-2748bcb64e49', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:41:22.206711 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-42c92685-377b-4258-b5aa-027d10a5c4de None None] The sync data for ids ['d2c00031-a918-482a-ab17-bf2b1058f4a4'] in dv-cinder-804470-6-iscsi is: [{'id': 'd2c00031-a918-482a-ab17-bf2b1058f4a4', 'name': 'tempest-TestMinimumBasicScenario-2027707586-router', 'tenant_id': 'e5499776ba4b4ca1a60a858539853303', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': '0bfc635e-76c9-4d59-8312-62cb4d0c808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:14Z', 'updated_at': '2021-09-18T08:41:17Z', 'revision_number': 4, 'project_id': 'e5499776ba4b4ca1a60a858539853303', 'gw_port': {'id': '0bfc635e-76c9-4d59-8312-62cb4d0c808d', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:0a:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2c00031-a918-482a-ab17-bf2b1058f4a4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 453, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:14Z', 'updated_at': '2021-09-18T08:41:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '52d7871c-2f26-4048-bd50-331024fd3e4c', 'name': '', 'network_id': 'dcbcf1bc-d782-4448-8e94-4151a8b0647f', 'tenant_id': 'e5499776ba4b4ca1a60a858539853303', 'mac_address': 'fa:16:3e:07:2f:af', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd2c00031-a918-482a-ab17-bf2b1058f4a4', 'device_owner': 'network:router_interface', 'standard_attr_id': 454, 'fixed_ips': [{'subnet_id': '55d4aec3-9a5a-49a9-a580-2748bcb64e49', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:16Z', 'updated_at': '2021-09-18T08:41:21Z', 'revision_number': 4, 'project_id': 'e5499776ba4b4ca1a60a858539853303', 'subnets': [{'id': '55d4aec3-9a5a-49a9-a580-2748bcb64e49', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:41:22.223507 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b6c407a6-4b6a-4479-911e-1c4620f28924', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2f2f886e-b6d3-4d02-92de-a193d7d276f7'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:41:22.225941 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a90548aa-07cc-4ea3-b560-bb4f8fc00d51" -d '{"events": [{"server_uuid": "b6c407a6-4b6a-4479-911e-1c4620f28924", "name": "network-vif-plugged", "status": "completed", "tag": "2f2f886e-b6d3-4d02-92de-a193d7d276f7"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:41:22.260090 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 2f2f886e-b6d3-4d02-92de-a193d7d276f7, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=2f2f886e-b6d3-4d02-92de-a193d7d276f7,segment=NetworkSegment(6dfc82da-1689-40bb-a749-6245f29bfd89),segment_id=6dfc82da-1689-40bb-a749-6245f29bfd89)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:41:22.269427 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:22.318979 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:41:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-40a2da1a-c8c4-4cb5-9c88-47a52fe3188f x-openstack-request-id: req-40a2da1a-c8c4-4cb5-9c88-47a52fe3188f {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:41:22.319500 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b6c407a6-4b6a-4479-911e-1c4620f28924", "name": "network-vif-plugged", "status": "completed", "tag": "2f2f886e-b6d3-4d02-92de-a193d7d276f7", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:41:22.319914 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-40a2da1a-c8c4-4cb5-9c88-47a52fe3188f {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:41:22.320301 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b6c407a6-4b6a-4479-911e-1c4620f28924', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2f2f886e-b6d3-4d02-92de-a193d7d276f7', 'code': 200} Sep 18 08:41:22.330053 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=2f2f886e-b6d3-4d02-92de-a193d7d276f7,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:22.416406 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-03c1e9f5-73aa-4704-bc76-18f93e5460bb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:22.435308 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a54c927a-c945-4d9b-9d18-4ad1bd27f0c6 req-7845b18d-7c07-4460-a23c-182ed60df989 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:22.436845 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a54c927a-c945-4d9b-9d18-4ad1bd27f0c6 req-7845b18d-7c07-4460-a23c-182ed60df989 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 945 time: 0.0707262 Sep 18 08:41:22.475277 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a54c927a-c945-4d9b-9d18-4ad1bd27f0c6 req-f46e5f15-4345-4055-a8be-24916ae64323 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0325193 Sep 18 08:41:22.649833 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51b05b81-b409-48ea-9868-b5fa81016707 req-7557d77e-c19a-43a9-8580-ef23f698c882 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:22.651395 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-51b05b81-b409-48ea-9868-b5fa81016707 req-7557d77e-c19a-43a9-8580-ef23f698c882 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 1098 time: 0.0515730 Sep 18 08:41:22.689525 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-51b05b81-b409-48ea-9868-b5fa81016707 req-e5c1364a-0cb4-4535-a424-da64462699a0 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0291591 Sep 18 08:41:23.068078 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83e8e4ab-9381-4918-b45a-c9901386f41f req-34570a0e-80c5-49df-ae4c-eb967457491a tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:23.069676 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-83e8e4ab-9381-4918-b45a-c9901386f41f req-34570a0e-80c5-49df-ae4c-eb967457491a tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0487814 Sep 18 08:41:23.110365 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-83e8e4ab-9381-4918-b45a-c9901386f41f req-ee370439-dc73-41d4-94ed-33ab89501856 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0339310 Sep 18 08:41:23.184872 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:23.331690 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:23.400501 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 52d7871c-2f26-4048-bd50-331024fd3e4c up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:41:23.456557 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 52d7871c-2f26-4048-bd50-331024fd3e4c triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:23.456935 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:23.596057 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89a61304-b70d-4616-b214-c070797ab0da req-dbb0f930-d497-4952-bc17-27355f44dfa1 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:23.597021 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-89a61304-b70d-4616-b214-c070797ab0da req-dbb0f930-d497-4952-bc17-27355f44dfa1 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 945 time: 0.0525770 Sep 18 08:41:23.642843 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-89a61304-b70d-4616-b214-c070797ab0da req-d63aa7db-aa44-437e-8f3d-e839c5741247 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0392323 Sep 18 08:41:24.053833 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-82cb172e-d4f1-459d-adcc-9c10cedc9672 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:24.059228 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-82cb172e-d4f1-459d-adcc-9c10cedc9672 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/networks?id=fe2753d3-7f3b-4739-adbf-6643a840c73e HTTP/1.1" status: 200 len: 815 time: 0.1160059 Sep 18 08:41:24.074249 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-23f45f1d-39b7-4e04-9579-2102cc4cc320 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/quotas/38bd82e43ad3497aa14e8e4e68a29009 HTTP/1.1" status: 200 len: 375 time: 0.0122390 Sep 18 08:41:24.132326 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-d6709c34-2c1c-4412-9610-cb30e74cf0b3 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?tenant_id=38bd82e43ad3497aa14e8e4e68a29009&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0521996 Sep 18 08:41:24.257817 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-a8b8840d-9281-4119-805d-9d6cb30c5d84 service neutron] 10.222.0.35 "GET /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1170473 Sep 18 08:41:24.285833 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fb7c409-c623-4229-b226-4586d272d861 req-fc26eacd-5556-445d-85cf-0f7f4eeb219c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:24.287490 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6fb7c409-c623-4229-b226-4586d272d861 req-fc26eacd-5556-445d-85cf-0f7f4eeb219c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0914574 Sep 18 08:41:24.374612 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6fb7c409-c623-4229-b226-4586d272d861 req-78532a4c-9dea-4b28-88c8-a12c25f974a7 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0754509 Sep 18 08:41:24.402726 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-f74df3e1-398e-4e41-bb0c-8e206bbf9ad4 service neutron] 10.222.0.35 "GET /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1330209 Sep 18 08:41:24.609103 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2d421715-a1bd-4386-8938-7618869ce914 req-54047917-5fc0-4199-9cb7-664e6b2f9dd1 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 210 time: 0.0304010 Sep 18 08:41:24.862001 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32341c55-5f18-4770-a7eb-8eb242be59ab req-f6ed484f-ab4e-469e-95bc-7e8f6bedb65e tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:24.875912 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-32341c55-5f18-4770-a7eb-8eb242be59ab req-f6ed484f-ab4e-469e-95bc-7e8f6bedb65e tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 945 time: 0.1429231 Sep 18 08:41:24.887043 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:24.960166 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-32341c55-5f18-4770-a7eb-8eb242be59ab req-f7213b5f-23f3-450f-aee9-857dab2b2963 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0785174 Sep 18 08:41:25.506161 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ce3ceea-f884-47ca-ab20-efb3070b5070 req-91dd8aaa-2d7c-4e05-a580-2579d79e46d8 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:25.514546 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2ce3ceea-f884-47ca-ab20-efb3070b5070 req-91dd8aaa-2d7c-4e05-a580-2579d79e46d8 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0602055 Sep 18 08:41:25.561862 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2ce3ceea-f884-47ca-ab20-efb3070b5070 req-bfb0eec2-5fe7-44e0-bfb0-738d3b64e1ab tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459497 Sep 18 08:41:25.721313 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a9a74fba-709e-4f63-9ab8-d46f8d6122c7 req-8078d84d-59ea-4e18-8ccb-f249a0b7bc50 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 210 time: 0.0302515 Sep 18 08:41:26.080247 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc967c70-ea93-4e9c-b4cd-ddc762e0b3ac req-d4fc8139-33cd-4150-bc49-5186cb516259 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:26.081831 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bc967c70-ea93-4e9c-b4cd-ddc762e0b3ac req-d4fc8139-33cd-4150-bc49-5186cb516259 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 945 time: 0.0545552 Sep 18 08:41:26.139857 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bc967c70-ea93-4e9c-b4cd-ddc762e0b3ac req-ea8503a1-0d8a-49da-8bd4-659289e97279 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0470629 Sep 18 08:41:26.275723 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8b2fcc5-97f5-4ec8-ab8e-7ac8d0e72787 req-723f50d5-3fcd-4ee1-bd6f-25e70943ae1d tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:26.277468 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a8b2fcc5-97f5-4ec8-ab8e-7ac8d0e72787 req-723f50d5-3fcd-4ee1-bd6f-25e70943ae1d tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 945 time: 0.0536149 Sep 18 08:41:26.319111 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a8b2fcc5-97f5-4ec8-ab8e-7ac8d0e72787 req-ff5f3350-78d2-454b-af27-77c1d39409c4 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0350122 Sep 18 08:41:26.344739 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 60678) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:41:26.665366 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee86b727-d0d4-41e7-9ecd-7dcfbe3b3b58 tempest-TestShelveInstance-900046232 tempest-TestShelveInstance-900046232-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:26.667198 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-ee86b727-d0d4-41e7-9ecd-7dcfbe3b3b58 tempest-TestShelveInstance-900046232 tempest-TestShelveInstance-900046232-project-admin] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 1093 time: 0.3206906 Sep 18 08:41:26.670769 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 60686) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:41:26.676117 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-830314dc-0787-47ca-9500-a84b880157d6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Request body: {'floatingip': {'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'port_id': '2f2f886e-b6d3-4d02-92de-a193d7d276f7', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'fixed_ip_address': '172.20.0.9'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:41:26.760683 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-830314dc-0787-47ca-9500-a84b880157d6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for floatingip, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:26.853232 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-c7a608b9-36a5-499e-8e89-1951b449a8ae tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:26.853232 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-c7a608b9-36a5-499e-8e89-1951b449a8ae tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.13 "GET /v2.0/networks?id=fe2753d3-7f3b-4739-adbf-6643a840c73e HTTP/1.1" status: 200 len: 815 time: 0.2651489 Sep 18 08:41:26.866100 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0eb2eea-4913-4446-b839-8343d239b608 req-e9344d2b-3567-4cd6-8381-32497ca97297 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:26.874756 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d0eb2eea-4913-4446-b839-8343d239b608 req-e9344d2b-3567-4cd6-8381-32497ca97297 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.1233218 Sep 18 08:41:26.897360 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-c3ed046c-9e0d-4358-8885-77c6e0625591 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Request body: {'port': {'device_id': 'd29eb9fe-297b-417b-af91-cdeca7c4c612', 'network_id': 'fe2753d3-7f3b-4739-adbf-6643a840c73e', 'admin_state_up': True, 'tenant_id': '38bd82e43ad3497aa14e8e4e68a29009'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:41:26.946914 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7da095df-2c86-4b8d-88e9-26599d5756f8 req-6adf87fd-85e9-4381-8cc9-f32b9b5df697 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 210 time: 0.0700285 Sep 18 08:41:27.049773 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d0eb2eea-4913-4446-b839-8343d239b608 req-96ed7e38-be88-4e4a-a295-756abe69adb3 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1740327 Sep 18 08:41:27.110786 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-c3ed046c-9e0d-4358-8885-77c6e0625591 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Made reservation on behalf of 38bd82e43ad3497aa14e8e4e68a29009 for: {'port': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:41:27.115034 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-c3ed046c-9e0d-4358-8885-77c6e0625591 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:27.172433 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-830314dc-0787-47ca-9500-a84b880157d6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:27.239927 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf280e3d-6a67-4867-b0da-829a0ff54c44 req-cbf30687-16f9-4be3-b13a-4ed79fdde457 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:27.241602 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cf280e3d-6a67-4867-b0da-829a0ff54c44 req-cbf30687-16f9-4be3-b13a-4ed79fdde457 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 1098 time: 0.1148005 Sep 18 08:41:27.300411 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_common [None req-830314dc-0787-47ca-9500-a84b880157d6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Allocated IP 172.27.1.43 (2e3b3f85-63e4-4380-917a-8c90c80b3e38/cd525bb9-7f93-490c-a5d6-a08911817e54/476c0246-be19-45c5-83c9-9aa64b808c49) {{(pid=94346) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:41:27.372954 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_common [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-c3ed046c-9e0d-4358-8885-77c6e0625591 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Allocated IP 172.20.0.11 (fe2753d3-7f3b-4739-adbf-6643a840c73e/b96e08ba-91b8-4c1f-bd27-4a1270ccbde2/3e95f520-0716-4198-96ec-20bb84895fe7) {{(pid=94347) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:41:27.384797 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cf280e3d-6a67-4867-b0da-829a0ff54c44 req-853b11e8-f298-4fb8-beaf-b8247494fa0a service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1280334 Sep 18 08:41:27.419245 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-830314dc-0787-47ca-9500-a84b880157d6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for port, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:27.465704 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-830314dc-0787-47ca-9500-a84b880157d6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:27.502967 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-830314dc-0787-47ca-9500-a84b880157d6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:41:27.506108 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-830314dc-0787-47ca-9500-a84b880157d6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:41:27.510119 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [None req-830314dc-0787-47ca-9500-a84b880157d6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Received port after_create {{(pid=94346) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:41:27.557726 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-c3ed046c-9e0d-4358-8885-77c6e0625591 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks [] for port, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:27.579921 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-830314dc-0787-47ca-9500-a84b880157d6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Pushing event updated for resources: {'Port': ['ID=476c0246-be19-45c5-83c9-9aa64b808c49,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:27.890548 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-c3ed046c-9e0d-4358-8885-77c6e0625591 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:27.938415 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['9a4f8ce9-f706-4c25-b3f4-05f2173cf516', '1f9a3d54-fb75-4f0c-8013-46a939823a2e', '711ec98d-b2bf-4c0b-b015-9df1011dd8ce'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:41:27.943372 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-c3ed046c-9e0d-4358-8885-77c6e0625591 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Network fe2753d3-7f3b-4739-adbf-6643a840c73e is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:41:27.946711 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-c3ed046c-9e0d-4358-8885-77c6e0625591 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:41:27.961220 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-c3ed046c-9e0d-4358-8885-77c6e0625591 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Received port after_create {{(pid=94347) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:41:28.002887 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3ed046c-9e0d-4358-8885-77c6e0625591 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Pushing event updated for resources: {'Port': ['ID=3e95f520-0716-4198-96ec-20bb84895fe7,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:28.017678 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ed046c-9e0d-4358-8885-77c6e0625591 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:28.018032 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ed046c-9e0d-4358-8885-77c6e0625591 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:28.018382 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ed046c-9e0d-4358-8885-77c6e0625591 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:28.018973 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ed046c-9e0d-4358-8885-77c6e0625591 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:28.019351 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ed046c-9e0d-4358-8885-77c6e0625591 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:28.019693 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ed046c-9e0d-4358-8885-77c6e0625591 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:28.020027 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ed046c-9e0d-4358-8885-77c6e0625591 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:28.020361 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ed046c-9e0d-4358-8885-77c6e0625591 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:28.020859 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ed046c-9e0d-4358-8885-77c6e0625591 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:28.021226 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ed046c-9e0d-4358-8885-77c6e0625591 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:28.021700 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ed046c-9e0d-4358-8885-77c6e0625591 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:28.022041 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c3ed046c-9e0d-4358-8885-77c6e0625591 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:28.036064 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-c3ed046c-9e0d-4358-8885-77c6e0625591 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:28.036710 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-c3ed046c-9e0d-4358-8885-77c6e0625591 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:28.064316 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-c3ed046c-9e0d-4358-8885-77c6e0625591 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.1800857 Sep 18 08:41:28.091811 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-1bb76008-2563-4cad-b48b-69b03a67628b service neutron] Request body: {'port': {'device_id': 'd29eb9fe-297b-417b-af91-cdeca7c4c612', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80447'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:41:28.174713 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-1bb76008-2563-4cad-b48b-69b03a67628b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:28.222713 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e226abc-c56d-4118-8944-cad984755538 req-9f5980f6-a5f2-4272-83e7-75709612c0e7 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:28.230581 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-830314dc-0787-47ca-9500-a84b880157d6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for floatingip, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:28.231472 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2e226abc-c56d-4118-8944-cad984755538 req-9f5980f6-a5f2-4272-83e7-75709612c0e7 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 932 time: 0.1539879 Sep 18 08:41:28.365498 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-830314dc-0787-47ca-9500-a84b880157d6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:28.385793 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2e226abc-c56d-4118-8944-cad984755538 req-4dd3160d-c724-4fc3-8bbf-a76bb7f49b41 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1489537 Sep 18 08:41:28.418110 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c61305ed-c81b-4fd4-903a-2dead4033579 req-ab500387-02e3-4cb5-83ac-f3af00059360 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:28.422384 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c61305ed-c81b-4fd4-903a-2dead4033579 req-ab500387-02e3-4cb5-83ac-f3af00059360 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.1865144 Sep 18 08:41:28.540285 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c61305ed-c81b-4fd4-903a-2dead4033579 req-e1e2860c-2963-41a4-bad7-2d935208859a tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0747383 Sep 18 08:41:28.592373 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-830314dc-0787-47ca-9500-a84b880157d6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for port, precommit_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:28.600464 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-830314dc-0787-47ca-9500-a84b880157d6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14290155'] for port, after_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:28.660511 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-1bb76008-2563-4cad-b48b-69b03a67628b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3e95f520-0716-4198-96ec-20bb84895fe7 {{(pid=94347) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:41:28.668204 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-1bb76008-2563-4cad-b48b-69b03a67628b service neutron] Notify callbacks [] for port, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:28.678124 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-830314dc-0787-47ca-9500-a84b880157d6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Pushing event updated for resources: {'Port': ['ID=476c0246-be19-45c5-83c9-9aa64b808c49,revision_number=2']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:28.684381 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.provisioning_blocks [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-1bb76008-2563-4cad-b48b-69b03a67628b service neutron] Transition to ACTIVE for port object 3e95f520-0716-4198-96ec-20bb84895fe7 will not be triggered until provisioned by entity L2. {{(pid=94347) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 18 08:41:28.686297 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-830314dc-0787-47ca-9500-a84b880157d6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-784908'] for floatingip, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:28.692352 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-1bb76008-2563-4cad-b48b-69b03a67628b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:28.751949 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bb76008-2563-4cad-b48b-69b03a67628b service neutron] Pushing event updated for resources: {'Port': ['ID=3e95f520-0716-4198-96ec-20bb84895fe7,revision_number=2']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:28.800981 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.db.l3_db [None req-830314dc-0787-47ca-9500-a84b880157d6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Floating IP 5ba46ac2-2b32-4120-9e3c-946b63c051ee associated. External IP: 172.27.1.43, port: 2f2f886e-b6d3-4d02-92de-a193d7d276f7. Sep 18 08:41:28.841017 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-1bb76008-2563-4cad-b48b-69b03a67628b service neutron] Attempting to bind port 3e95f520-0716-4198-96ec-20bb84895fe7 on host hv-cinder-80447 for vnic_type normal with profile {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:41:28.841429 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-1bb76008-2563-4cad-b48b-69b03a67628b service neutron] Attempting to bind port 3e95f520-0716-4198-96ec-20bb84895fe7 by drivers openvswitch,hyperv on host hv-cinder-80447 at level 0 using segments [{'id': 'd1432479-9c27-42c4-87db-6905e7868675', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 233, 'network_id': 'fe2753d3-7f3b-4739-adbf-6643a840c73e'}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:41:28.842156 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-1bb76008-2563-4cad-b48b-69b03a67628b service neutron] Attempting to bind port 3e95f520-0716-4198-96ec-20bb84895fe7 on network fe2753d3-7f3b-4739-adbf-6643a840c73e {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:41:28.848018 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-1bb76008-2563-4cad-b48b-69b03a67628b service neutron] Port 3e95f520-0716-4198-96ec-20bb84895fe7 on network fe2753d3-7f3b-4739-adbf-6643a840c73e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80447 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 18 08:41:28.848330 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-1bb76008-2563-4cad-b48b-69b03a67628b service neutron] Attempting to bind port 3e95f520-0716-4198-96ec-20bb84895fe7 on network fe2753d3-7f3b-4739-adbf-6643a840c73e {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:41:28.855157 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-1bb76008-2563-4cad-b48b-69b03a67628b service neutron] Checking agent: {'id': '8d51fdc4-974b-4200-9c3f-5dddea60a869', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80447', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'started_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 41, 20), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:41:28.856078 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-1bb76008-2563-4cad-b48b-69b03a67628b service neutron] Checking segment: {'id': 'd1432479-9c27-42c4-87db-6905e7868675', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 233, 'network_id': 'fe2753d3-7f3b-4739-adbf-6643a840c73e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94347) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:41:28.856482 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-1bb76008-2563-4cad-b48b-69b03a67628b service neutron] Bound using segment: {'id': 'd1432479-9c27-42c4-87db-6905e7868675', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 233, 'network_id': 'fe2753d3-7f3b-4739-adbf-6643a840c73e'} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:41:28.856926 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-1bb76008-2563-4cad-b48b-69b03a67628b service neutron] Bound port: 3e95f520-0716-4198-96ec-20bb84895fe7, host: hv-cinder-80447, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd1432479-9c27-42c4-87db-6905e7868675', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 233, 'network_id': 'fe2753d3-7f3b-4739-adbf-6643a840c73e'}}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:41:28.857341 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-1bb76008-2563-4cad-b48b-69b03a67628b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:28.965072 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-1bb76008-2563-4cad-b48b-69b03a67628b service neutron] For port 3e95f520-0716-4198-96ec-20bb84895fe7, host hv-cinder-80447, cleared binding levels {{(pid=94347) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:41:28.971477 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-1bb76008-2563-4cad-b48b-69b03a67628b service neutron] For port 3e95f520-0716-4198-96ec-20bb84895fe7, host hv-cinder-80447, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=3e95f520-0716-4198-96ec-20bb84895fe7,segment=NetworkSegment(d1432479-9c27-42c4-87db-6905e7868675),segment_id=d1432479-9c27-42c4-87db-6905e7868675)] {{(pid=94347) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:41:28.991792 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-1bb76008-2563-4cad-b48b-69b03a67628b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:29.031386 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-1bb76008-2563-4cad-b48b-69b03a67628b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:29.032335 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-1bb76008-2563-4cad-b48b-69b03a67628b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:29.034094 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-1bb76008-2563-4cad-b48b-69b03a67628b service neutron] 10.222.0.13 "PUT /v2.0/ports/3e95f520-0716-4198-96ec-20bb84895fe7 HTTP/1.1" status: 200 len: 1094 time: 0.9467406 Sep 18 08:41:29.034779 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd29eb9fe-297b-417b-af91-cdeca7c4c612', 'tag': '3e95f520-0716-4198-96ec-20bb84895fe7'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:41:29.037471 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c7a81d6a-3bda-4f43-adf8-2deb916a1c85" -d '{"events": [{"name": "network-changed", "server_uuid": "d29eb9fe-297b-417b-af91-cdeca7c4c612", "tag": "3e95f520-0716-4198-96ec-20bb84895fe7"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:41:29.098685 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-830314dc-0787-47ca-9500-a84b880157d6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Router d221b587-201f-4923-926d-02481e296d23 has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94346) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:41:29.103523 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:41:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9eed4755-07a6-475b-8bdd-3d8831ec3214 x-openstack-request-id: req-9eed4755-07a6-475b-8bdd-3d8831ec3214 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:41:29.103814 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d29eb9fe-297b-417b-af91-cdeca7c4c612", "tag": "3e95f520-0716-4198-96ec-20bb84895fe7", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:41:29.104068 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-9eed4755-07a6-475b-8bdd-3d8831ec3214 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:41:29.104470 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd29eb9fe-297b-417b-af91-cdeca7c4c612', 'tag': '3e95f520-0716-4198-96ec-20bb84895fe7', 'status': 'completed', 'code': 200} Sep 18 08:41:29.105439 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bb76008-2563-4cad-b48b-69b03a67628b service neutron] Pushing event updated for resources: {'Port': ['ID=3e95f520-0716-4198-96ec-20bb84895fe7,revision_number=3']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:29.229948 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-830314dc-0787-47ca-9500-a84b880157d6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94346) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:41:29.243305 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b523bb64-d250-480e-ab57-dcc6cac013dd None None] Sync routers for ids ['d221b587-201f-4923-926d-02481e296d23'] in dv-cinder-804470-6-iscsi {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:41:29.259669 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-830314dc-0787-47ca-9500-a84b880157d6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for floatingip, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:29.266840 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b523bb64-d250-480e-ab57-dcc6cac013dd None None] Routers {'d221b587-201f-4923-926d-02481e296d23'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:41:29.267458 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-b523bb64-d250-480e-ab57-dcc6cac013dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:41:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['d221b587-201f-4923-926d-02481e296d23'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:41:29.301318 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-830314dc-0787-47ca-9500-a84b880157d6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.6164308 Sep 18 08:41:29.301318 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b6c407a6-4b6a-4479-911e-1c4620f28924', 'tag': '2f2f886e-b6d3-4d02-92de-a193d7d276f7'}] {{(pid=94346) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:41:29.301318 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9c65146fa140f7f105fbfe1cfc0ed8a4aa4ddea85af05f4a70363726e3aa059" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-09ae692e-e1fd-43be-b0c7-17f5821cdc05" -d '{"events": [{"name": "network-changed", "server_uuid": "b6c407a6-4b6a-4479-911e-1c4620f28924", "tag": "2f2f886e-b6d3-4d02-92de-a193d7d276f7"}]}' {{(pid=94346) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:41:29.378328 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:41:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-441694b0-0a65-480e-81e5-1c4a98263111 x-openstack-request-id: req-441694b0-0a65-480e-81e5-1c4a98263111 {{(pid=94346) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:41:29.379020 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b6c407a6-4b6a-4479-911e-1c4620f28924", "tag": "2f2f886e-b6d3-4d02-92de-a193d7d276f7", "status": "completed", "code": 200}]} {{(pid=94346) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:41:29.379499 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-441694b0-0a65-480e-81e5-1c4a98263111 {{(pid=94346) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:41:29.380142 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b6c407a6-4b6a-4479-911e-1c4620f28924', 'tag': '2f2f886e-b6d3-4d02-92de-a193d7d276f7', 'status': 'completed', 'code': 200} Sep 18 08:41:29.393244 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-330b2af1-eaf8-4889-b8d0-7a7cb445b3a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:29.395114 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-330b2af1-eaf8-4889-b8d0-7a7cb445b3a2 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=38bd82e43ad3497aa14e8e4e68a29009&device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 1097 time: 0.0651183 Sep 18 08:41:29.435503 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-b523bb64-d250-480e-ab57-dcc6cac013dd None None] Set router d221b587-201f-4923-926d-02481e296d23 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:41:29.561691 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-0018ffeb-7ac9-4d22-897d-995ae314d17d service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=3e95f520-0716-4198-96ec-20bb84895fe7 HTTP/1.1" status: 200 len: 217 time: 0.0605853 Sep 18 08:41:29.648652 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a39d208d-8c95-4fd9-88ed-aa1075b9f326 req-a6042463-97ce-4bc9-bc31-4ada46a9c8e1 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:29.659060 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a39d208d-8c95-4fd9-88ed-aa1075b9f326 req-a6042463-97ce-4bc9-bc31-4ada46a9c8e1 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 944 time: 0.2057126 Sep 18 08:41:29.719800 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09ae692e-e1fd-43be-b0c7-17f5821cdc05 req-57a8cf2e-073c-4d87-ad79-31f8f1704ce8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:29.721462 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-09ae692e-e1fd-43be-b0c7-17f5821cdc05 req-57a8cf2e-073c-4d87-ad79-31f8f1704ce8 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=467aba0ce03e40a6927a5c05223dd512&device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 1098 time: 0.1724093 Sep 18 08:41:29.740220 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-241a46e1-12b1-4272-bf35-ea4f61c10306 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:29.741092 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-241a46e1-12b1-4272-bf35-ea4f61c10306 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=b96e08ba-91b8-4c1f-bd27-4a1270ccbde2 HTTP/1.1" status: 200 len: 855 time: 0.1608725 Sep 18 08:41:29.755174 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-b523bb64-d250-480e-ab57-dcc6cac013dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd221b587-201f-4923-926d-02481e296d23', 'name': 'tempest-TestShelveInstance-734449530-router', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.84'}], 'enable_snat': True}, 'gw_port_id': 'bd096082-b42e-4e6d-a36f-afdc95ef9ae4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:39:48Z', 'updated_at': '2021-09-18T08:39:52Z', 'revision_number': 4, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'gw_port': {'id': 'bd096082-b42e-4e6d-a36f-afdc95ef9ae4', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:ed:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd221b587-201f-4923-926d-02481e296d23', 'device_owner': 'network:router_gateway', 'standard_attr_id': 303, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:49Z', 'updated_at': '2021-09-18T08:39:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': '5ba46ac2-2b32-4120-9e3c-946b63c051ee', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'floating_ip_address': '172.27.1.43', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': 'd221b587-201f-4923-926d-02481e296d23', 'port_id': '2f2f886e-b6d3-4d02-92de-a193d7d276f7', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 457, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca', 'mac_address': 'fa:16:3e:a6:2f:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b6c407a6-4b6a-4479-911e-1c4620f28924', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:41:27Z', 'updated_at': '2021-09-18T08:41:27Z', 'revision_number': 0, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '23821731-be27-4d6b-834b-f6953b4d873a', 'name': '', 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'mac_address': 'fa:16:3e:47:27:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd221b587-201f-4923-926d-02481e296d23', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': '58e9d53a-333d-4a2f-a575-92c9de3fb737', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:51Z', 'updated_at': '2021-09-18T08:39:58Z', 'revision_number': 5, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'subnets': [{'id': '58e9d53a-333d-4a2f-a575-92c9de3fb737', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:41:29.790514 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a39d208d-8c95-4fd9-88ed-aa1075b9f326 req-7932c273-15dc-4a68-b710-3f7dae39ce4b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1303885 Sep 18 08:41:29.792065 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b523bb64-d250-480e-ab57-dcc6cac013dd None None] Checking router: d221b587-201f-4923-926d-02481e296d23 for host: dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:41:29.814022 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b523bb64-d250-480e-ab57-dcc6cac013dd None None] Routers {'d221b587-201f-4923-926d-02481e296d23'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:41:29.814673 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-b523bb64-d250-480e-ab57-dcc6cac013dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:41:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['d221b587-201f-4923-926d-02481e296d23'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:41:29.819105 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-a60a1a82-44aa-43cb-8ebe-de0b3709be4d service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fe2753d3-7f3b-4739-adbf-6643a840c73e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0658405 Sep 18 08:41:29.887360 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8163f56-bd41-4b2d-90cb-8c9a20de43fb req-6a9df565-5a0e-449e-8c47-65a417d63938 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:29.903715 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8163f56-bd41-4b2d-90cb-8c9a20de43fb req-6a9df565-5a0e-449e-8c47-65a417d63938 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.2312074 Sep 18 08:41:29.969902 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-b523bb64-d250-480e-ab57-dcc6cac013dd None None] Set router d221b587-201f-4923-926d-02481e296d23 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:41:29.997326 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09ae692e-e1fd-43be-b0c7-17f5821cdc05 req-3c4ae171-4651-448b-8335-f4c752fd3835 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:29.998697 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-09ae692e-e1fd-43be-b0c7-17f5821cdc05 req-3c4ae171-4651-448b-8335-f4c752fd3835 service neutron] 10.222.0.13 "GET /v2.0/networks?id=c81b2232-3aba-4f15-b8f1-a71826c8c1ca HTTP/1.1" status: 200 len: 909 time: 0.2610860 Sep 18 08:41:30.135897 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8163f56-bd41-4b2d-90cb-8c9a20de43fb req-093c80c7-8c4d-454b-b8d1-fd3aec77523c tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2228277 Sep 18 08:41:30.142097 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-09ae692e-e1fd-43be-b0c7-17f5821cdc05 req-a8bd9d53-79da-42d9-acec-b2616d2e50d2 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=2f2f886e-b6d3-4d02-92de-a193d7d276f7 HTTP/1.1" status: 200 len: 998 time: 0.1215250 Sep 18 08:41:30.145740 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-313c6d28-3190-440a-96d9-26241b9c65e2 service neutron] 10.222.0.13 "GET /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3171711 Sep 18 08:41:30.274799 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09ae692e-e1fd-43be-b0c7-17f5821cdc05 req-72669976-2072-4b11-a9fe-e3d9847b1d54 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:30.278652 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-09ae692e-e1fd-43be-b0c7-17f5821cdc05 req-72669976-2072-4b11-a9fe-e3d9847b1d54 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=58e9d53a-333d-4a2f-a575-92c9de3fb737 HTTP/1.1" status: 200 len: 847 time: 0.1207886 Sep 18 08:41:30.292009 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-b523bb64-d250-480e-ab57-dcc6cac013dd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd221b587-201f-4923-926d-02481e296d23', 'name': 'tempest-TestShelveInstance-734449530-router', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.84'}], 'enable_snat': True}, 'gw_port_id': 'bd096082-b42e-4e6d-a36f-afdc95ef9ae4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:39:48Z', 'updated_at': '2021-09-18T08:39:52Z', 'revision_number': 4, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'gw_port': {'id': 'bd096082-b42e-4e6d-a36f-afdc95ef9ae4', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:ed:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd221b587-201f-4923-926d-02481e296d23', 'device_owner': 'network:router_gateway', 'standard_attr_id': 303, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:49Z', 'updated_at': '2021-09-18T08:39:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': '5ba46ac2-2b32-4120-9e3c-946b63c051ee', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'floating_ip_address': '172.27.1.43', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': 'd221b587-201f-4923-926d-02481e296d23', 'port_id': '2f2f886e-b6d3-4d02-92de-a193d7d276f7', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 457, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca', 'mac_address': 'fa:16:3e:a6:2f:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b6c407a6-4b6a-4479-911e-1c4620f28924', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:41:27Z', 'updated_at': '2021-09-18T08:41:27Z', 'revision_number': 0, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '23821731-be27-4d6b-834b-f6953b4d873a', 'name': '', 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'mac_address': 'fa:16:3e:47:27:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd221b587-201f-4923-926d-02481e296d23', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': '58e9d53a-333d-4a2f-a575-92c9de3fb737', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:51Z', 'updated_at': '2021-09-18T08:39:58Z', 'revision_number': 5, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'subnets': [{'id': '58e9d53a-333d-4a2f-a575-92c9de3fb737', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:41:30.336047 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b523bb64-d250-480e-ab57-dcc6cac013dd None None] The sync data for ids ['d221b587-201f-4923-926d-02481e296d23'] in dv-cinder-804470-6-iscsi is: [{'id': 'd221b587-201f-4923-926d-02481e296d23', 'name': 'tempest-TestShelveInstance-734449530-router', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.84'}], 'enable_snat': True}, 'gw_port_id': 'bd096082-b42e-4e6d-a36f-afdc95ef9ae4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:39:48Z', 'updated_at': '2021-09-18T08:39:52Z', 'revision_number': 4, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'gw_port': {'id': 'bd096082-b42e-4e6d-a36f-afdc95ef9ae4', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:ed:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd221b587-201f-4923-926d-02481e296d23', 'device_owner': 'network:router_gateway', 'standard_attr_id': 303, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:49Z', 'updated_at': '2021-09-18T08:39:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': '5ba46ac2-2b32-4120-9e3c-946b63c051ee', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'floating_ip_address': '172.27.1.43', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': 'd221b587-201f-4923-926d-02481e296d23', 'port_id': '2f2f886e-b6d3-4d02-92de-a193d7d276f7', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 457, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca', 'mac_address': 'fa:16:3e:a6:2f:3c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b6c407a6-4b6a-4479-911e-1c4620f28924', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:41:27Z', 'updated_at': '2021-09-18T08:41:27Z', 'revision_number': 0, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '23821731-be27-4d6b-834b-f6953b4d873a', 'name': '', 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'mac_address': 'fa:16:3e:47:27:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd221b587-201f-4923-926d-02481e296d23', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': '58e9d53a-333d-4a2f-a575-92c9de3fb737', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:51Z', 'updated_at': '2021-09-18T08:39:58Z', 'revision_number': 5, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'subnets': [{'id': '58e9d53a-333d-4a2f-a575-92c9de3fb737', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:41:30.339239 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a3e12cfe-2820-441d-946a-a1e65b220244 req-404231f6-d84c-468f-99d1-968643c92288 service neutron] 10.222.0.13 "GET /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1674590 Sep 18 08:41:30.352966 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09ae692e-e1fd-43be-b0c7-17f5821cdc05 req-d16661b0-9e2b-479e-8ac7-f984f0f1d24c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:30.364337 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-09ae692e-e1fd-43be-b0c7-17f5821cdc05 req-d16661b0-9e2b-479e-8ac7-f984f0f1d24c service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=c81b2232-3aba-4f15-b8f1-a71826c8c1ca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0754395 Sep 18 08:41:30.564985 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-09ae692e-e1fd-43be-b0c7-17f5821cdc05 req-c19ea4ad-0c2c-4a03-9ff1-1bc6aa37ea6d service neutron] 10.222.0.13 "GET /v2.0/networks/c81b2232-3aba-4f15-b8f1-a71826c8c1ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1910675 Sep 18 08:41:30.637969 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7a81d6a-3bda-4f43-adf8-2deb916a1c85 req-ccb105df-e350-4649-989e-0f3dd22f3284 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:30.639694 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c7a81d6a-3bda-4f43-adf8-2deb916a1c85 req-ccb105df-e350-4649-989e-0f3dd22f3284 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=38bd82e43ad3497aa14e8e4e68a29009&device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 1097 time: 0.1678216 Sep 18 08:41:30.675242 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f7968e12-3a39-44fd-b895-109bab9d8dd5 None None] New status for floating IP 5ba46ac2-2b32-4120-9e3c-946b63c051ee: ACTIVE {{(pid=94348) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 18 08:41:30.779296 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-886d60a5-8d49-4b14-8173-cfc77cc880da req-bbbdb8fc-85f4-4016-ab62-00f71f0e7f7a tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:30.780992 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-886d60a5-8d49-4b14-8173-cfc77cc880da req-bbbdb8fc-85f4-4016-ab62-00f71f0e7f7a tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.2679400 Sep 18 08:41:30.794330 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5e20800-477d-49ef-8084-7445976f8136 req-7f3118f4-464e-4515-b61a-117010e8fd56 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:30.795986 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a5e20800-477d-49ef-8084-7445976f8136 req-7f3118f4-464e-4515-b61a-117010e8fd56 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=f439efa4eed0456ab2a914377e490fad&device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 1098 time: 0.2613037 Sep 18 08:41:30.839353 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-09ae692e-e1fd-43be-b0c7-17f5821cdc05 req-4dbc8912-6283-4c40-b1fc-528454bb00d8 service neutron] 10.222.0.13 "GET /v2.0/networks/c81b2232-3aba-4f15-b8f1-a71826c8c1ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2544079 Sep 18 08:41:30.887890 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7a81d6a-3bda-4f43-adf8-2deb916a1c85 req-ebd7a800-2bef-4042-b352-9bf549c7f668 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:30.889549 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c7a81d6a-3bda-4f43-adf8-2deb916a1c85 req-ebd7a800-2bef-4042-b352-9bf549c7f668 service neutron] 10.222.0.13 "GET /v2.0/networks?id=fe2753d3-7f3b-4739-adbf-6643a840c73e HTTP/1.1" status: 200 len: 916 time: 0.2336586 Sep 18 08:41:30.922904 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-886d60a5-8d49-4b14-8173-cfc77cc880da req-cc1858ff-358a-4dd3-b7b0-e0741418999a tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1308658 Sep 18 08:41:30.991849 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c7a81d6a-3bda-4f43-adf8-2deb916a1c85 req-0362c0fd-b45e-4d72-a3f4-c456631dcd81 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=3e95f520-0716-4198-96ec-20bb84895fe7 HTTP/1.1" status: 200 len: 217 time: 0.0650778 Sep 18 08:41:31.078836 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5e20800-477d-49ef-8084-7445976f8136 req-7b148aa2-0ae2-4744-9c4c-f45e2f3f355e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:31.080323 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a5e20800-477d-49ef-8084-7445976f8136 req-7b148aa2-0ae2-4744-9c4c-f45e2f3f355e service neutron] 10.222.0.13 "GET /v2.0/networks?id=fdcbc66e-323e-4b44-be97-566949f4f2ef HTTP/1.1" status: 200 len: 919 time: 0.2646110 Sep 18 08:41:31.100124 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7a81d6a-3bda-4f43-adf8-2deb916a1c85 req-9e2424cb-be32-4432-8a03-f7b0518f0e49 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:31.100266 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c7a81d6a-3bda-4f43-adf8-2deb916a1c85 req-9e2424cb-be32-4432-8a03-f7b0518f0e49 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=b96e08ba-91b8-4c1f-bd27-4a1270ccbde2 HTTP/1.1" status: 200 len: 855 time: 0.0883934 Sep 18 08:41:31.109898 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-435c8509-31ad-417c-93b5-317ee7408fe4 req-f68e8345-de2c-4f34-802c-2d0b294575f6 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:31.116870 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-435c8509-31ad-417c-93b5-317ee7408fe4 req-f68e8345-de2c-4f34-802c-2d0b294575f6 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 944 time: 0.1901059 Sep 18 08:41:31.168908 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a5e20800-477d-49ef-8084-7445976f8136 req-3944af55-3635-42c6-8efc-d71d933c3379 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b03411eb-66ff-4691-88c8-2c570d78c323 HTTP/1.1" status: 200 len: 217 time: 0.0675633 Sep 18 08:41:31.199028 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c7a81d6a-3bda-4f43-adf8-2deb916a1c85 req-32d41b45-d4d4-4b36-8969-ef0fd64ce089 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fe2753d3-7f3b-4739-adbf-6643a840c73e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0777650 Sep 18 08:41:31.263351 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-435c8509-31ad-417c-93b5-317ee7408fe4 req-f7a18b7a-973b-4593-bd67-1544bc400301 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1456327 Sep 18 08:41:31.306038 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5e20800-477d-49ef-8084-7445976f8136 req-e28e4dd9-cfd2-4e2a-8b9c-06744b75cef7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:31.307555 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a5e20800-477d-49ef-8084-7445976f8136 req-e28e4dd9-cfd2-4e2a-8b9c-06744b75cef7 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=e5dc6eef-e778-41a2-a708-c7810ade97db HTTP/1.1" status: 200 len: 858 time: 0.1189601 Sep 18 08:41:31.345476 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a5e20800-477d-49ef-8084-7445976f8136 req-de3dfbec-a81a-4135-b380-6f11b4011eb6 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=fdcbc66e-323e-4b44-be97-566949f4f2ef&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0289297 Sep 18 08:41:31.376516 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c7a81d6a-3bda-4f43-adf8-2deb916a1c85 req-06673d57-c9c0-4c39-81fd-b66b21ba1243 service neutron] 10.222.0.13 "GET /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1502881 Sep 18 08:41:31.523677 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a5e20800-477d-49ef-8084-7445976f8136 req-b2ca2704-ff8f-4fdf-a63f-4d848ee98f45 service neutron] 10.222.0.13 "GET /v2.0/networks/fdcbc66e-323e-4b44-be97-566949f4f2ef?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1654420 Sep 18 08:41:31.530129 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c7a81d6a-3bda-4f43-adf8-2deb916a1c85 req-000e33c0-6ca2-45a5-822f-ac0bf35b1d88 service neutron] 10.222.0.13 "GET /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1437652 Sep 18 08:41:31.641781 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a5e20800-477d-49ef-8084-7445976f8136 req-a3f6db38-bfbd-4675-8272-41f4aca4034f service neutron] 10.222.0.13 "GET /v2.0/networks/fdcbc66e-323e-4b44-be97-566949f4f2ef?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0866091 Sep 18 08:41:32.053625 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d664d50-67f1-4da2-9d66-a74ffcd85e21 req-66412c2e-de1b-467f-b020-4d404038a448 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:32.055837 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9d664d50-67f1-4da2-9d66-a74ffcd85e21 req-66412c2e-de1b-467f-b020-4d404038a448 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0606561 Sep 18 08:41:32.109675 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9d664d50-67f1-4da2-9d66-a74ffcd85e21 req-a692526d-e7df-40c1-b469-2cdb45b5d2ba tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435274 Sep 18 08:41:32.381498 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a556078-77e4-4c10-abeb-cb147ccd01e3 req-449ef99e-e804-4925-b7b0-1da3466238c8 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:32.383008 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1a556078-77e4-4c10-abeb-cb147ccd01e3 req-449ef99e-e804-4925-b7b0-1da3466238c8 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 944 time: 0.0488040 Sep 18 08:41:32.433471 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1a556078-77e4-4c10-abeb-cb147ccd01e3 req-2ac73bf4-706e-4d87-a5a3-4c7be96071d7 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0399344 Sep 18 08:41:33.245145 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2c03d2c-1b7d-457d-979e-c8781f3f68da req-4f643f40-2fb1-47d9-a1cd-51254adcc0a6 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:33.247034 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f2c03d2c-1b7d-457d-979e-c8781f3f68da req-4f643f40-2fb1-47d9-a1cd-51254adcc0a6 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0609763 Sep 18 08:41:33.302170 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f2c03d2c-1b7d-457d-979e-c8781f3f68da req-68da6bf3-e3d1-4fd5-8720-9dd0ab1a9291 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0478225 Sep 18 08:41:33.548564 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8229582-3bd6-46f7-be38-98f1e484d1dd req-b24d6aa1-37ac-4095-b296-150ba212fdd2 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:33.557286 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e8229582-3bd6-46f7-be38-98f1e484d1dd req-b24d6aa1-37ac-4095-b296-150ba212fdd2 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 944 time: 0.0617635 Sep 18 08:41:33.822682 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e8229582-3bd6-46f7-be38-98f1e484d1dd req-f37ee072-9445-4fd3-8baf-64f00e6f2aae tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2644031 Sep 18 08:41:34.421037 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1db839b-ff3a-4ca4-bed1-e32556db8da0 req-b4503fab-02ff-4fbc-a9d7-ee972ef1d637 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:34.422466 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e1db839b-ff3a-4ca4-bed1-e32556db8da0 req-b4503fab-02ff-4fbc-a9d7-ee972ef1d637 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0508523 Sep 18 08:41:34.459979 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e1db839b-ff3a-4ca4-bed1-e32556db8da0 req-cb2fc4fd-54ff-4540-84ff-1768bc538109 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0316687 Sep 18 08:41:34.943692 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c8e6066-a7c6-4273-a040-2bf95c922639 req-2b268118-66da-4bce-994b-f5845a0f1c9c tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:34.945297 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2c8e6066-a7c6-4273-a040-2bf95c922639 req-2b268118-66da-4bce-994b-f5845a0f1c9c tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 944 time: 0.0491948 Sep 18 08:41:34.983835 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2c8e6066-a7c6-4273-a040-2bf95c922639 req-00bf234f-3784-470b-9d4e-3df572bf385e tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0320184 Sep 18 08:41:35.121342 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-aac2ce2b-0110-4745-8ed0-c94efa50a5f1 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:35.122711 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-aac2ce2b-0110-4745-8ed0-c94efa50a5f1 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/networks?id=48bd9423-5b85-4344-9434-17e10e227731 HTTP/1.1" status: 200 len: 815 time: 0.1002898 Sep 18 08:41:35.137786 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-028facce-a5e7-43e3-80bc-e5930de5302b tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/quotas/62a8d3b5ed4d4fe085db724f264e25c4 HTTP/1.1" status: 200 len: 375 time: 0.0094452 Sep 18 08:41:35.185697 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-08d4bdd4-5d9f-467f-a9cc-93314fef843b tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?tenant_id=62a8d3b5ed4d4fe085db724f264e25c4&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0428658 Sep 18 08:41:35.287294 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-7d7e1998-da94-420b-8e38-9f33def766f2 service neutron] 10.222.0.35 "GET /v2.0/networks/48bd9423-5b85-4344-9434-17e10e227731?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0884123 Sep 18 08:41:35.375385 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-f5961980-763d-4fd3-808f-48078c54cf90 service neutron] 10.222.0.35 "GET /v2.0/networks/48bd9423-5b85-4344-9434-17e10e227731?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0818102 Sep 18 08:41:35.533458 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-987d31e7-adf2-4c87-9e5e-be5b8c7360c4 req-747d6eb6-2419-41a9-9e6b-bcf390b86868 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 210 time: 0.0311768 Sep 18 08:41:35.580162 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b466b9f-bfae-4cc8-9832-e9d02133cdc3 req-7980150c-83db-439d-b4a6-2a7efe02f18e tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:35.581695 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1b466b9f-bfae-4cc8-9832-e9d02133cdc3 req-7980150c-83db-439d-b4a6-2a7efe02f18e tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0506618 Sep 18 08:41:35.619669 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1b466b9f-bfae-4cc8-9832-e9d02133cdc3 req-5e261ce4-481b-4eca-a5d0-f43235a00147 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0317712 Sep 18 08:41:35.689186 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 3e95f520-0716-4198-96ec-20bb84895fe7 details requested by agent hyperv_hv-cinder-80447 with host hv-cinder-80447 {{(pid=94348) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 18 08:41:35.784959 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 3e95f520-0716-4198-96ec-20bb84895fe7, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=3e95f520-0716-4198-96ec-20bb84895fe7,segment=NetworkSegment(d1432479-9c27-42c4-87db-6905e7868675),segment_id=d1432479-9c27-42c4-87db-6905e7868675)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:41:35.796437 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Returning: {'device': '3e95f520-0716-4198-96ec-20bb84895fe7', 'network_id': 'fe2753d3-7f3b-4739-adbf-6643a840c73e', 'port_id': '3e95f520-0716-4198-96ec-20bb84895fe7', 'mac_address': 'fa:16:3e:b1:29:e3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 233, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b96e08ba-91b8-4c1f-bd27-4a1270ccbde2', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94348) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 18 08:41:35.839356 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:35.853166 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3e95f520-0716-4198-96ec-20bb84895fe7 {{(pid=94348) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:41:35.872667 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 3e95f520-0716-4198-96ec-20bb84895fe7, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=3e95f520-0716-4198-96ec-20bb84895fe7,segment=NetworkSegment(d1432479-9c27-42c4-87db-6905e7868675),segment_id=d1432479-9c27-42c4-87db-6905e7868675)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:41:35.877449 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:35.924837 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=3e95f520-0716-4198-96ec-20bb84895fe7,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:36.095730 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c4952b9-c307-454a-b01e-c94777d6c739 req-475fee19-873c-4c0b-9585-387f85f2d56b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:36.097199 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4c4952b9-c307-454a-b01e-c94777d6c739 req-475fee19-873c-4c0b-9585-387f85f2d56b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 945 time: 0.0477567 Sep 18 08:41:36.133971 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4c4952b9-c307-454a-b01e-c94777d6c739 req-449ba3fd-203a-4b84-afbc-356543d73a11 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0301845 Sep 18 08:41:36.544096 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['3e95f520-0716-4198-96ec-20bb84895fe7'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:41:36.634297 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-16c3ba93-573e-4cde-8515-833d0c05b589 req-f61e0e5f-8b5d-4a3f-91d4-42a8f8c89ee3 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 210 time: 0.0296893 Sep 18 08:41:36.799705 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-704aed15-ed8c-4d3c-be87-06824a9b3067 req-bffeb735-7c26-472b-afc2-0bc01004dc1f tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:36.801156 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-704aed15-ed8c-4d3c-be87-06824a9b3067 req-bffeb735-7c26-472b-afc2-0bc01004dc1f tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.1062312 Sep 18 08:41:36.828624 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-b85aaca4-ac8e-4024-aee3-5451a7fd440c tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:36.830081 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-b85aaca4-ac8e-4024-aee3-5451a7fd440c tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.13 "GET /v2.0/networks?id=48bd9423-5b85-4344-9434-17e10e227731 HTTP/1.1" status: 200 len: 815 time: 0.1435266 Sep 18 08:41:36.857130 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-704aed15-ed8c-4d3c-be87-06824a9b3067 req-ca2a8b3b-ff96-490f-ba30-0b433d005391 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0490716 Sep 18 08:41:36.878357 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-2d0ed8fd-bdcf-44fa-ab4d-1cc97cac172e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Request body: {'port': {'device_id': 'e85a7284-e6ea-47ab-9674-09d8666b742f', 'network_id': '48bd9423-5b85-4344-9434-17e10e227731', 'admin_state_up': True, 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:41:36.981923 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-2d0ed8fd-bdcf-44fa-ab4d-1cc97cac172e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Made reservation on behalf of 62a8d3b5ed4d4fe085db724f264e25c4 for: {'port': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:41:36.985530 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-2d0ed8fd-bdcf-44fa-ab4d-1cc97cac172e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:37.122779 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_common [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-2d0ed8fd-bdcf-44fa-ab4d-1cc97cac172e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Allocated IP 172.20.0.10 (48bd9423-5b85-4344-9434-17e10e227731/95fb2797-9ac9-40f9-9ea9-56d2c5a16291/a16828fd-b0f1-4ba0-a92a-61614fabe668) {{(pid=94347) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:41:37.317844 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a20e6efd-26e3-4e04-bd46-773469b8564b req-51501820-fc42-42bb-8a26-c98eada7ad33 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:37.319381 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a20e6efd-26e3-4e04-bd46-773469b8564b req-51501820-fc42-42bb-8a26-c98eada7ad33 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 945 time: 0.0995760 Sep 18 08:41:37.360666 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-2d0ed8fd-bdcf-44fa-ab4d-1cc97cac172e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for port, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:37.403237 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a20e6efd-26e3-4e04-bd46-773469b8564b req-ddc45678-8fff-46b7-955c-914a5836d11a tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0640090 Sep 18 08:41:37.424922 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-2d0ed8fd-bdcf-44fa-ab4d-1cc97cac172e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:37.523861 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-2d0ed8fd-bdcf-44fa-ab4d-1cc97cac172e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Network 48bd9423-5b85-4344-9434-17e10e227731 is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:41:37.525440 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d0ed8fd-bdcf-44fa-ab4d-1cc97cac172e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Pushing event updated for resources: {'Port': ['ID=a16828fd-b0f1-4ba0-a92a-61614fabe668,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:37.533551 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-2d0ed8fd-bdcf-44fa-ab4d-1cc97cac172e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:41:37.535355 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-2d0ed8fd-bdcf-44fa-ab4d-1cc97cac172e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Received port after_create {{(pid=94347) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:41:37.591022 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-2d0ed8fd-bdcf-44fa-ab4d-1cc97cac172e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:37.591661 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-2d0ed8fd-bdcf-44fa-ab4d-1cc97cac172e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:37.606738 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-2d0ed8fd-bdcf-44fa-ab4d-1cc97cac172e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7323289 Sep 18 08:41:37.746829 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-dc0ca49b-eb5a-4442-be89-47c3d2e53ed8 None None] Provisioning complete for port a16828fd-b0f1-4ba0-a92a-61614fabe668 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:37.747460 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-dc0ca49b-eb5a-4442-be89-47c3d2e53ed8 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:37.754103 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df1e57d1-fcdd-4ec6-9e50-5ddcf5f2c49f req-5599570c-f5e3-41a7-9d4c-91361efb6e1f tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:37.756331 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-df1e57d1-fcdd-4ec6-9e50-5ddcf5f2c49f req-5599570c-f5e3-41a7-9d4c-91361efb6e1f tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 932 time: 0.0528553 Sep 18 08:41:37.785234 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-dc0ca49b-eb5a-4442-be89-47c3d2e53ed8 None None] Port a16828fd-b0f1-4ba0-a92a-61614fabe668 cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:41:37.801293 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-df1e57d1-fcdd-4ec6-9e50-5ddcf5f2c49f req-65c17303-7e33-428a-8d74-9b6b4fbbe1d0 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0310607 Sep 18 08:41:38.531084 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22a01553-2aa4-4c22-a87c-be532e45713f req-a78cb62d-71e7-4978-a363-368eee5aceaf tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:38.532801 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-22a01553-2aa4-4c22-a87c-be532e45713f req-a78cb62d-71e7-4978-a363-368eee5aceaf tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 945 time: 0.0512612 Sep 18 08:41:38.571812 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-22a01553-2aa4-4c22-a87c-be532e45713f req-6fa1f58f-6072-45fe-a309-4b6ebca651ab tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0332944 Sep 18 08:41:38.915900 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6da8c8f-3e4c-42ae-86cb-22d6c337c7fd req-29554c34-6750-47d0-a213-5632c3d9852b tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:38.917385 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e6da8c8f-3e4c-42ae-86cb-22d6c337c7fd req-29554c34-6750-47d0-a213-5632c3d9852b tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 932 time: 0.0509522 Sep 18 08:41:38.954670 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e6da8c8f-3e4c-42ae-86cb-22d6c337c7fd req-b4c2e2a3-1c5e-440c-b7ea-b278b2c3683c tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313179 Sep 18 08:41:39.692163 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf1c711d-0493-4a24-9677-16e531d954f7 req-15fd7f2a-2b7f-4a08-8a5a-6b357a24d3b4 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:39.693672 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bf1c711d-0493-4a24-9677-16e531d954f7 req-15fd7f2a-2b7f-4a08-8a5a-6b357a24d3b4 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 945 time: 0.0567105 Sep 18 08:41:39.730850 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bf1c711d-0493-4a24-9677-16e531d954f7 req-bf842b75-f7ee-4334-acae-07fa6f05ff67 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0308855 Sep 18 08:41:39.735533 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 3e95f520-0716-4198-96ec-20bb84895fe7 up at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:41:39.784692 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning for port 3e95f520-0716-4198-96ec-20bb84895fe7 completed by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 18 08:41:39.788477 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning complete for port 3e95f520-0716-4198-96ec-20bb84895fe7 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:39.788860 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:39.869655 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:39.891326 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd29eb9fe-297b-417b-af91-cdeca7c4c612', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3e95f520-0716-4198-96ec-20bb84895fe7'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:41:39.893542 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-42d93d85-edd3-481c-b023-c635aac823bc" -d '{"events": [{"server_uuid": "d29eb9fe-297b-417b-af91-cdeca7c4c612", "name": "network-vif-plugged", "status": "completed", "tag": "3e95f520-0716-4198-96ec-20bb84895fe7"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:41:39.905827 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 3e95f520-0716-4198-96ec-20bb84895fe7, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=3e95f520-0716-4198-96ec-20bb84895fe7,segment=NetworkSegment(d1432479-9c27-42c4-87db-6905e7868675),segment_id=d1432479-9c27-42c4-87db-6905e7868675)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:41:39.910693 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:39.955790 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:41:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9726cf44-4f70-4726-84ad-175c42c92b8e x-openstack-request-id: req-9726cf44-4f70-4726-84ad-175c42c92b8e {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:41:39.956076 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d29eb9fe-297b-417b-af91-cdeca7c4c612", "name": "network-vif-plugged", "status": "completed", "tag": "3e95f520-0716-4198-96ec-20bb84895fe7", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:41:39.956329 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-9726cf44-4f70-4726-84ad-175c42c92b8e {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:41:39.956712 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd29eb9fe-297b-417b-af91-cdeca7c4c612', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3e95f520-0716-4198-96ec-20bb84895fe7', 'code': 200} Sep 18 08:41:39.961170 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=3e95f520-0716-4198-96ec-20bb84895fe7,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:40.075459 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c2a17d7-5f1d-4fb7-aa0f-8b4f47437b4b req-5a2f62b8-3543-4251-b2fd-21cbc3b4941f tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:40.076959 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8c2a17d7-5f1d-4fb7-aa0f-8b4f47437b4b req-5a2f62b8-3543-4251-b2fd-21cbc3b4941f tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 932 time: 0.0553641 Sep 18 08:41:40.114493 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8c2a17d7-5f1d-4fb7-aa0f-8b4f47437b4b req-b87dd2b8-74bf-49b0-8182-d391f293201e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0316505 Sep 18 08:41:40.851184 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b2f2346-5b28-409e-9763-ff2c94e83174 req-ff005d3d-07f2-4aaa-ac04-c03a81f132b1 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:40.852812 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1b2f2346-5b28-409e-9763-ff2c94e83174 req-ff005d3d-07f2-4aaa-ac04-c03a81f132b1 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 946 time: 0.0562863 Sep 18 08:41:40.890357 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1b2f2346-5b28-409e-9763-ff2c94e83174 req-48791f6b-6074-4a12-9fd2-90707d050bf3 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0317714 Sep 18 08:41:41.228555 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1dfe848-0eae-4d9f-b96e-06fa4370ea96 req-1ca3c234-2fab-4a84-9419-2cc37c203c3e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:41.230041 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b1dfe848-0eae-4d9f-b96e-06fa4370ea96 req-1ca3c234-2fab-4a84-9419-2cc37c203c3e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 932 time: 0.0474503 Sep 18 08:41:41.270180 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b1dfe848-0eae-4d9f-b96e-06fa4370ea96 req-2ce67023-db6b-45c6-b5cc-1207eb99bfdd tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0344574 Sep 18 08:41:42.007967 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6200a3f-a451-4464-9dc3-c7dd80d12a6a req-25b0757f-ccd6-4dd0-8b8b-6f9be327503e tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:42.010347 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a6200a3f-a451-4464-9dc3-c7dd80d12a6a req-25b0757f-ccd6-4dd0-8b8b-6f9be327503e tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 946 time: 0.0481853 Sep 18 08:41:42.065016 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a6200a3f-a451-4464-9dc3-c7dd80d12a6a req-6a757655-7519-4268-bf0d-29b8749a513e tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459127 Sep 18 08:41:42.389485 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4b82980-28cf-4d03-bac7-0e3a9f385280 req-8a469924-3dc3-4d51-a11c-717ef58e8bf1 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:42.390992 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e4b82980-28cf-4d03-bac7-0e3a9f385280 req-8a469924-3dc3-4d51-a11c-717ef58e8bf1 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 932 time: 0.0550017 Sep 18 08:41:42.427673 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e4b82980-28cf-4d03-bac7-0e3a9f385280 req-f40a9d50-563f-479b-a1d8-920f1d79da37 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0308487 Sep 18 08:41:43.175705 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2353068e-1830-4561-b970-c127396adc1f req-f975929e-a1d5-4e3a-a9e3-71d3182b769c tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:43.177178 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2353068e-1830-4561-b970-c127396adc1f req-f975929e-a1d5-4e3a-a9e3-71d3182b769c tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 946 time: 0.0477660 Sep 18 08:41:43.217238 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2353068e-1830-4561-b970-c127396adc1f req-31ab2436-49c1-4668-a69e-c225cd00ad4b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0340741 Sep 18 08:41:43.538667 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e07fc90-b87d-4b86-8b2c-7eb7c82e57f2 req-fabf3a13-4a61-4c2d-ade6-fa5dad188931 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:43.540133 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4e07fc90-b87d-4b86-8b2c-7eb7c82e57f2 req-fabf3a13-4a61-4c2d-ade6-fa5dad188931 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 932 time: 0.0471492 Sep 18 08:41:43.578117 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4e07fc90-b87d-4b86-8b2c-7eb7c82e57f2 req-eb87ac76-193c-4a60-9a8c-377b068d3d15 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319669 Sep 18 08:41:44.343800 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55eb115a-6bc9-4f66-88d6-fa9f67d0b3bc req-45a25b03-cc23-4d3f-8bd0-becfc5c06905 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:44.345902 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-55eb115a-6bc9-4f66-88d6-fa9f67d0b3bc req-45a25b03-cc23-4d3f-8bd0-becfc5c06905 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 946 time: 0.0626247 Sep 18 08:41:44.386104 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-55eb115a-6bc9-4f66-88d6-fa9f67d0b3bc req-45888ba2-ce50-4b2d-9670-088189a3773d tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0337050 Sep 18 08:41:44.689758 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e032997-adda-4ad3-9529-7a2b108b0ce0 req-a35139b0-adf5-4e6d-917d-77aad777329e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:44.691451 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6e032997-adda-4ad3-9529-7a2b108b0ce0 req-a35139b0-adf5-4e6d-917d-77aad777329e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 932 time: 0.0487907 Sep 18 08:41:44.730110 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6e032997-adda-4ad3-9529-7a2b108b0ce0 req-17410d4f-442a-428d-8c35-fe79d9dbd6f9 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0328050 Sep 18 08:41:45.503206 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef6afb1b-f2be-4089-a82b-b345b6f2ef76 req-15d7575e-7182-4b37-b862-c0a4dd720f74 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:45.504670 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ef6afb1b-f2be-4089-a82b-b345b6f2ef76 req-15d7575e-7182-4b37-b862-c0a4dd720f74 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 946 time: 0.0469639 Sep 18 08:41:45.540650 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ef6afb1b-f2be-4089-a82b-b345b6f2ef76 req-07929100-2c9e-4e8d-9f30-366c0b597635 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0302896 Sep 18 08:41:45.846561 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-756ae5ef-8a7f-44b2-b39d-4c0a2fcb1b56 req-60644abd-f24c-4af5-bb1c-4457a692836d tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:45.848971 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-756ae5ef-8a7f-44b2-b39d-4c0a2fcb1b56 req-60644abd-f24c-4af5-bb1c-4457a692836d tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 932 time: 0.0528133 Sep 18 08:41:45.924113 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-756ae5ef-8a7f-44b2-b39d-4c0a2fcb1b56 req-8a398ee3-8152-411c-b8f8-971460b196a7 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0695794 Sep 18 08:41:46.655755 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bafc4b5-9154-4480-bd7a-cd0bbfee3f2d req-55746e02-17f5-4701-98f3-72edf506c932 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:46.657455 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2bafc4b5-9154-4480-bd7a-cd0bbfee3f2d req-55746e02-17f5-4701-98f3-72edf506c932 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 946 time: 0.0495377 Sep 18 08:41:46.695160 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2bafc4b5-9154-4480-bd7a-cd0bbfee3f2d req-e34d82d1-26f0-4ed3-9848-061b571bfd5f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0317881 Sep 18 08:41:47.061533 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7657dfe2-4cd6-4100-b357-67b13ae45f78 req-9c9bbfb9-c857-485c-906f-462259114ec9 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:47.063051 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7657dfe2-4cd6-4100-b357-67b13ae45f78 req-9c9bbfb9-c857-485c-906f-462259114ec9 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 932 time: 0.0496562 Sep 18 08:41:47.099951 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7657dfe2-4cd6-4100-b357-67b13ae45f78 req-7655bd99-d81f-49d7-af3b-b0d65e9d1b62 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0310650 Sep 18 08:41:47.707913 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:41:47.810715 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f632494-1ed4-4b24-868c-530393912697 req-8ad98d75-781b-4582-873d-275e766a14ca tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:47.812255 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8f632494-1ed4-4b24-868c-530393912697 req-8ad98d75-781b-4582-873d-275e766a14ca tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 946 time: 0.0530605 Sep 18 08:41:47.850583 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8f632494-1ed4-4b24-868c-530393912697 req-bcadc4be-1429-498c-8f86-4fc02c267a09 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0324876 Sep 18 08:41:48.212151 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-946375bb-d9bf-46d2-a325-9d5af31fc61c req-b79ac703-3887-4c7c-b8ba-650c9fc0ece9 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:48.213637 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-946375bb-d9bf-46d2-a325-9d5af31fc61c req-b79ac703-3887-4c7c-b8ba-650c9fc0ece9 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 932 time: 0.0475814 Sep 18 08:41:48.250178 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-946375bb-d9bf-46d2-a325-9d5af31fc61c req-293a8088-5bfe-41f7-bdd0-7f7ee8454240 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0306273 Sep 18 08:41:48.962449 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aefe4211-0ca5-4ce1-86d8-a86e52dacb14 req-14da7f43-8738-4329-a956-94316e056e68 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:48.964455 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-aefe4211-0ca5-4ce1-86d8-a86e52dacb14 req-14da7f43-8738-4329-a956-94316e056e68 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 946 time: 0.0487902 Sep 18 08:41:49.001986 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-aefe4211-0ca5-4ce1-86d8-a86e52dacb14 req-bf6d6df5-cdcd-4e95-9c7b-474478ab11df tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313218 Sep 18 08:41:49.365187 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91c50167-6208-427b-a3cc-eec00f7f190f req-eeef730c-4d5b-485a-ac00-d60ae16f8389 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:49.366691 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-91c50167-6208-427b-a3cc-eec00f7f190f req-eeef730c-4d5b-485a-ac00-d60ae16f8389 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 932 time: 0.0528681 Sep 18 08:41:49.405760 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-91c50167-6208-427b-a3cc-eec00f7f190f req-cf91f3aa-6460-4423-a498-a6dcf55b1765 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0328000 Sep 18 08:41:49.605571 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-a9cf0a9f-d229-49c5-a1f5-d48f439d571b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:49.905552 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:50.151063 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-510a935e-a40f-4793-9840-3ca25fd69b5f req-7caadcac-ad12-4bdb-a64f-2a1cb489d01f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:50.158307 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-510a935e-a40f-4793-9840-3ca25fd69b5f req-7caadcac-ad12-4bdb-a64f-2a1cb489d01f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 946 time: 0.0558128 Sep 18 08:41:50.210182 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-510a935e-a40f-4793-9840-3ca25fd69b5f req-bc68b255-6d0c-43b6-a779-f67633172626 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0478649 Sep 18 08:41:50.531940 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5896b8ef-4cc7-473b-be12-32567e091014 req-aa3aa674-d8c9-422f-8340-e71a4c4a9cfa tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:50.533438 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5896b8ef-4cc7-473b-be12-32567e091014 req-aa3aa674-d8c9-422f-8340-e71a4c4a9cfa tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 932 time: 0.0473561 Sep 18 08:41:50.583845 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5896b8ef-4cc7-473b-be12-32567e091014 req-62536a6f-1b07-4f62-8281-cc34e45b1cc2 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444229 Sep 18 08:41:51.339687 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd18b900-029d-4d62-982f-0874ca669fa9 req-1fd38dc3-6828-4337-95da-bb97a7d7e98b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:51.341185 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bd18b900-029d-4d62-982f-0874ca669fa9 req-1fd38dc3-6828-4337-95da-bb97a7d7e98b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 946 time: 0.0535543 Sep 18 08:41:51.378104 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bd18b900-029d-4d62-982f-0874ca669fa9 req-471b5461-1bb6-448a-b08f-d0ed0cad686a tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0305388 Sep 18 08:41:51.765865 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ec11ff6-1c5d-4b5f-94b8-197814b52b02 req-bd022eec-e31a-44e3-a70c-ca9c880eef30 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:51.771860 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7ec11ff6-1c5d-4b5f-94b8-197814b52b02 req-bd022eec-e31a-44e3-a70c-ca9c880eef30 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 932 time: 0.1016409 Sep 18 08:41:51.821163 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 32834) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:41:51.829246 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7ec11ff6-1c5d-4b5f-94b8-197814b52b02 req-2fcd32a5-26a1-4153-bce5-b75bba205707 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0515273 Sep 18 08:41:51.959745 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-660db6e5-958e-4b86-9963-cc0bc58c0ef8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:52.055380 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-660db6e5-958e-4b86-9963-cc0bc58c0ef8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:52.059278 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-660db6e5-958e-4b86-9963-cc0bc58c0ef8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:52.096251 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-660db6e5-958e-4b86-9963-cc0bc58c0ef8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4ababfd9-d6c4-4e2e-afc8-fee9e0b6e770,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:52.099966 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-660db6e5-958e-4b86-9963-cc0bc58c0ef8 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=fdfb17cfe64145a4bbac5c3897eda06d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2776308 Sep 18 08:41:52.102730 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 32838) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:41:52.106859 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-660db6e5-958e-4b86-9963-cc0bc58c0ef8 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:52.107221 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-660db6e5-958e-4b86-9963-cc0bc58c0ef8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:52.107571 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-660db6e5-958e-4b86-9963-cc0bc58c0ef8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:52.107918 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-660db6e5-958e-4b86-9963-cc0bc58c0ef8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:52.108259 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-660db6e5-958e-4b86-9963-cc0bc58c0ef8 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:52.108596 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-660db6e5-958e-4b86-9963-cc0bc58c0ef8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:52.108933 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-660db6e5-958e-4b86-9963-cc0bc58c0ef8 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:52.109309 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-660db6e5-958e-4b86-9963-cc0bc58c0ef8 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:52.109645 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-660db6e5-958e-4b86-9963-cc0bc58c0ef8 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:52.110065 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-660db6e5-958e-4b86-9963-cc0bc58c0ef8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:52.110298 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-660db6e5-958e-4b86-9963-cc0bc58c0ef8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:52.110624 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-660db6e5-958e-4b86-9963-cc0bc58c0ef8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:41:52.153189 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-17d8ee16-5436-422b-9658-c5d61804aec5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:52.176129 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-17d8ee16-5436-422b-9658-c5d61804aec5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:52.223433 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-17d8ee16-5436-422b-9658-c5d61804aec5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:52.226213 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-17d8ee16-5436-422b-9658-c5d61804aec5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:52.227371 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-17d8ee16-5436-422b-9658-c5d61804aec5 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/4ababfd9-d6c4-4e2e-afc8-fee9e0b6e770 HTTP/1.1" status: 204 len: 168 time: 0.1235254 Sep 18 08:41:52.235488 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17d8ee16-5436-422b-9658-c5d61804aec5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4ababfd9-d6c4-4e2e-afc8-fee9e0b6e770,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:52.398698 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-1e27c379-9b6e-4564-85de-07e330cc6dd2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:52.513127 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3421b083-54d7-40dc-bcc7-7b871cbe504b req-02b6b230-1fba-4878-8724-1900ae880557 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:52.514767 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3421b083-54d7-40dc-bcc7-7b871cbe504b req-02b6b230-1fba-4878-8724-1900ae880557 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 946 time: 0.0687973 Sep 18 08:41:52.556802 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3421b083-54d7-40dc-bcc7-7b871cbe504b req-b02f51fa-0c90-4b50-86e0-8d5b31e03ed4 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0361853 Sep 18 08:41:52.947300 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 32870) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:41:52.980970 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a72ab2b7-9cda-479f-b0d9-dee476fa0e00 req-4b72f48b-d4e0-4ec4-bc8c-980093a0c95d tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:52.988081 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a72ab2b7-9cda-479f-b0d9-dee476fa0e00 req-4b72f48b-d4e0-4ec4-bc8c-980093a0c95d tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 932 time: 0.0674233 Sep 18 08:41:53.030748 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a72ab2b7-9cda-479f-b0d9-dee476fa0e00 req-4953ff4b-b991-45bf-bfd5-fd272a8e15a4 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417826 Sep 18 08:41:53.088671 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-28b14d72-0e76-4efa-b091-a54d7a468d65 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1303512803-network', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:41:53.110977 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-28b14d72-0e76-4efa-b091-a54d7a468d65 admin admin] Made reservation on behalf of 0c7c58787ad549afa94b716f4c2f187b for: {'network': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:41:53.114477 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-28b14d72-0e76-4efa-b091-a54d7a468d65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for network, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:53.124718 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-28b14d72-0e76-4efa-b091-a54d7a468d65 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:53.200048 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:53.215846 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-28b14d72-0e76-4efa-b091-a54d7a468d65 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:53.219979 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-28b14d72-0e76-4efa-b091-a54d7a468d65 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:53.243168 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-28b14d72-0e76-4efa-b091-a54d7a468d65 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 200} {{(pid=94346) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 18 08:41:53.252788 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28b14d72-0e76-4efa-b091-a54d7a468d65 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d8512039-443c-4490-b4a6-c8b163c8fdbc,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:53.257605 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-28b14d72-0e76-4efa-b091-a54d7a468d65 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:53.257952 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.db.segments_db [None req-28b14d72-0e76-4efa-b091-a54d7a468d65 admin admin] Added segment c215153d-2878-4c82-8dc0-2a92b453bf12 of type vlan for network 000f3583-b7de-458d-9146-0010cd28b00d Sep 18 08:41:53.297385 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-28b14d72-0e76-4efa-b091-a54d7a468d65 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732885226527'] for network, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:53.331308 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-28b14d72-0e76-4efa-b091-a54d7a468d65 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for network, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:53.332304 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-28b14d72-0e76-4efa-b091-a54d7a468d65 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:53.333976 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-28b14d72-0e76-4efa-b091-a54d7a468d65 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:53.343746 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:53.369115 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-28b14d72-0e76-4efa-b091-a54d7a468d65 admin admin] 10.222.0.35 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.4207225 Sep 18 08:41:53.372103 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 32876) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:41:53.377062 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-09193912-6151-40ec-9f77-e91d4be24952 admin admin] Request body: {'subnet': {'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1303512803-subnet', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'ip_version': 4}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:41:53.397712 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-09193912-6151-40ec-9f77-e91d4be24952 admin admin] Made reservation on behalf of 0c7c58787ad549afa94b716f4c2f187b for: {'subnet': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:41:53.399994 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-09193912-6151-40ec-9f77-e91d4be24952 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-13996252'] for subnet, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:53.402577 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28b14d72-0e76-4efa-b091-a54d7a468d65 admin admin] Pushing event updated for resources: {'Network': ['ID=000f3583-b7de-458d-9146-0010cd28b00d,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:53.412644 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Network 000f3583-b7de-458d-9146-0010cd28b00d details requested by agent ovs-agent-dv-cinder-804470-6-iscsi with host dv-cinder-804470-6-iscsi {{(pid=94348) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 18 08:41:53.571296 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-09193912-6151-40ec-9f77-e91d4be24952 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-15069167', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-13996274'] for subnet, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:53.672780 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09193912-6151-40ec-9f77-e91d4be24952 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a4c047cf-cba6-4b94-8339-59469f96c92a,revision_number=0']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:53.680286 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-09193912-6151-40ec-9f77-e91d4be24952 admin admin] Checking segment: {'id': 'c215153d-2878-4c82-8dc0-2a92b453bf12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 200, 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94347) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:41:53.680650 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-09193912-6151-40ec-9f77-e91d4be24952 admin admin] Network hostable DHCP agents. Network: 000f3583-b7de-458d-9146-0010cd28b00d, hostable agents: ['6aaa6222-6d04-44a7-b807-bfc2cbd3e99f'], hosted agents: [] {{(pid=94347) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 18 08:41:53.708115 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e33107f-2c22-412d-bc95-c4ad8ecba0c3 req-bfe31094-a402-4a0b-8bb1-6a44576012fe tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:53.709666 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6e33107f-2c22-412d-bc95-c4ad8ecba0c3 req-bfe31094-a402-4a0b-8bb1-6a44576012fe tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 946 time: 0.0707827 Sep 18 08:41:53.715475 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-09193912-6151-40ec-9f77-e91d4be24952 admin admin] Network 000f3583-b7de-458d-9146-0010cd28b00d is scheduled to be hosted by DHCP agent 6aaa6222-6d04-44a7-b807-bfc2cbd3e99f with binding_index 1 {{(pid=94347) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 18 08:41:53.734881 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [None req-09193912-6151-40ec-9f77-e91d4be24952 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804470-6-iscsi, 000f3583-b7de-458d-9146-0010cd28b00d) {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:41:53.740553 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-09193912-6151-40ec-9f77-e91d4be24952 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:53.741149 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-09193912-6151-40ec-9f77-e91d4be24952 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for subnet, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:53.742917 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fdd9db87-5d37-40cd-8fe3-5bda17f19901 None None] Network 000f3583-b7de-458d-9146-0010cd28b00d requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:41:53.765026 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6e33107f-2c22-412d-bc95-c4ad8ecba0c3 req-d9cfd4f8-5a12-4fdb-8940-d4850aa81d09 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470295 Sep 18 08:41:53.769964 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-09193912-6151-40ec-9f77-e91d4be24952 admin admin] 10.222.0.35 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.3940253 Sep 18 08:41:53.770527 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 32880) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:41:53.774923 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-c0e04b49-e905-41ad-b0fd-a55d1c459032 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:41:53.806497 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c0e04b49-e905-41ad-b0fd-a55d1c459032 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-784001', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2995'] for router, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:53.807577 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c0e04b49-e905-41ad-b0fd-a55d1c459032 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-782353', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-784513', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-710924', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2984'] for router, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:53.861019 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c0e04b49-e905-41ad-b0fd-a55d1c459032 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:54.004927 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c0e04b49-e905-41ad-b0fd-a55d1c459032 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:54.052282 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-297cd49a-59c9-45d8-a480-a5477eedfe1d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp22fa9bf9-2738-5c16-87a3-3f58ee5e2dc2-000f3583-b7de-458d-9146-0010cd28b00d', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a'}]}} from dv-cinder-804470-6-iscsi. {{(pid=94348) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 18 08:41:54.053321 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-297cd49a-59c9-45d8-a480-a5477eedfe1d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:54.172895 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cf54e4f-d1b3-47df-a22c-ef23b4e15331 req-c4e516f3-716e-4781-9f6c-a72756522f82 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:54.174651 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9cf54e4f-d1b3-47df-a22c-ef23b4e15331 req-c4e516f3-716e-4781-9f6c-a72756522f82 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 932 time: 0.0531182 Sep 18 08:41:54.227560 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9cf54e4f-d1b3-47df-a22c-ef23b4e15331 req-6e5cdeea-2106-4b20-ba52-eb55ee103af1 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392919 Sep 18 08:41:54.235726 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.db_base_plugin_common [None req-297cd49a-59c9-45d8-a480-a5477eedfe1d None None] Allocated IP 172.20.0.2 (000f3583-b7de-458d-9146-0010cd28b00d/a4c047cf-cba6-4b94-8339-59469f96c92a/578ee7da-5391-495a-b55d-a0609cbf3eb1) {{(pid=94348) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:41:54.357659 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c0e04b49-e905-41ad-b0fd-a55d1c459032 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:54.380257 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c0e04b49-e905-41ad-b0fd-a55d1c459032 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:54.410570 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-297cd49a-59c9-45d8-a480-a5477eedfe1d None None] Notify callbacks [] for port, precommit_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:54.416368 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-297cd49a-59c9-45d8-a480-a5477eedfe1d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528'] for port, after_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:54.458223 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-297cd49a-59c9-45d8-a480-a5477eedfe1d None None] Network 000f3583-b7de-458d-9146-0010cd28b00d is already hosted by enough agents. {{(pid=94348) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:41:54.465363 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.scheduler.base_scheduler [None req-297cd49a-59c9-45d8-a480-a5477eedfe1d None None] Resources bound (agent type, host, resource id): {{(pid=94348) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:41:54.467849 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-297cd49a-59c9-45d8-a480-a5477eedfe1d None None] Received port after_create {{(pid=94348) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:41:54.475635 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-297cd49a-59c9-45d8-a480-a5477eedfe1d None None] Pushing event updated for resources: {'Port': ['ID=578ee7da-5391-495a-b55d-a0609cbf3eb1,revision_number=1']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:54.496347 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_common [None req-c0e04b49-e905-41ad-b0fd-a55d1c459032 admin admin] Allocated IP 172.27.1.183 (2e3b3f85-63e4-4380-917a-8c90c80b3e38/cd525bb9-7f93-490c-a5d6-a08911817e54/f206227f-a59a-4423-8cb4-9d1abe6f264f) {{(pid=94346) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:41:54.530065 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-297cd49a-59c9-45d8-a480-a5477eedfe1d None None] Attempting to bind port 578ee7da-5391-495a-b55d-a0609cbf3eb1 on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:41:54.530917 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-297cd49a-59c9-45d8-a480-a5477eedfe1d None None] Attempting to bind port 578ee7da-5391-495a-b55d-a0609cbf3eb1 by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': 'c215153d-2878-4c82-8dc0-2a92b453bf12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 200, 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d'}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:41:54.531123 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-297cd49a-59c9-45d8-a480-a5477eedfe1d None None] Attempting to bind port 578ee7da-5391-495a-b55d-a0609cbf3eb1 on network 000f3583-b7de-458d-9146-0010cd28b00d {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:41:54.537767 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-297cd49a-59c9-45d8-a480-a5477eedfe1d None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 41, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:41:54.538150 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-297cd49a-59c9-45d8-a480-a5477eedfe1d None None] Checking segment: {'id': 'c215153d-2878-4c82-8dc0-2a92b453bf12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 200, 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94348) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:41:54.538555 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-297cd49a-59c9-45d8-a480-a5477eedfe1d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:54.538957 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-297cd49a-59c9-45d8-a480-a5477eedfe1d None None] Bound using segment: {'id': 'c215153d-2878-4c82-8dc0-2a92b453bf12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 200, 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d'} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:41:54.539428 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-297cd49a-59c9-45d8-a480-a5477eedfe1d None None] Bound port: 578ee7da-5391-495a-b55d-a0609cbf3eb1, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c215153d-2878-4c82-8dc0-2a92b453bf12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 200, 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d'}}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:41:54.539815 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-297cd49a-59c9-45d8-a480-a5477eedfe1d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:54.605237 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-297cd49a-59c9-45d8-a480-a5477eedfe1d None None] For port 578ee7da-5391-495a-b55d-a0609cbf3eb1, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94348) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:41:54.605845 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c0e04b49-e905-41ad-b0fd-a55d1c459032 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:54.608513 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-297cd49a-59c9-45d8-a480-a5477eedfe1d None None] For port 578ee7da-5391-495a-b55d-a0609cbf3eb1, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=578ee7da-5391-495a-b55d-a0609cbf3eb1,segment=NetworkSegment(c215153d-2878-4c82-8dc0-2a92b453bf12),segment_id=c215153d-2878-4c82-8dc0-2a92b453bf12)] {{(pid=94348) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:41:54.614164 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-297cd49a-59c9-45d8-a480-a5477eedfe1d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:54.689346 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-297cd49a-59c9-45d8-a480-a5477eedfe1d None None] Pushing event updated for resources: {'Port': ['ID=578ee7da-5391-495a-b55d-a0609cbf3eb1,revision_number=2']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:54.853387 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c0e04b49-e905-41ad-b0fd-a55d1c459032 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:54.874037 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:54.899170 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0e04b49-e905-41ad-b0fd-a55d1c459032 admin admin] Network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:41:54.905578 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-c0e04b49-e905-41ad-b0fd-a55d1c459032 admin admin] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:41:54.911352 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c0e04b49-e905-41ad-b0fd-a55d1c459032 admin admin] Received port after_create {{(pid=94346) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:41:54.934191 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0e04b49-e905-41ad-b0fd-a55d1c459032 admin admin] Pushing event updated for resources: {'Port': ['ID=f206227f-a59a-4423-8cb4-9d1abe6f264f,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:54.939551 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6be64e66-8515-4b1d-a31f-2053db71a56c req-f9889322-3058-4fba-8af6-487c28cd83dd tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:54.941400 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6be64e66-8515-4b1d-a31f-2053db71a56c req-f9889322-3058-4fba-8af6-487c28cd83dd tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 946 time: 0.0600877 Sep 18 08:41:54.986369 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6be64e66-8515-4b1d-a31f-2053db71a56c req-f2aee94e-776c-4d57-8f56-09ef74c7b368 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387189 Sep 18 08:41:55.171397 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c0e04b49-e905-41ad-b0fd-a55d1c459032 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:55.366980 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c0e04b49-e905-41ad-b0fd-a55d1c459032 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-782366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-784982'] for router, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:55.380313 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a3221dc-237a-49bb-b5e1-1be26d72320f req-94403488-97b6-46ad-ab9f-aaa2db37952d tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:55.389140 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7a3221dc-237a-49bb-b5e1-1be26d72320f req-94403488-97b6-46ad-ab9f-aaa2db37952d tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 932 time: 0.0739322 Sep 18 08:41:55.441888 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7a3221dc-237a-49bb-b5e1-1be26d72320f req-f3ec3c90-600b-4818-ab43-44237cd742e2 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458813 Sep 18 08:41:55.474777 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 578ee7da-5391-495a-b55d-a0609cbf3eb1 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:41:55.531389 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c0e04b49-e905-41ad-b0fd-a55d1c459032 admin admin] Router 4922fc58-f2eb-480a-878f-2bc3f212b4da is scheduled to L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a with binding_index 1 {{(pid=94346) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 18 08:41:55.535935 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 578ee7da-5391-495a-b55d-a0609cbf3eb1 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:55.536675 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:55.621011 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:55.641246 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c0e04b49-e905-41ad-b0fd-a55d1c459032 admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94346) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:41:55.660213 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c0e04b49-e905-41ad-b0fd-a55d1c459032 admin admin] Notify callbacks [] for router, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:55.664138 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-536c997d-2873-442a-81bf-9fe918803742 None None] For port 578ee7da-5391-495a-b55d-a0609cbf3eb1, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=578ee7da-5391-495a-b55d-a0609cbf3eb1,segment=NetworkSegment(c215153d-2878-4c82-8dc0-2a92b453bf12),segment_id=c215153d-2878-4c82-8dc0-2a92b453bf12)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:41:55.664300 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-c0e04b49-e905-41ad-b0fd-a55d1c459032 admin admin] 10.222.0.35 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 1.8901668 Sep 18 08:41:55.664420 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] Sync routers for ids ['4922fc58-f2eb-480a-878f-2bc3f212b4da'] in dv-cinder-804470-6-iscsi {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:41:55.664907 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f7a1b794-b7b5-4343-a50d-d112129f01a4 None None] Network 000f3583-b7de-458d-9146-0010cd28b00d requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:41:55.665006 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 32898) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:41:55.673482 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] Routers {'4922fc58-f2eb-480a-878f-2bc3f212b4da'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:41:55.674372 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:41:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['4922fc58-f2eb-480a-878f-2bc3f212b4da'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:41:55.680769 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:55.784308 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] Set router 4922fc58-f2eb-480a-878f-2bc3f212b4da gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:41:55.785104 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-0dafcc3c-7b5d-454b-acec-f3221f6fd300 None None] Provisioning complete for port 578ee7da-5391-495a-b55d-a0609cbf3eb1 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:55.785515 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-0dafcc3c-7b5d-454b-acec-f3221f6fd300 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:55.812711 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Pushing event updated for resources: {'Port': ['ID=578ee7da-5391-495a-b55d-a0609cbf3eb1,revision_number=3']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:56.057934 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:41:55Z', 'revision_number': 3, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port': {'id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ad:c5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 474, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:54Z', 'updated_at': '2021-09-18T08:41:54Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:41:56.083902 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-79592181-f149-4b93-803d-d629a93cb7d6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:56.091320 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] Checking router: 4922fc58-f2eb-480a-878f-2bc3f212b4da for host: dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:41:56.092095 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] Updating router 4922fc58-f2eb-480a-878f-2bc3f212b4da port f206227f-a59a-4423-8cb4-9d1abe6f264f binding host dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 18 08:41:56.116900 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b89b014b-467e-4e6c-86c9-f0f81f9c7ccf req-fa389f06-39e9-4a31-b29c-b8590938a490 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:56.119736 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:56.124750 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b89b014b-467e-4e6c-86c9-f0f81f9c7ccf req-fa389f06-39e9-4a31-b29c-b8590938a490 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 946 time: 0.0594957 Sep 18 08:41:56.176202 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b89b014b-467e-4e6c-86c9-f0f81f9c7ccf req-d0fda0c3-a686-4471-9ffc-948bba827974 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504115 Sep 18 08:41:56.252861 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_common [None req-79592181-f149-4b93-803d-d629a93cb7d6 admin admin] Allocated IP 172.20.0.1 (000f3583-b7de-458d-9146-0010cd28b00d/a4c047cf-cba6-4b94-8339-59469f96c92a/4eb6aada-4647-4cc0-b357-a3113e1607e9) {{(pid=94346) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:41:56.256694 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-55e4d6e1-338c-4e30-8e58-bc0b4754aa62 None None] Provisioning complete for port 578ee7da-5391-495a-b55d-a0609cbf3eb1 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:56.257077 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-55e4d6e1-338c-4e30-8e58-bc0b4754aa62 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:56.359947 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-79592181-f149-4b93-803d-d629a93cb7d6 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:56.394883 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] Notify callbacks [] for port, precommit_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:56.395133 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-79592181-f149-4b93-803d-d629a93cb7d6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:56.400402 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:56.430773 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-79592181-f149-4b93-803d-d629a93cb7d6 admin admin] Network 000f3583-b7de-458d-9146-0010cd28b00d is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:41:56.438099 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-79592181-f149-4b93-803d-d629a93cb7d6 admin admin] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:41:56.442410 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79592181-f149-4b93-803d-d629a93cb7d6 admin admin] Received port after_create {{(pid=94346) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:41:56.445348 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79592181-f149-4b93-803d-d629a93cb7d6 admin admin] Pushing event updated for resources: {'Port': ['ID=4eb6aada-4647-4cc0-b357-a3113e1607e9,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:56.447666 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] Attempting to bind port f206227f-a59a-4423-8cb4-9d1abe6f264f on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:41:56.448118 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] Attempting to bind port f206227f-a59a-4423-8cb4-9d1abe6f264f by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}] {{(pid=94349) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:41:56.449096 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] Attempting to bind port f206227f-a59a-4423-8cb4-9d1abe6f264f on network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:41:56.460905 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 41, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:41:56.461294 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] Checking segment: {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94349) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:41:56.461908 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:56.462396 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] Bound using segment: {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'} {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:41:56.462874 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] Bound port: f206227f-a59a-4423-8cb4-9d1abe6f264f, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}}] {{(pid=94349) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:41:56.463820 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:56.464930 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-887b307f-e83b-4884-a6da-baa01c21ce15 None None] Pushing event updated for resources: {'Port': ['ID=f206227f-a59a-4423-8cb4-9d1abe6f264f,revision_number=2']} {{(pid=94349) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:56.481878 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-79592181-f149-4b93-803d-d629a93cb7d6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-785025'] for router_interface, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:56.528963 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.db [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] For port f206227f-a59a-4423-8cb4-9d1abe6f264f, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94349) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:41:56.534265 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.db [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] For port f206227f-a59a-4423-8cb4-9d1abe6f264f, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=f206227f-a59a-4423-8cb4-9d1abe6f264f,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94349) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:41:56.541118 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:56.594228 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bef8e6c-dcf8-4b80-8a91-7af11ed83550 req-91e392ea-b6f4-4705-b3fe-f68f8df50009 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:56.596029 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9bef8e6c-dcf8-4b80-8a91-7af11ed83550 req-91e392ea-b6f4-4705-b3fe-f68f8df50009 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 932 time: 0.0555995 Sep 18 08:41:56.602988 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] Routers {'4922fc58-f2eb-480a-878f-2bc3f212b4da'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:41:56.603654 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:41:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['4922fc58-f2eb-480a-878f-2bc3f212b4da'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:41:56.635216 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-79592181-f149-4b93-803d-d629a93cb7d6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:56.654769 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9bef8e6c-dcf8-4b80-8a91-7af11ed83550 req-db094c31-5ca7-4c2d-badf-a8e9e14e54a3 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517566 Sep 18 08:41:56.666152 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-887b307f-e83b-4884-a6da-baa01c21ce15 None None] Pushing event updated for resources: {'Port': ['ID=f206227f-a59a-4423-8cb4-9d1abe6f264f,revision_number=3']} {{(pid=94349) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:56.741002 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] Set router 4922fc58-f2eb-480a-878f-2bc3f212b4da gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:41:56.816268 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-79592181-f149-4b93-803d-d629a93cb7d6 admin admin] Notify callbacks [] for port, precommit_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:56.820966 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-79592181-f149-4b93-803d-d629a93cb7d6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14290155'] for port, after_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:56.856301 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-a9d0ab02-5fa6-4237-a82d-68d2560752f5 None None] Provisioning complete for port 4eb6aada-4647-4cc0-b357-a3113e1607e9 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:56.856947 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-a9d0ab02-5fa6-4237-a82d-68d2560752f5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:56.888556 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79592181-f149-4b93-803d-d629a93cb7d6 admin admin] Pushing event updated for resources: {'Port': ['ID=4eb6aada-4647-4cc0-b357-a3113e1607e9,revision_number=2']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:56.891162 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-79592181-f149-4b93-803d-d629a93cb7d6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-580051', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-783377'] for router_interface, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:56.891539 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-a9d0ab02-5fa6-4237-a82d-68d2560752f5 None None] Port 4eb6aada-4647-4cc0-b357-a3113e1607e9 cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:41:56.944559 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 4, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port': {'id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ad:c5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 474, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:54Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '4eb6aada-4647-4cc0-b357-a3113e1607e9', 'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'mac_address': 'fa:16:3e:49:34:f2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_interface', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:56Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 1, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'subnets': [{'id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:41:56.973991 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-eb8c99ff-b8b2-4548-8c3d-4fdd911c9895 None None] The sync data for ids ['4922fc58-f2eb-480a-878f-2bc3f212b4da'] in dv-cinder-804470-6-iscsi is: [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 4, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port': {'id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ad:c5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 474, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:54Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '4eb6aada-4647-4cc0-b357-a3113e1607e9', 'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'mac_address': 'fa:16:3e:49:34:f2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_interface', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:56Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 1, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'subnets': [{'id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:41:56.980817 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-79592181-f149-4b93-803d-d629a93cb7d6 admin admin] Network 000f3583-b7de-458d-9146-0010cd28b00d is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:41:56.982353 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-79592181-f149-4b93-803d-d629a93cb7d6 admin admin] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:41:57.232470 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-79ec0e1f-0834-45b7-a68d-443a44c6f330 None None] Provisioning complete for port 4eb6aada-4647-4cc0-b357-a3113e1607e9 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:57.232848 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-79ec0e1f-0834-45b7-a68d-443a44c6f330 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:57.279018 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-79ec0e1f-0834-45b7-a68d-443a44c6f330 None None] Port 4eb6aada-4647-4cc0-b357-a3113e1607e9 cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:41:57.315850 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6152f12-a7c4-4aa9-a03a-ebeab70f7ce8 req-9f56a596-10c3-4ea2-b181-3dd817c30f6e tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:57.317486 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e6152f12-a7c4-4aa9-a03a-ebeab70f7ce8 req-9f56a596-10c3-4ea2-b181-3dd817c30f6e tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 946 time: 0.0516748 Sep 18 08:41:57.320564 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-79592181-f149-4b93-803d-d629a93cb7d6 admin admin] Router 4922fc58-f2eb-480a-878f-2bc3f212b4da has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94346) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:41:57.373702 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e6152f12-a7c4-4aa9-a03a-ebeab70f7ce8 req-c979915f-30e6-4730-ae12-b18e984b4ea5 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0484147 Sep 18 08:41:57.438102 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 578ee7da-5391-495a-b55d-a0609cbf3eb1 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:41:57.441010 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-79592181-f149-4b93-803d-d629a93cb7d6 admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94346) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:41:57.445872 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-79592181-f149-4b93-803d-d629a93cb7d6 admin admin] 10.222.0.35 "PUT /v2.0/routers/4922fc58-f2eb-480a-878f-2bc3f212b4da/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7798083 Sep 18 08:41:57.497570 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 578ee7da-5391-495a-b55d-a0609cbf3eb1 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:57.497944 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:57.772187 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed169fbc-de61-40a7-b1c3-d4ae78d56e80 req-972bae84-86e3-40d2-88ee-fbfa0c1037f0 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:57.773807 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ed169fbc-de61-40a7-b1c3-d4ae78d56e80 req-972bae84-86e3-40d2-88ee-fbfa0c1037f0 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 932 time: 0.0524101 Sep 18 08:41:57.819552 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ed169fbc-de61-40a7-b1c3-d4ae78d56e80 req-1ce5bea7-aac7-4da6-848d-8a27bb552a76 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0355260 Sep 18 08:41:57.973635 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 32930) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:41:57.978543 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-e47ef2bb-b30c-48ec-ae23-9b4be55dccc0 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-977916314-network', 'tenant_id': '4d7fa64820344320b93dffee809df6ff'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:41:58.002373 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e47ef2bb-b30c-48ec-ae23-9b4be55dccc0 admin admin] Made reservation on behalf of 4d7fa64820344320b93dffee809df6ff for: {'network': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:41:58.004740 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-e47ef2bb-b30c-48ec-ae23-9b4be55dccc0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for network, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:58.014260 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-e47ef2bb-b30c-48ec-ae23-9b4be55dccc0 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:58.105510 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-e47ef2bb-b30c-48ec-ae23-9b4be55dccc0 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:58.109263 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-e47ef2bb-b30c-48ec-ae23-9b4be55dccc0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:58.134215 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e47ef2bb-b30c-48ec-ae23-9b4be55dccc0 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 217} {{(pid=94346) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 18 08:41:58.144827 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e47ef2bb-b30c-48ec-ae23-9b4be55dccc0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=26d5aef2-7f70-4a6c-88b0-a9b75f962e74,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:58.149758 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-e47ef2bb-b30c-48ec-ae23-9b4be55dccc0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:58.150100 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.db.segments_db [None req-e47ef2bb-b30c-48ec-ae23-9b4be55dccc0 admin admin] Added segment 8465a312-532d-4cae-ae69-08750a6f234e of type vlan for network 381227c0-612c-49cf-a6b8-b4b55d31fb02 Sep 18 08:41:58.193350 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-e47ef2bb-b30c-48ec-ae23-9b4be55dccc0 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732885226527'] for network, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:58.218442 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-e47ef2bb-b30c-48ec-ae23-9b4be55dccc0 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for network, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:58.219925 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e47ef2bb-b30c-48ec-ae23-9b4be55dccc0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:58.220515 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-e47ef2bb-b30c-48ec-ae23-9b4be55dccc0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:58.249449 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-e47ef2bb-b30c-48ec-ae23-9b4be55dccc0 admin admin] 10.222.0.35 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.2746603 Sep 18 08:41:58.252192 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 32934) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:41:58.257094 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-eacc3f92-b450-4e26-86f4-38617b1d44a1 admin admin] Request body: {'subnet': {'network_id': '381227c0-612c-49cf-a6b8-b4b55d31fb02', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-977916314-subnet', 'tenant_id': '4d7fa64820344320b93dffee809df6ff', 'ip_version': 4}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:41:58.297715 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e47ef2bb-b30c-48ec-ae23-9b4be55dccc0 admin admin] Pushing event updated for resources: {'Network': ['ID=381227c0-612c-49cf-a6b8-b4b55d31fb02,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:58.308351 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Network 381227c0-612c-49cf-a6b8-b4b55d31fb02 details requested by agent ovs-agent-dv-cinder-804470-6-iscsi with host dv-cinder-804470-6-iscsi {{(pid=94348) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 18 08:41:58.309298 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eacc3f92-b450-4e26-86f4-38617b1d44a1 admin admin] Made reservation on behalf of 4d7fa64820344320b93dffee809df6ff for: {'subnet': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:41:58.311682 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-eacc3f92-b450-4e26-86f4-38617b1d44a1 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-14198618'] for subnet, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:58.479881 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-eacc3f92-b450-4e26-86f4-38617b1d44a1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-14290078', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-14198644'] for subnet, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:58.481976 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33a575c6-ca87-4a2a-aa81-794be90b70a5 req-e594c043-3349-4d53-a528-88eecf5b92a4 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:58.483486 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-33a575c6-ca87-4a2a-aa81-794be90b70a5 req-e594c043-3349-4d53-a528-88eecf5b92a4 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 946 time: 0.0516284 Sep 18 08:41:58.524836 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-33a575c6-ca87-4a2a-aa81-794be90b70a5 req-7df1cf0a-7ad6-4a23-8b67-697ac1dbe396 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0353577 Sep 18 08:41:58.535690 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eacc3f92-b450-4e26-86f4-38617b1d44a1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=75555034-92fb-4ece-a037-0b068488ec29,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:58.542889 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eacc3f92-b450-4e26-86f4-38617b1d44a1 admin admin] Checking segment: {'id': '8465a312-532d-4cae-ae69-08750a6f234e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 217, 'network_id': '381227c0-612c-49cf-a6b8-b4b55d31fb02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94346) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:41:58.543244 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eacc3f92-b450-4e26-86f4-38617b1d44a1 admin admin] Network hostable DHCP agents. Network: 381227c0-612c-49cf-a6b8-b4b55d31fb02, hostable agents: ['6aaa6222-6d04-44a7-b807-bfc2cbd3e99f'], hosted agents: [] {{(pid=94346) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 18 08:41:58.559358 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eacc3f92-b450-4e26-86f4-38617b1d44a1 admin admin] Network 381227c0-612c-49cf-a6b8-b4b55d31fb02 is scheduled to be hosted by DHCP agent 6aaa6222-6d04-44a7-b807-bfc2cbd3e99f with binding_index 1 {{(pid=94346) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 18 08:41:58.568001 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-eacc3f92-b450-4e26-86f4-38617b1d44a1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804470-6-iscsi, 381227c0-612c-49cf-a6b8-b4b55d31fb02) {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:41:58.571935 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eacc3f92-b450-4e26-86f4-38617b1d44a1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:58.572538 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-eacc3f92-b450-4e26-86f4-38617b1d44a1 admin admin] Notify callbacks [] for subnet, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:58.577618 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a4a9850f-6286-47a3-a2b4-227502b8ebaa None None] Network 381227c0-612c-49cf-a6b8-b4b55d31fb02 requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:41:58.586273 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-eacc3f92-b450-4e26-86f4-38617b1d44a1 admin admin] 10.222.0.35 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.3330209 Sep 18 08:41:58.588948 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 32938) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:41:58.593466 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-c62a7093-36c3-4339-95ba-b015cfb856ab admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-977916314-router', 'tenant_id': '4d7fa64820344320b93dffee809df6ff', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:41:58.616501 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c62a7093-36c3-4339-95ba-b015cfb856ab admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-784001', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2995'] for router, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:58.618040 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c62a7093-36c3-4339-95ba-b015cfb856ab admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-782353', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-784513', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-710924', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2984'] for router, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:58.680176 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c62a7093-36c3-4339-95ba-b015cfb856ab admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:58.737827 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-57e53fd5-180a-484c-9350-503165164ead None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp22fa9bf9-2738-5c16-87a3-3f58ee5e2dc2-381227c0-612c-49cf-a6b8-b4b55d31fb02', 'network_id': '381227c0-612c-49cf-a6b8-b4b55d31fb02', 'tenant_id': '4d7fa64820344320b93dffee809df6ff', 'fixed_ips': [{'subnet_id': '75555034-92fb-4ece-a037-0b068488ec29'}]}} from dv-cinder-804470-6-iscsi. {{(pid=94348) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 18 08:41:58.739762 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-57e53fd5-180a-484c-9350-503165164ead None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:58.826665 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c62a7093-36c3-4339-95ba-b015cfb856ab admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:58.878555 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.db_base_plugin_common [None req-57e53fd5-180a-484c-9350-503165164ead None None] Allocated IP 172.20.0.2 (381227c0-612c-49cf-a6b8-b4b55d31fb02/75555034-92fb-4ece-a037-0b068488ec29/218f0876-0173-499c-8e72-f52a4f3e02b5) {{(pid=94348) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:41:58.960493 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73cec269-432f-4d24-9cda-1f143a95e869 req-d51f04d6-7e2e-4730-8ba8-82c78cd52095 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:58.962072 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-73cec269-432f-4d24-9cda-1f143a95e869 req-d51f04d6-7e2e-4730-8ba8-82c78cd52095 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 932 time: 0.0650375 Sep 18 08:41:58.980630 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] Sync routers for ids ['4922fc58-f2eb-480a-878f-2bc3f212b4da'] in dv-cinder-804470-6-iscsi {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:41:59.024406 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] Routers {'4922fc58-f2eb-480a-878f-2bc3f212b4da'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:41:59.025038 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:41:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['4922fc58-f2eb-480a-878f-2bc3f212b4da'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:41:59.082937 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-57e53fd5-180a-484c-9350-503165164ead None None] Notify callbacks [] for port, precommit_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:59.085330 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-73cec269-432f-4d24-9cda-1f143a95e869 req-4696ed64-4282-4bab-9c71-63c8f4bff862 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1146634 Sep 18 08:41:59.093413 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-57e53fd5-180a-484c-9350-503165164ead None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528'] for port, after_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:59.109074 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c62a7093-36c3-4339-95ba-b015cfb856ab admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:59.128468 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c62a7093-36c3-4339-95ba-b015cfb856ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:59.166000 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-57e53fd5-180a-484c-9350-503165164ead None None] Network 381227c0-612c-49cf-a6b8-b4b55d31fb02 is already hosted by enough agents. {{(pid=94348) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:41:59.175060 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.scheduler.base_scheduler [None req-57e53fd5-180a-484c-9350-503165164ead None None] Resources bound (agent type, host, resource id): {{(pid=94348) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:41:59.181016 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-57e53fd5-180a-484c-9350-503165164ead None None] Received port after_create {{(pid=94348) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:41:59.183336 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57e53fd5-180a-484c-9350-503165164ead None None] Pushing event updated for resources: {'Port': ['ID=218f0876-0173-499c-8e72-f52a4f3e02b5,revision_number=1']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:59.199138 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] Set router 4922fc58-f2eb-480a-878f-2bc3f212b4da gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:41:59.232970 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_common [None req-c62a7093-36c3-4339-95ba-b015cfb856ab admin admin] Allocated IP 172.27.1.6 (2e3b3f85-63e4-4380-917a-8c90c80b3e38/cd525bb9-7f93-490c-a5d6-a08911817e54/c6d050fc-3bc2-4b89-baaf-c1be3438b3f6) {{(pid=94347) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:41:59.290608 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-57e53fd5-180a-484c-9350-503165164ead None None] Attempting to bind port 218f0876-0173-499c-8e72-f52a4f3e02b5 on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:41:59.290982 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-57e53fd5-180a-484c-9350-503165164ead None None] Attempting to bind port 218f0876-0173-499c-8e72-f52a4f3e02b5 by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': '8465a312-532d-4cae-ae69-08750a6f234e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 217, 'network_id': '381227c0-612c-49cf-a6b8-b4b55d31fb02'}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:41:59.291353 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57e53fd5-180a-484c-9350-503165164ead None None] Attempting to bind port 218f0876-0173-499c-8e72-f52a4f3e02b5 on network 381227c0-612c-49cf-a6b8-b4b55d31fb02 {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:41:59.327159 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57e53fd5-180a-484c-9350-503165164ead None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 41, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:41:59.327971 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57e53fd5-180a-484c-9350-503165164ead None None] Checking segment: {'id': '8465a312-532d-4cae-ae69-08750a6f234e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 217, 'network_id': '381227c0-612c-49cf-a6b8-b4b55d31fb02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94348) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:41:59.327971 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-57e53fd5-180a-484c-9350-503165164ead None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:59.328325 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-57e53fd5-180a-484c-9350-503165164ead None None] Bound using segment: {'id': '8465a312-532d-4cae-ae69-08750a6f234e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 217, 'network_id': '381227c0-612c-49cf-a6b8-b4b55d31fb02'} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:41:59.328798 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-57e53fd5-180a-484c-9350-503165164ead None None] Bound port: 218f0876-0173-499c-8e72-f52a4f3e02b5, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8465a312-532d-4cae-ae69-08750a6f234e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 217, 'network_id': '381227c0-612c-49cf-a6b8-b4b55d31fb02'}}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:41:59.329186 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-57e53fd5-180a-484c-9350-503165164ead None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:59.338550 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c62a7093-36c3-4339-95ba-b015cfb856ab admin admin] Notify callbacks [] for port, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:59.376310 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c62a7093-36c3-4339-95ba-b015cfb856ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:59.421744 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c62a7093-36c3-4339-95ba-b015cfb856ab admin admin] Network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:41:59.424696 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [None req-c62a7093-36c3-4339-95ba-b015cfb856ab admin admin] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:41:59.428721 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c62a7093-36c3-4339-95ba-b015cfb856ab admin admin] Received port after_create {{(pid=94347) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:41:59.455385 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device f206227f-a59a-4423-8cb4-9d1abe6f264f up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:41:59.461170 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-57e53fd5-180a-484c-9350-503165164ead None None] For port 218f0876-0173-499c-8e72-f52a4f3e02b5, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94348) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:41:59.468887 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c62a7093-36c3-4339-95ba-b015cfb856ab admin admin] Pushing event updated for resources: {'Port': ['ID=c6d050fc-3bc2-4b89-baaf-c1be3438b3f6,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:59.630644 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-57e53fd5-180a-484c-9350-503165164ead None None] For port 218f0876-0173-499c-8e72-f52a4f3e02b5, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=218f0876-0173-499c-8e72-f52a4f3e02b5,segment=NetworkSegment(8465a312-532d-4cae-ae69-08750a6f234e),segment_id=8465a312-532d-4cae-ae69-08750a6f234e)] {{(pid=94348) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:41:59.644974 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-57e53fd5-180a-484c-9350-503165164ead None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:59.728923 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57e53fd5-180a-484c-9350-503165164ead None None] Pushing event updated for resources: {'Port': ['ID=218f0876-0173-499c-8e72-f52a4f3e02b5,revision_number=2']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:41:59.736653 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port f206227f-a59a-4423-8cb4-9d1abe6f264f triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:41:59.737036 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:59.765343 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 4, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port': {'id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ad:c5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 474, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:54Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '4eb6aada-4647-4cc0-b357-a3113e1607e9', 'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'mac_address': 'fa:16:3e:49:34:f2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_interface', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:56Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 2, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'subnets': [{'id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:41:59.796843 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] Checking router: 4922fc58-f2eb-480a-878f-2bc3f212b4da for host: dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:41:59.797801 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] Updating router 4922fc58-f2eb-480a-878f-2bc3f212b4da port 4eb6aada-4647-4cc0-b357-a3113e1607e9 binding host dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 18 08:41:59.832482 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:59.869268 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ead49306-e0ce-40fc-a155-a73a488a371b req-2f8562b5-0f28-4d2c-9900-0efe5916e54a tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:41:59.876599 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ead49306-e0ce-40fc-a155-a73a488a371b req-2f8562b5-0f28-4d2c-9900-0efe5916e54a tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 946 time: 0.1219943 Sep 18 08:41:59.933557 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:41:59.957529 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ead49306-e0ce-40fc-a155-a73a488a371b req-84dbd5c7-41b9-4e63-a030-6747dfcca698 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0800283 Sep 18 08:42:00.023782 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-536c997d-2873-442a-81bf-9fe918803742 None None] For port f206227f-a59a-4423-8cb4-9d1abe6f264f, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=f206227f-a59a-4423-8cb4-9d1abe6f264f,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:42:00.029569 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c62a7093-36c3-4339-95ba-b015cfb856ab admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:00.030310 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:00.141385 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Pushing event updated for resources: {'Port': ['ID=f206227f-a59a-4423-8cb4-9d1abe6f264f,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:00.228380 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] Notify callbacks [] for port, precommit_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:00.234714 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:00.271302 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-882da440-7145-4a6d-ae30-d9d67042ced7 req-f67512d5-48a5-4fe7-874d-8ae3714e170b tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:00.272810 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-882da440-7145-4a6d-ae30-d9d67042ced7 req-f67512d5-48a5-4fe7-874d-8ae3714e170b tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 932 time: 0.0918748 Sep 18 08:42:00.284417 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b82e80f-3c94-4deb-bb2d-2d5160e724a2 None None] Pushing event updated for resources: {'Port': ['ID=4eb6aada-4647-4cc0-b357-a3113e1607e9,revision_number=3']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:00.308656 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c62a7093-36c3-4339-95ba-b015cfb856ab admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-782366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-784982'] for router, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:00.351627 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] Attempting to bind port 4eb6aada-4647-4cc0-b357-a3113e1607e9 on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:42:00.352209 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] Attempting to bind port 4eb6aada-4647-4cc0-b357-a3113e1607e9 by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': 'c215153d-2878-4c82-8dc0-2a92b453bf12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 200, 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d'}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:42:00.352504 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] Attempting to bind port 4eb6aada-4647-4cc0-b357-a3113e1607e9 on network 000f3583-b7de-458d-9146-0010cd28b00d {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:42:00.360458 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 41, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:42:00.360718 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] Checking segment: {'id': 'c215153d-2878-4c82-8dc0-2a92b453bf12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 200, 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94348) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:42:00.361512 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:00.362978 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] Bound using segment: {'id': 'c215153d-2878-4c82-8dc0-2a92b453bf12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 200, 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d'} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:42:00.363487 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] Bound port: 4eb6aada-4647-4cc0-b357-a3113e1607e9, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c215153d-2878-4c82-8dc0-2a92b453bf12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 200, 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d'}}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:42:00.363889 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:00.376920 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-882da440-7145-4a6d-ae30-d9d67042ced7 req-9cb521b7-dccb-4570-9125-f9c8b3dde88d tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0818202 Sep 18 08:42:00.429460 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-d8249843-d099-4e00-9cfc-ddfe595e9f62 service neutron] Request body: {'port': {'device_id': 'e85a7284-e6ea-47ab-9674-09d8666b742f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80447'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:42:00.474827 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] For port 4eb6aada-4647-4cc0-b357-a3113e1607e9, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94348) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:42:00.478857 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] For port 4eb6aada-4647-4cc0-b357-a3113e1607e9, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=4eb6aada-4647-4cc0-b357-a3113e1607e9,segment=NetworkSegment(c215153d-2878-4c82-8dc0-2a92b453bf12),segment_id=c215153d-2878-4c82-8dc0-2a92b453bf12)] {{(pid=94348) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:42:00.491928 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:00.558168 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-d8249843-d099-4e00-9cfc-ddfe595e9f62 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:00.578394 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] Routers {'4922fc58-f2eb-480a-878f-2bc3f212b4da'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:42:00.579367 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:41:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['4922fc58-f2eb-480a-878f-2bc3f212b4da'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:42:00.629975 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b82e80f-3c94-4deb-bb2d-2d5160e724a2 None None] Pushing event updated for resources: {'Port': ['ID=4eb6aada-4647-4cc0-b357-a3113e1607e9,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:00.642642 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c62a7093-36c3-4339-95ba-b015cfb856ab admin admin] Router 7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5 is scheduled to L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a with binding_index 1 {{(pid=94347) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 18 08:42:00.711507 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-7dfc40d8-3ec3-47e2-921e-6e477252a62d None None] Provisioning complete for port 4eb6aada-4647-4cc0-b357-a3113e1607e9 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:42:00.711887 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-7dfc40d8-3ec3-47e2-921e-6e477252a62d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:00.767514 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] Set router 4922fc58-f2eb-480a-878f-2bc3f212b4da gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:42:01.005793 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9450ab09-2581-4f09-932d-57784e475c8b None None] Network 381227c0-612c-49cf-a6b8-b4b55d31fb02 requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:42:01.031832 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-7dfc40d8-3ec3-47e2-921e-6e477252a62d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:01.041469 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-249101fc-bcbe-4157-86e0-aa7e882481ef req-6ac97bb8-61b3-4eb4-8384-be284e21f72b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:01.043603 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-249101fc-bcbe-4157-86e0-aa7e882481ef req-6ac97bb8-61b3-4eb4-8384-be284e21f72b service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 1099 time: 0.1595376 Sep 18 08:42:01.047555 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c62a7093-36c3-4339-95ba-b015cfb856ab admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94347) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:42:01.056644 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] Sync routers for ids ['7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5'] in dv-cinder-804470-6-iscsi {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:42:01.068431 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] Routers {'7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:42:01.069058 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:41:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:42:01.128951 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c62a7093-36c3-4339-95ba-b015cfb856ab admin admin] Notify callbacks [] for router, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:01.130294 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-c62a7093-36c3-4339-95ba-b015cfb856ab admin admin] 10.222.0.35 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 2.5401919 Sep 18 08:42:01.133005 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 32966) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:01.144502 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-7dfc40d8-3ec3-47e2-921e-6e477252a62d None None] For port 4eb6aada-4647-4cc0-b357-a3113e1607e9, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=4eb6aada-4647-4cc0-b357-a3113e1607e9,segment=NetworkSegment(c215153d-2878-4c82-8dc0-2a92b453bf12),segment_id=c215153d-2878-4c82-8dc0-2a92b453bf12)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:42:01.157931 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-7dfc40d8-3ec3-47e2-921e-6e477252a62d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:01.177175 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-249101fc-bcbe-4157-86e0-aa7e882481ef req-ac1201b3-1b7c-4395-8648-9b8cfdeb595a service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1004369 Sep 18 08:42:01.196188 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9f2df6b-953e-4d17-b80f-c9c1ca0b0455 req-d7092473-d087-44bb-86e8-344d7de17294 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:01.197731 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e9f2df6b-953e-4d17-b80f-c9c1ca0b0455 req-d7092473-d087-44bb-86e8-344d7de17294 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 946 time: 0.1514575 Sep 18 08:42:01.207648 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] Set router 7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:42:01.234299 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 4, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port': {'id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ad:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 474, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:54Z', 'updated_at': '2021-09-18T08:41:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '4eb6aada-4647-4cc0-b357-a3113e1607e9', 'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'mac_address': 'fa:16:3e:49:34:f2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_interface', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:56Z', 'updated_at': '2021-09-18T08:42:00Z', 'revision_number': 4, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'subnets': [{'id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:42:01.254633 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-d8249843-d099-4e00-9cfc-ddfe595e9f62 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a16828fd-b0f1-4ba0-a92a-61614fabe668 {{(pid=94347) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:42:01.269172 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-d8249843-d099-4e00-9cfc-ddfe595e9f62 service neutron] Notify callbacks [] for port, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:01.283529 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-736dbc43-176b-4609-969e-ca10bcc6fd5a None None] The sync data for ids ['4922fc58-f2eb-480a-878f-2bc3f212b4da'] in dv-cinder-804470-6-iscsi is: [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 4, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port': {'id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ad:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 474, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:54Z', 'updated_at': '2021-09-18T08:41:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '4eb6aada-4647-4cc0-b357-a3113e1607e9', 'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'mac_address': 'fa:16:3e:49:34:f2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_interface', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:56Z', 'updated_at': '2021-09-18T08:42:00Z', 'revision_number': 4, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'subnets': [{'id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:42:01.283839 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e9f2df6b-953e-4d17-b80f-c9c1ca0b0455 req-b2fc0de1-34f2-477d-837e-28b7f9ff851f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0628400 Sep 18 08:42:01.311604 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.provisioning_blocks [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-d8249843-d099-4e00-9cfc-ddfe595e9f62 service neutron] Transition to ACTIVE for port object a16828fd-b0f1-4ba0-a92a-61614fabe668 will not be triggered until provisioned by entity L2. {{(pid=94347) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 18 08:42:01.317586 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-d8249843-d099-4e00-9cfc-ddfe595e9f62 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:01.320000 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dfc40d8-3ec3-47e2-921e-6e477252a62d None None] Pushing event updated for resources: {'Port': ['ID=4eb6aada-4647-4cc0-b357-a3113e1607e9,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:01.366778 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-f7c981b2-b100-4b29-a599-dd55b62cec5a None None] Provisioning complete for port 4eb6aada-4647-4cc0-b357-a3113e1607e9 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:42:01.366778 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-f7c981b2-b100-4b29-a599-dd55b62cec5a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:01.540195 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8249843-d099-4e00-9cfc-ddfe595e9f62 service neutron] Pushing event updated for resources: {'Port': ['ID=a16828fd-b0f1-4ba0-a92a-61614fabe668,revision_number=2']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:01.621480 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-f7c981b2-b100-4b29-a599-dd55b62cec5a None None] Provisioning complete for port 218f0876-0173-499c-8e72-f52a4f3e02b5 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:42:01.623101 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-f7c981b2-b100-4b29-a599-dd55b62cec5a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:01.631053 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5', 'name': 'tempest-TestVolumeBootPattern-977916314-router', 'tenant_id': '4d7fa64820344320b93dffee809df6ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.6'}], 'enable_snat': True}, 'gw_port_id': 'c6d050fc-3bc2-4b89-baaf-c1be3438b3f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:58Z', 'updated_at': '2021-09-18T08:41:59Z', 'revision_number': 3, 'project_id': '4d7fa64820344320b93dffee809df6ff', 'gw_port': {'id': 'c6d050fc-3bc2-4b89-baaf-c1be3438b3f6', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:ae:b8:e1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 486, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:59Z', 'updated_at': '2021-09-18T08:41:59Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:42:01.742851 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] Checking router: 7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5 for host: dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:42:01.742851 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] Updating router 7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5 port c6d050fc-3bc2-4b89-baaf-c1be3438b3f6 binding host dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 18 08:42:01.755913 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device f206227f-a59a-4423-8cb4-9d1abe6f264f up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:42:01.795708 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-d8249843-d099-4e00-9cfc-ddfe595e9f62 service neutron] Attempting to bind port a16828fd-b0f1-4ba0-a92a-61614fabe668 on host hv-cinder-80447 for vnic_type normal with profile {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:42:01.796408 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-d8249843-d099-4e00-9cfc-ddfe595e9f62 service neutron] Attempting to bind port a16828fd-b0f1-4ba0-a92a-61614fabe668 by drivers openvswitch,hyperv on host hv-cinder-80447 at level 0 using segments [{'id': '5d556fd8-f02d-4c49-9c67-863cea39ec4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 238, 'network_id': '48bd9423-5b85-4344-9434-17e10e227731'}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:42:01.797426 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-d8249843-d099-4e00-9cfc-ddfe595e9f62 service neutron] Attempting to bind port a16828fd-b0f1-4ba0-a92a-61614fabe668 on network 48bd9423-5b85-4344-9434-17e10e227731 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:42:01.804358 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:01.809854 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-d8249843-d099-4e00-9cfc-ddfe595e9f62 service neutron] Port a16828fd-b0f1-4ba0-a92a-61614fabe668 on network 48bd9423-5b85-4344-9434-17e10e227731 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80447 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 18 08:42:01.810504 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-d8249843-d099-4e00-9cfc-ddfe595e9f62 service neutron] Attempting to bind port a16828fd-b0f1-4ba0-a92a-61614fabe668 on network 48bd9423-5b85-4344-9434-17e10e227731 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:42:01.825865 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52525610-bd1b-4f51-8c39-a4de7182509b req-953dddec-a02e-4614-addb-f7e9036a7829 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:01.833903 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-52525610-bd1b-4f51-8c39-a4de7182509b req-953dddec-a02e-4614-addb-f7e9036a7829 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 944 time: 0.2124386 Sep 18 08:42:01.837066 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-d8249843-d099-4e00-9cfc-ddfe595e9f62 service neutron] Checking agent: {'id': '8d51fdc4-974b-4200-9c3f-5dddea60a869', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80447', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'started_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 41, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:42:01.837664 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-d8249843-d099-4e00-9cfc-ddfe595e9f62 service neutron] Checking segment: {'id': '5d556fd8-f02d-4c49-9c67-863cea39ec4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 238, 'network_id': '48bd9423-5b85-4344-9434-17e10e227731'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94347) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:42:01.838279 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-d8249843-d099-4e00-9cfc-ddfe595e9f62 service neutron] Bound using segment: {'id': '5d556fd8-f02d-4c49-9c67-863cea39ec4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 238, 'network_id': '48bd9423-5b85-4344-9434-17e10e227731'} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:42:01.839500 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-d8249843-d099-4e00-9cfc-ddfe595e9f62 service neutron] Bound port: a16828fd-b0f1-4ba0-a92a-61614fabe668, host: hv-cinder-80447, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5d556fd8-f02d-4c49-9c67-863cea39ec4a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 238, 'network_id': '48bd9423-5b85-4344-9434-17e10e227731'}}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:42:01.840078 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-d8249843-d099-4e00-9cfc-ddfe595e9f62 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:01.966000 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-f7c981b2-b100-4b29-a599-dd55b62cec5a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:01.999448 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port f206227f-a59a-4423-8cb4-9d1abe6f264f triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:42:02.000428 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:02.028781 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-52525610-bd1b-4f51-8c39-a4de7182509b req-5def13f1-8500-4184-a027-68c04bccf563 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1935318 Sep 18 08:42:02.032687 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-d8249843-d099-4e00-9cfc-ddfe595e9f62 service neutron] For port a16828fd-b0f1-4ba0-a92a-61614fabe668, host hv-cinder-80447, cleared binding levels {{(pid=94347) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:42:02.045564 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-d8249843-d099-4e00-9cfc-ddfe595e9f62 service neutron] For port a16828fd-b0f1-4ba0-a92a-61614fabe668, host hv-cinder-80447, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=a16828fd-b0f1-4ba0-a92a-61614fabe668,segment=NetworkSegment(5d556fd8-f02d-4c49-9c67-863cea39ec4a),segment_id=5d556fd8-f02d-4c49-9c67-863cea39ec4a)] {{(pid=94347) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:42:02.053806 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-d8249843-d099-4e00-9cfc-ddfe595e9f62 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:02.075543 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-f7c981b2-b100-4b29-a599-dd55b62cec5a None None] For port 218f0876-0173-499c-8e72-f52a4f3e02b5, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=218f0876-0173-499c-8e72-f52a4f3e02b5,segment=NetworkSegment(8465a312-532d-4cae-ae69-08750a6f234e),segment_id=8465a312-532d-4cae-ae69-08750a6f234e)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:42:02.085644 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-f7c981b2-b100-4b29-a599-dd55b62cec5a None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:02.115341 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-d8249843-d099-4e00-9cfc-ddfe595e9f62 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:02.115970 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-d8249843-d099-4e00-9cfc-ddfe595e9f62 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:02.117416 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-d8249843-d099-4e00-9cfc-ddfe595e9f62 service neutron] 10.222.0.13 "PUT /v2.0/ports/a16828fd-b0f1-4ba0-a92a-61614fabe668 HTTP/1.1" status: 200 len: 1094 time: 1.6922174 Sep 18 08:42:02.117858 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e85a7284-e6ea-47ab-9674-09d8666b742f', 'tag': 'a16828fd-b0f1-4ba0-a92a-61614fabe668'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:42:02.121421 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a1d4aaf8-624e-4329-a7f1-4748626e9de4" -d '{"events": [{"name": "network-changed", "server_uuid": "e85a7284-e6ea-47ab-9674-09d8666b742f", "tag": "a16828fd-b0f1-4ba0-a92a-61614fabe668"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:42:02.122869 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dea96bd0-70cb-4a33-8460-1307dff5b60f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:02.206718 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:42:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-acf898b3-8347-49fb-8088-cca8acec8280 x-openstack-request-id: req-acf898b3-8347-49fb-8088-cca8acec8280 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:42:02.207008 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e85a7284-e6ea-47ab-9674-09d8666b742f", "tag": "a16828fd-b0f1-4ba0-a92a-61614fabe668", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:42:02.207852 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-acf898b3-8347-49fb-8088-cca8acec8280 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:42:02.208418 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e85a7284-e6ea-47ab-9674-09d8666b742f', 'tag': 'a16828fd-b0f1-4ba0-a92a-61614fabe668', 'status': 'completed', 'code': 200} Sep 18 08:42:02.214441 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8249843-d099-4e00-9cfc-ddfe595e9f62 service neutron] Pushing event updated for resources: {'Port': ['ID=a16828fd-b0f1-4ba0-a92a-61614fabe668,revision_number=3']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:02.255529 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7c981b2-b100-4b29-a599-dd55b62cec5a None None] Pushing event updated for resources: {'Port': ['ID=218f0876-0173-499c-8e72-f52a4f3e02b5,revision_number=3']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:02.310307 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 4eb6aada-4647-4cc0-b357-a3113e1607e9 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:42:02.378093 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_common [None req-dea96bd0-70cb-4a33-8460-1307dff5b60f admin admin] Allocated IP 172.20.0.1 (381227c0-612c-49cf-a6b8-b4b55d31fb02/75555034-92fb-4ece-a037-0b068488ec29/4fbf206e-55b5-4ee6-ab2b-e3d758a81072) {{(pid=94346) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:42:02.382597 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-dbe16bd9-879e-4b31-a8df-9745428a413a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:02.384483 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-dbe16bd9-879e-4b31-a8df-9745428a413a service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=62a8d3b5ed4d4fe085db724f264e25c4&device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 1097 time: 0.0999122 Sep 18 08:42:02.391898 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-68ccfbbb-18b8-4bb2-b8b7-1315d0d96c69 None None] Provisioning complete for port 218f0876-0173-499c-8e72-f52a4f3e02b5 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:42:02.392472 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-68ccfbbb-18b8-4bb2-b8b7-1315d0d96c69 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:02.499636 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 4eb6aada-4647-4cc0-b357-a3113e1607e9 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:42:02.500123 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:02.520081 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dea96bd0-70cb-4a33-8460-1307dff5b60f admin admin] Notify callbacks [] for port, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:02.531541 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-dc0f81e9-f909-4eda-951f-353aeb261f04 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a16828fd-b0f1-4ba0-a92a-61614fabe668 HTTP/1.1" status: 200 len: 217 time: 0.1260643 Sep 18 08:42:02.561024 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] Notify callbacks [] for port, precommit_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:02.569287 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:02.586486 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dea96bd0-70cb-4a33-8460-1307dff5b60f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:02.591909 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1564514-5b30-44dd-8c8e-bcaf159bea37 req-cb5d75a9-c94b-4adf-be6e-d8021f93a574 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:02.608567 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d1564514-5b30-44dd-8c8e-bcaf159bea37 req-cb5d75a9-c94b-4adf-be6e-d8021f93a574 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 946 time: 0.2138579 Sep 18 08:42:02.637344 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] Attempting to bind port c6d050fc-3bc2-4b89-baaf-c1be3438b3f6 on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:42:02.637784 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] Attempting to bind port c6d050fc-3bc2-4b89-baaf-c1be3438b3f6 by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}] {{(pid=94349) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:42:02.638255 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] Attempting to bind port c6d050fc-3bc2-4b89-baaf-c1be3438b3f6 on network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:42:02.639268 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dea96bd0-70cb-4a33-8460-1307dff5b60f admin admin] Network 381227c0-612c-49cf-a6b8-b4b55d31fb02 is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:42:02.643953 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-cd93170b-5c01-4005-aa9d-1597c5cbac27 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:02.644158 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d03e1e2-cb91-4dd8-b034-4127c1240b7c None None] Pushing event updated for resources: {'Port': ['ID=c6d050fc-3bc2-4b89-baaf-c1be3438b3f6,revision_number=2']} {{(pid=94349) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:02.644464 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-dea96bd0-70cb-4a33-8460-1307dff5b60f admin admin] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:42:02.645262 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-cd93170b-5c01-4005-aa9d-1597c5cbac27 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=95fb2797-9ac9-40f9-9ea9-56d2c5a16291 HTTP/1.1" status: 200 len: 854 time: 0.1075902 Sep 18 08:42:02.646771 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 41, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:42:02.647319 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] Checking segment: {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94349) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:42:02.647835 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:02.648403 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] Bound using segment: {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'} {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:42:02.648976 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] Bound port: c6d050fc-3bc2-4b89-baaf-c1be3438b3f6, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}}] {{(pid=94349) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:42:02.649555 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:02.657451 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dea96bd0-70cb-4a33-8460-1307dff5b60f admin admin] Received port after_create {{(pid=94346) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:42:02.671514 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d1564514-5b30-44dd-8c8e-bcaf159bea37 req-5c76fe7a-39d9-41f0-9af3-edfc5fb277fc tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0620821 Sep 18 08:42:02.706563 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-831f444b-0ae0-4543-a69b-b224f7496018 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:02.708915 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-831f444b-0ae0-4543-a69b-b224f7496018 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=48bd9423-5b85-4344-9434-17e10e227731&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0544219 Sep 18 08:42:02.715407 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dea96bd0-70cb-4a33-8460-1307dff5b60f admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-785025'] for router_interface, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:02.720762 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.db [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] For port c6d050fc-3bc2-4b89-baaf-c1be3438b3f6, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94349) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:42:02.725522 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.db [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] For port c6d050fc-3bc2-4b89-baaf-c1be3438b3f6, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=c6d050fc-3bc2-4b89-baaf-c1be3438b3f6,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94349) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:42:02.734412 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:02.747925 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 218f0876-0173-499c-8e72-f52a4f3e02b5 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:42:02.769266 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dea96bd0-70cb-4a33-8460-1307dff5b60f admin admin] Pushing event updated for resources: {'Port': ['ID=4fbf206e-55b5-4ee6-ab2b-e3d758a81072,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:02.856458 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] Routers {'7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:42:02.856458 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:41:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:42:02.946064 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dea96bd0-70cb-4a33-8460-1307dff5b60f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:02.946190 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d03e1e2-cb91-4dd8-b034-4127c1240b7c None None] Pushing event updated for resources: {'Port': ['ID=c6d050fc-3bc2-4b89-baaf-c1be3438b3f6,revision_number=3']} {{(pid=94349) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:02.949411 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-b01349a2-2d2f-4d9e-8999-bbc2e1d61368 service neutron] 10.222.0.13 "GET /v2.0/networks/48bd9423-5b85-4344-9434-17e10e227731?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2322025 Sep 18 08:42:03.081276 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 218f0876-0173-499c-8e72-f52a4f3e02b5 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:42:03.081665 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:03.083310 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] Set router 7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:42:03.157224 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dea96bd0-70cb-4a33-8460-1307dff5b60f admin admin] Notify callbacks [] for port, precommit_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:03.165693 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dea96bd0-70cb-4a33-8460-1307dff5b60f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14290155'] for port, after_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:03.182224 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-7b27dc95-adc1-4d60-8879-e47dd5aea4a1 None None] Provisioning complete for port 4fbf206e-55b5-4ee6-ab2b-e3d758a81072 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:42:03.183394 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-7b27dc95-adc1-4d60-8879-e47dd5aea4a1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:03.232495 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-7b27dc95-adc1-4d60-8879-e47dd5aea4a1 None None] Port 4fbf206e-55b5-4ee6-ab2b-e3d758a81072 cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:42:03.240554 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cc2f996-6eeb-41be-b140-089815f2412f req-b7988cf2-0776-4c7f-8bff-72505abbb2be tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:03.242756 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2cc2f996-6eeb-41be-b140-089815f2412f req-b7988cf2-0776-4c7f-8bff-72505abbb2be tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 944 time: 0.0780828 Sep 18 08:42:03.248136 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dea96bd0-70cb-4a33-8460-1307dff5b60f admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-580051', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-783377'] for router_interface, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:03.248412 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f539a1de-b5f7-4761-a0bf-36126d27973d req-72e7732c-5f4e-47ed-af8b-5cf640b54059 service neutron] 10.222.0.13 "GET /v2.0/networks/48bd9423-5b85-4344-9434-17e10e227731?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2634640 Sep 18 08:42:03.249632 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dea96bd0-70cb-4a33-8460-1307dff5b60f admin admin] Pushing event updated for resources: {'Port': ['ID=4fbf206e-55b5-4ee6-ab2b-e3d758a81072,revision_number=2']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:03.289485 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2cc2f996-6eeb-41be-b140-089815f2412f req-3a1200c2-b7d6-454f-9490-de2ed4963d9c tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0384436 Sep 18 08:42:03.352536 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dea96bd0-70cb-4a33-8460-1307dff5b60f admin admin] Network 381227c0-612c-49cf-a6b8-b4b55d31fb02 is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:42:03.353979 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-dea96bd0-70cb-4a33-8460-1307dff5b60f admin admin] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:42:03.380807 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5', 'name': 'tempest-TestVolumeBootPattern-977916314-router', 'tenant_id': '4d7fa64820344320b93dffee809df6ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.6'}], 'enable_snat': True}, 'gw_port_id': 'c6d050fc-3bc2-4b89-baaf-c1be3438b3f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:58Z', 'updated_at': '2021-09-18T08:42:02Z', 'revision_number': 4, 'project_id': '4d7fa64820344320b93dffee809df6ff', 'gw_port': {'id': 'c6d050fc-3bc2-4b89-baaf-c1be3438b3f6', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:ae:b8:e1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 486, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:59Z', 'updated_at': '2021-09-18T08:42:02Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '4fbf206e-55b5-4ee6-ab2b-e3d758a81072', 'name': '', 'network_id': '381227c0-612c-49cf-a6b8-b4b55d31fb02', 'tenant_id': '4d7fa64820344320b93dffee809df6ff', 'mac_address': 'fa:16:3e:3a:6f:fc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': '75555034-92fb-4ece-a037-0b068488ec29', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:42:02Z', 'updated_at': '2021-09-18T08:42:02Z', 'revision_number': 1, 'project_id': '4d7fa64820344320b93dffee809df6ff', 'subnets': [{'id': '75555034-92fb-4ece-a037-0b068488ec29', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:42:03.420887 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ec42f29-de02-472c-be04-dca522e86661 None None] The sync data for ids ['7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5'] in dv-cinder-804470-6-iscsi is: [{'id': '7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5', 'name': 'tempest-TestVolumeBootPattern-977916314-router', 'tenant_id': '4d7fa64820344320b93dffee809df6ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.6'}], 'enable_snat': True}, 'gw_port_id': 'c6d050fc-3bc2-4b89-baaf-c1be3438b3f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:58Z', 'updated_at': '2021-09-18T08:42:02Z', 'revision_number': 4, 'project_id': '4d7fa64820344320b93dffee809df6ff', 'gw_port': {'id': 'c6d050fc-3bc2-4b89-baaf-c1be3438b3f6', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:ae:b8:e1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 486, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:59Z', 'updated_at': '2021-09-18T08:42:02Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '4fbf206e-55b5-4ee6-ab2b-e3d758a81072', 'name': '', 'network_id': '381227c0-612c-49cf-a6b8-b4b55d31fb02', 'tenant_id': '4d7fa64820344320b93dffee809df6ff', 'mac_address': 'fa:16:3e:3a:6f:fc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': '75555034-92fb-4ece-a037-0b068488ec29', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:42:02Z', 'updated_at': '2021-09-18T08:42:02Z', 'revision_number': 1, 'project_id': '4d7fa64820344320b93dffee809df6ff', 'subnets': [{'id': '75555034-92fb-4ece-a037-0b068488ec29', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:42:03.455830 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 218f0876-0173-499c-8e72-f52a4f3e02b5 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:42:03.475468 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1d4aaf8-624e-4329-a7f1-4748626e9de4 req-8e3441fb-81f2-4413-979b-d411d91cca13 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:03.476948 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a1d4aaf8-624e-4329-a7f1-4748626e9de4 req-8e3441fb-81f2-4413-979b-d411d91cca13 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=62a8d3b5ed4d4fe085db724f264e25c4&device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 1097 time: 0.0685298 Sep 18 08:42:03.517420 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dea96bd0-70cb-4a33-8460-1307dff5b60f admin admin] Router 7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5 has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94346) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:42:03.530720 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 218f0876-0173-499c-8e72-f52a4f3e02b5 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:42:03.531109 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:03.614934 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1d4aaf8-624e-4329-a7f1-4748626e9de4 req-ee0fb49c-805c-4d2b-80dd-ca7e83d2e664 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:03.616866 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a1d4aaf8-624e-4329-a7f1-4748626e9de4 req-ee0fb49c-805c-4d2b-80dd-ca7e83d2e664 service neutron] 10.222.0.13 "GET /v2.0/networks?id=48bd9423-5b85-4344-9434-17e10e227731 HTTP/1.1" status: 200 len: 916 time: 0.1312044 Sep 18 08:42:03.658971 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-7c102053-6fbc-4370-9cec-03cba5a7f76d None None] Provisioning complete for port 4fbf206e-55b5-4ee6-ab2b-e3d758a81072 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:42:03.659574 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-7c102053-6fbc-4370-9cec-03cba5a7f76d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:03.660376 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dea96bd0-70cb-4a33-8460-1307dff5b60f admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94346) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:42:03.674381 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-dea96bd0-70cb-4a33-8460-1307dff5b60f admin admin] 10.222.0.35 "PUT /v2.0/routers/7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5315638 Sep 18 08:42:03.684507 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a1d4aaf8-624e-4329-a7f1-4748626e9de4 req-8cbcff13-5ffc-4c59-85cb-181cd9b03564 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a16828fd-b0f1-4ba0-a92a-61614fabe668 HTTP/1.1" status: 200 len: 217 time: 0.0546527 Sep 18 08:42:03.705542 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-7c102053-6fbc-4370-9cec-03cba5a7f76d None None] Port 4fbf206e-55b5-4ee6-ab2b-e3d758a81072 cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:42:03.822957 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1d4aaf8-624e-4329-a7f1-4748626e9de4 req-f9bedade-b248-4dd3-9240-5bed88771a73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:03.824827 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a1d4aaf8-624e-4329-a7f1-4748626e9de4 req-f9bedade-b248-4dd3-9240-5bed88771a73 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=95fb2797-9ac9-40f9-9ea9-56d2c5a16291 HTTP/1.1" status: 200 len: 854 time: 0.0952020 Sep 18 08:42:03.857300 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8d1c0e5-c639-4495-89e1-3412bbe7060b req-9dc20941-4e72-4c98-8e3f-e772715d1d6a tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:03.858862 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c8d1c0e5-c639-4495-89e1-3412bbe7060b req-9dc20941-4e72-4c98-8e3f-e772715d1d6a tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 946 time: 0.1000686 Sep 18 08:42:03.920255 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1d4aaf8-624e-4329-a7f1-4748626e9de4 req-14586485-3f0b-4608-a26e-068d82812ee4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:03.921806 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a1d4aaf8-624e-4329-a7f1-4748626e9de4 req-14586485-3f0b-4608-a26e-068d82812ee4 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=48bd9423-5b85-4344-9434-17e10e227731&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0875127 Sep 18 08:42:03.936385 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c8d1c0e5-c639-4495-89e1-3412bbe7060b req-78bb6442-00df-4d4a-a7da-32747db11d1a tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0579503 Sep 18 08:42:04.024307 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a1d4aaf8-624e-4329-a7f1-4748626e9de4 req-9750fe6f-2274-447a-a2c6-c181791873a2 service neutron] 10.222.0.13 "GET /v2.0/networks/48bd9423-5b85-4344-9434-17e10e227731?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0866561 Sep 18 08:42:04.152464 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a1d4aaf8-624e-4329-a7f1-4748626e9de4 req-7dda2cd8-c281-4415-8b17-97861ccf4a9c service neutron] 10.222.0.13 "GET /v2.0/networks/48bd9423-5b85-4344-9434-17e10e227731?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1095498 Sep 18 08:42:04.383603 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 33026) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:04.388951 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-71e79c9e-7ceb-4d10-835b-a472f3c50ecb tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-143517560', 'description': 'tempest-secgroup-smoke-143517560 description', 'project_id': '0c7c58787ad549afa94b716f4c2f187b'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:42:04.413125 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-71e79c9e-7ceb-4d10-835b-a472f3c50ecb tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:04.440608 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec897f57-2755-44b7-bd57-c576a0a1b259 req-e4b34b28-c978-4c5b-ac49-421f78bd7e7e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:04.442680 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ec897f57-2755-44b7-bd57-c576a0a1b259 req-e4b34b28-c978-4c5b-ac49-421f78bd7e7e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 944 time: 0.0698197 Sep 18 08:42:04.487447 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ec897f57-2755-44b7-bd57-c576a0a1b259 req-5c0c0eb2-8ddf-4297-87ea-e0acc8c3e9f5 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0387812 Sep 18 08:42:04.528616 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-71e79c9e-7ceb-4d10-835b-a472f3c50ecb tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:04.534001 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-71e79c9e-7ceb-4d10-835b-a472f3c50ecb tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:04.567428 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-71e79c9e-7ceb-4d10-835b-a472f3c50ecb tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:04.568684 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-71e79c9e-7ceb-4d10-835b-a472f3c50ecb tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1792 time: 0.1837249 Sep 18 08:42:04.571715 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 33030) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:04.576500 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-dd435c12-6b0e-4576-8433-223258e15086 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Request body: {'security_group_rule': {'security_group_id': 'c480fa62-0ee8-4f20-8da2-07bbb721cd7c', 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:42:04.581170 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71e79c9e-7ceb-4d10-835b-a472f3c50ecb tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c480fa62-0ee8-4f20-8da2-07bbb721cd7c,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:04.611943 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dd435c12-6b0e-4576-8433-223258e15086 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:04.675195 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dd435c12-6b0e-4576-8433-223258e15086 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:04.681627 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dd435c12-6b0e-4576-8433-223258e15086 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-561193'] for security_group_rule, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:04.700430 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd435c12-6b0e-4576-8433-223258e15086 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0efe1ffa-3ffc-4a8e-883a-8f82daf43d40,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:04.709453 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dd435c12-6b0e-4576-8433-223258e15086 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:04.711342 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-dd435c12-6b0e-4576-8433-223258e15086 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1381323 Sep 18 08:42:04.713758 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 33036) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:04.718461 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-c9a76f0a-b5aa-4bec-ac1d-5eef5edb1215 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Request body: {'security_group_rule': {'security_group_id': 'c480fa62-0ee8-4f20-8da2-07bbb721cd7c', 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:42:04.757758 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c9a76f0a-b5aa-4bec-ac1d-5eef5edb1215 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:04.817410 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c9a76f0a-b5aa-4bec-ac1d-5eef5edb1215 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:04.824376 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c9a76f0a-b5aa-4bec-ac1d-5eef5edb1215 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-561193'] for security_group_rule, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:04.844559 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9a76f0a-b5aa-4bec-ac1d-5eef5edb1215 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=604a2d45-22ce-45d6-bf8a-dd93188fbb51,revision_number=0']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:04.857592 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c9a76f0a-b5aa-4bec-ac1d-5eef5edb1215 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:04.858858 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-c9a76f0a-b5aa-4bec-ac1d-5eef5edb1215 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1439862 Sep 18 08:42:04.861946 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 33044) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:04.867084 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-60bdf054-bc77-4627-8e9c-064953b2ff11 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Request body: {'security_group_rule': {'security_group_id': 'c480fa62-0ee8-4f20-8da2-07bbb721cd7c', 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:42:04.899441 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-60bdf054-bc77-4627-8e9c-064953b2ff11 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:04.928881 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce182f7c-c038-48e4-9d87-14a92daba7fc req-b7a04744-8c82-46b9-813d-fca16c7744e8 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:04.930429 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ce182f7c-c038-48e4-9d87-14a92daba7fc req-b7a04744-8c82-46b9-813d-fca16c7744e8 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0489166 Sep 18 08:42:04.964414 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-60bdf054-bc77-4627-8e9c-064953b2ff11 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:04.970913 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-60bdf054-bc77-4627-8e9c-064953b2ff11 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-561193'] for security_group_rule, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:04.989380 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ce182f7c-c038-48e4-9d87-14a92daba7fc req-03e22a47-6c73-4eae-8e31-55c0b2a48f58 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0502608 Sep 18 08:42:04.994941 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-60bdf054-bc77-4627-8e9c-064953b2ff11 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:04.996291 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-60bdf054-bc77-4627-8e9c-064953b2ff11 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1329544 Sep 18 08:42:04.998955 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 33052) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:05.014683 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-59bffd3e-3140-4a8e-8304-08d1becbc6e8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Request body: {'security_group_rule': {'security_group_id': 'c480fa62-0ee8-4f20-8da2-07bbb721cd7c', 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:42:05.019367 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60bdf054-bc77-4627-8e9c-064953b2ff11 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=26e40046-4bc1-4e55-836f-cd50ae79b62f,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:05.057678 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-59bffd3e-3140-4a8e-8304-08d1becbc6e8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:05.084369 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-746c876b-cb8b-4824-835e-3f44413b9bc4 req-d3f46055-656a-4712-b736-54d72225eda2 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:05.086112 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-746c876b-cb8b-4824-835e-3f44413b9bc4 req-d3f46055-656a-4712-b736-54d72225eda2 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 946 time: 0.0656662 Sep 18 08:42:05.127989 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-746c876b-cb8b-4824-835e-3f44413b9bc4 req-0e058f9a-ed01-4218-b014-9916db1fc163 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0354168 Sep 18 08:42:05.129288 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-59bffd3e-3140-4a8e-8304-08d1becbc6e8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:05.142379 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-59bffd3e-3140-4a8e-8304-08d1becbc6e8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-561193'] for security_group_rule, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:05.148505 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59bffd3e-3140-4a8e-8304-08d1becbc6e8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2c505dde-cd97-4f1f-bdfe-aa194747c5eb,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:05.162072 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-59bffd3e-3140-4a8e-8304-08d1becbc6e8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:05.163400 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-59bffd3e-3140-4a8e-8304-08d1becbc6e8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1632593 Sep 18 08:42:05.165988 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 33058) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:05.170856 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-4e20ff2d-5917-4724-933c-f252152caed8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Request body: {'security_group_rule': {'security_group_id': 'c480fa62-0ee8-4f20-8da2-07bbb721cd7c', 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:42:05.192104 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.db.securitygroups_db [None req-4e20ff2d-5917-4724-933c-f252152caed8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Project 0c7c58787ad549afa94b716f4c2f187b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Sep 18 08:42:05.197100 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-4e20ff2d-5917-4724-933c-f252152caed8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:05.258774 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-4e20ff2d-5917-4724-933c-f252152caed8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:05.263371 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-4e20ff2d-5917-4724-933c-f252152caed8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-561193'] for security_group_rule, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:05.285004 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e20ff2d-5917-4724-933c-f252152caed8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3764f6d2-4352-4c57-8242-f933eedf259f,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:05.293177 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-4e20ff2d-5917-4724-933c-f252152caed8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:05.295052 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-4e20ff2d-5917-4724-933c-f252152caed8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1281481 Sep 18 08:42:05.297954 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 33064) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:05.302699 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-af079be9-3e0c-4c58-b54b-5b9a3fc95de2 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Request body: {'security_group_rule': {'security_group_id': 'c480fa62-0ee8-4f20-8da2-07bbb721cd7c', 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:42:05.329006 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.db.securitygroups_db [None req-af079be9-3e0c-4c58-b54b-5b9a3fc95de2 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Project 0c7c58787ad549afa94b716f4c2f187b added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Sep 18 08:42:05.334914 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-af079be9-3e0c-4c58-b54b-5b9a3fc95de2 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:05.451997 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-af079be9-3e0c-4c58-b54b-5b9a3fc95de2 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:05.451997 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-af079be9-3e0c-4c58-b54b-5b9a3fc95de2 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-561193'] for security_group_rule, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:05.467981 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af079be9-3e0c-4c58-b54b-5b9a3fc95de2 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1b232bc7-eb14-4827-a701-e18fb20274f1,revision_number=0']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:05.478824 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-af079be9-3e0c-4c58-b54b-5b9a3fc95de2 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:05.480587 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-af079be9-3e0c-4c58-b54b-5b9a3fc95de2 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1815760 Sep 18 08:42:05.507710 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device c6d050fc-3bc2-4b89-baaf-c1be3438b3f6 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:42:05.565726 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port c6d050fc-3bc2-4b89-baaf-c1be3438b3f6 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:42:05.566310 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:05.623568 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2876af54-eeed-45aa-b136-c66f5276009b req-aac98688-5d98-48cf-8815-edd1b5b12a97 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:05.629746 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2876af54-eeed-45aa-b136-c66f5276009b req-aac98688-5d98-48cf-8815-edd1b5b12a97 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 944 time: 0.0553961 Sep 18 08:42:05.662854 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:05.670395 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2876af54-eeed-45aa-b136-c66f5276009b req-5bde87e2-0c25-4250-a8f7-6d3be6d1a525 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388253 Sep 18 08:42:05.693817 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-536c997d-2873-442a-81bf-9fe918803742 None None] For port c6d050fc-3bc2-4b89-baaf-c1be3438b3f6, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=c6d050fc-3bc2-4b89-baaf-c1be3438b3f6,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:42:05.699183 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:05.756989 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Pushing event updated for resources: {'Port': ['ID=c6d050fc-3bc2-4b89-baaf-c1be3438b3f6,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:05.903686 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] Sync routers for ids ['7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5'] in dv-cinder-804470-6-iscsi {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:42:05.913511 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] Routers {'7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:42:05.914138 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:41:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:42:06.034724 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] Set router 7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:42:06.111941 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-938539e5-abc5-4450-863b-f252a76d766b req-c6aecad7-df31-4c88-8c2c-bd37783fd083 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:06.113659 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-938539e5-abc5-4450-863b-f252a76d766b req-c6aecad7-df31-4c88-8c2c-bd37783fd083 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0522358 Sep 18 08:42:06.153273 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-938539e5-abc5-4450-863b-f252a76d766b req-32c552ce-4c7e-40d6-a1ee-b9a776e528a6 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0337350 Sep 18 08:42:06.239571 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5', 'name': 'tempest-TestVolumeBootPattern-977916314-router', 'tenant_id': '4d7fa64820344320b93dffee809df6ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.6'}], 'enable_snat': True}, 'gw_port_id': 'c6d050fc-3bc2-4b89-baaf-c1be3438b3f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:58Z', 'updated_at': '2021-09-18T08:42:02Z', 'revision_number': 4, 'project_id': '4d7fa64820344320b93dffee809df6ff', 'gw_port': {'id': 'c6d050fc-3bc2-4b89-baaf-c1be3438b3f6', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:ae:b8:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 486, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:59Z', 'updated_at': '2021-09-18T08:42:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '4fbf206e-55b5-4ee6-ab2b-e3d758a81072', 'name': '', 'network_id': '381227c0-612c-49cf-a6b8-b4b55d31fb02', 'tenant_id': '4d7fa64820344320b93dffee809df6ff', 'mac_address': 'fa:16:3e:3a:6f:fc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': '75555034-92fb-4ece-a037-0b068488ec29', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:42:02Z', 'updated_at': '2021-09-18T08:42:03Z', 'revision_number': 2, 'project_id': '4d7fa64820344320b93dffee809df6ff', 'subnets': [{'id': '75555034-92fb-4ece-a037-0b068488ec29', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:42:06.274545 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] Checking router: 7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5 for host: dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:42:06.274863 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] Updating router 7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5 port 4fbf206e-55b5-4ee6-ab2b-e3d758a81072 binding host dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 18 08:42:06.306156 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:06.402090 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d944d9aa-f8f8-4176-abde-7ccfe15cbec1 req-90c0bb45-1f47-4c37-a65c-9b09db0d70ec tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:06.403727 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d944d9aa-f8f8-4176-abde-7ccfe15cbec1 req-90c0bb45-1f47-4c37-a65c-9b09db0d70ec tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.0498602 Sep 18 08:42:06.441398 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d944d9aa-f8f8-4176-abde-7ccfe15cbec1 req-f6bf8fc0-e61e-481e-84c1-95e95c28e10b tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0315108 Sep 18 08:42:06.589528 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] Notify callbacks [] for port, precommit_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:06.654162 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:06.707508 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8150fd9e-18ab-4ed6-a7d4-d6939f683eda None None] Pushing event updated for resources: {'Port': ['ID=4fbf206e-55b5-4ee6-ab2b-e3d758a81072,revision_number=3']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:06.764897 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] Attempting to bind port 4fbf206e-55b5-4ee6-ab2b-e3d758a81072 on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:42:06.765420 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] Attempting to bind port 4fbf206e-55b5-4ee6-ab2b-e3d758a81072 by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': '8465a312-532d-4cae-ae69-08750a6f234e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 217, 'network_id': '381227c0-612c-49cf-a6b8-b4b55d31fb02'}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:42:06.765979 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] Attempting to bind port 4fbf206e-55b5-4ee6-ab2b-e3d758a81072 on network 381227c0-612c-49cf-a6b8-b4b55d31fb02 {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:42:06.774191 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 41, 53), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:42:06.774666 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] Checking segment: {'id': '8465a312-532d-4cae-ae69-08750a6f234e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 217, 'network_id': '381227c0-612c-49cf-a6b8-b4b55d31fb02'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94348) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:42:06.775271 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:06.775800 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] Bound using segment: {'id': '8465a312-532d-4cae-ae69-08750a6f234e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 217, 'network_id': '381227c0-612c-49cf-a6b8-b4b55d31fb02'} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:42:06.776967 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] Bound port: 4fbf206e-55b5-4ee6-ab2b-e3d758a81072, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '8465a312-532d-4cae-ae69-08750a6f234e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 217, 'network_id': '381227c0-612c-49cf-a6b8-b4b55d31fb02'}}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:42:06.777442 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:06.817806 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1705eba8-fc05-4650-b55f-7c3b0b162c3d req-0eb88ffc-fe4a-4ffa-9dfc-0a5a34a00bba tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:06.826851 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1705eba8-fc05-4650-b55f-7c3b0b162c3d req-0eb88ffc-fe4a-4ffa-9dfc-0a5a34a00bba tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 944 time: 0.0673099 Sep 18 08:42:06.881327 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1705eba8-fc05-4650-b55f-7c3b0b162c3d req-2a79b4e3-2ad1-446a-beaa-4d17232c9591 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0530183 Sep 18 08:42:06.883455 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] For port 4fbf206e-55b5-4ee6-ab2b-e3d758a81072, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94348) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:42:06.887806 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] For port 4fbf206e-55b5-4ee6-ab2b-e3d758a81072, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=4fbf206e-55b5-4ee6-ab2b-e3d758a81072,segment=NetworkSegment(8465a312-532d-4cae-ae69-08750a6f234e),segment_id=8465a312-532d-4cae-ae69-08750a6f234e)] {{(pid=94348) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:42:06.899174 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 33148) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:06.902066 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:06.973720 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] Routers {'7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:42:06.974363 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:41:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:42:06.978524 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8150fd9e-18ab-4ed6-a7d4-d6939f683eda None None] Pushing event updated for resources: {'Port': ['ID=4fbf206e-55b5-4ee6-ab2b-e3d758a81072,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:07.018355 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-d9a3aaaa-c049-4291-9671-9cdab60124de None None] Provisioning complete for port 4fbf206e-55b5-4ee6-ab2b-e3d758a81072 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:42:07.018734 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-d9a3aaaa-c049-4291-9671-9cdab60124de None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:07.049655 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-5c6ba90a-4d5c-4276-96d8-2025f9d49f8f admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:07.140803 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] Set router 7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:42:07.168063 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-5c6ba90a-4d5c-4276-96d8-2025f9d49f8f admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:07.172080 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-5c6ba90a-4d5c-4276-96d8-2025f9d49f8f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:07.188058 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-d9a3aaaa-c049-4291-9671-9cdab60124de None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:07.214551 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-5c6ba90a-4d5c-4276-96d8-2025f9d49f8f admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=127f71a39d8f472690653186fbb14fae&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3119771 Sep 18 08:42:07.214551 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c6ba90a-4d5c-4276-96d8-2025f9d49f8f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=33038deb-f8a7-43b9-817e-d8391d616a4d,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:07.214938 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 33156) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:07.288242 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-afe23a6a-da7e-4622-b1c7-0639427d0116 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:07.299009 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a532e221-eb33-47aa-a54a-0ef69ba97cde req-942fddf3-d776-4553-b956-672866679ffa tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:07.300687 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a532e221-eb33-47aa-a54a-0ef69ba97cde req-942fddf3-d776-4553-b956-672866679ffa tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0656364 Sep 18 08:42:07.302687 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-d9a3aaaa-c049-4291-9671-9cdab60124de None None] For port 4fbf206e-55b5-4ee6-ab2b-e3d758a81072, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=4fbf206e-55b5-4ee6-ab2b-e3d758a81072,segment=NetworkSegment(8465a312-532d-4cae-ae69-08750a6f234e),segment_id=8465a312-532d-4cae-ae69-08750a6f234e)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:42:07.308448 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-d9a3aaaa-c049-4291-9671-9cdab60124de None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:07.312075 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-afe23a6a-da7e-4622-b1c7-0639427d0116 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:07.345807 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a532e221-eb33-47aa-a54a-0ef69ba97cde req-2aa5410d-b39b-43bf-8d2d-98f22b3ad18d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0369301 Sep 18 08:42:07.365804 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-afe23a6a-da7e-4622-b1c7-0639427d0116 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:07.369030 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-afe23a6a-da7e-4622-b1c7-0639427d0116 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:07.371380 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-afe23a6a-da7e-4622-b1c7-0639427d0116 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/33038deb-f8a7-43b9-817e-d8391d616a4d HTTP/1.1" status: 204 len: 168 time: 0.1546466 Sep 18 08:42:07.394821 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afe23a6a-da7e-4622-b1c7-0639427d0116 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=33038deb-f8a7-43b9-817e-d8391d616a4d,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:07.515418 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 4fbf206e-55b5-4ee6-ab2b-e3d758a81072 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:42:07.554192 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9a3aaaa-c049-4291-9671-9cdab60124de None None] Pushing event updated for resources: {'Port': ['ID=4fbf206e-55b5-4ee6-ab2b-e3d758a81072,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:07.574115 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-4a5d3edb-0d72-47c9-bda1-5768c851338c None None] Provisioning complete for port 4fbf206e-55b5-4ee6-ab2b-e3d758a81072 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:42:07.574491 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-4a5d3edb-0d72-47c9-bda1-5768c851338c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:07.602933 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f38e150-339f-4e67-9212-cca59a26c812 req-4d7e8021-d4ff-4f0c-8507-805255b0bea1 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:07.617878 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3f38e150-339f-4e67-9212-cca59a26c812 req-4d7e8021-d4ff-4f0c-8507-805255b0bea1 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.0882015 Sep 18 08:42:07.640015 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 4fbf206e-55b5-4ee6-ab2b-e3d758a81072 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:42:07.640535 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:07.645818 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5', 'name': 'tempest-TestVolumeBootPattern-977916314-router', 'tenant_id': '4d7fa64820344320b93dffee809df6ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.6'}], 'enable_snat': True}, 'gw_port_id': 'c6d050fc-3bc2-4b89-baaf-c1be3438b3f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:58Z', 'updated_at': '2021-09-18T08:42:02Z', 'revision_number': 4, 'project_id': '4d7fa64820344320b93dffee809df6ff', 'gw_port': {'id': 'c6d050fc-3bc2-4b89-baaf-c1be3438b3f6', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:ae:b8:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 486, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:59Z', 'updated_at': '2021-09-18T08:42:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '4fbf206e-55b5-4ee6-ab2b-e3d758a81072', 'name': '', 'network_id': '381227c0-612c-49cf-a6b8-b4b55d31fb02', 'tenant_id': '4d7fa64820344320b93dffee809df6ff', 'mac_address': 'fa:16:3e:3a:6f:fc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': '75555034-92fb-4ece-a037-0b068488ec29', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:42:02Z', 'updated_at': '2021-09-18T08:42:06Z', 'revision_number': 4, 'project_id': '4d7fa64820344320b93dffee809df6ff', 'subnets': [{'id': '75555034-92fb-4ece-a037-0b068488ec29', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:42:07.685629 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3f38e150-339f-4e67-9212-cca59a26c812 req-489202b0-6b5c-440f-a595-b2d92ecbca0f tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0666239 Sep 18 08:42:07.695231 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dda91d8c-fa60-4cd5-a43e-bd3d788f7dfe None None] The sync data for ids ['7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5'] in dv-cinder-804470-6-iscsi is: [{'id': '7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5', 'name': 'tempest-TestVolumeBootPattern-977916314-router', 'tenant_id': '4d7fa64820344320b93dffee809df6ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.6'}], 'enable_snat': True}, 'gw_port_id': 'c6d050fc-3bc2-4b89-baaf-c1be3438b3f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:58Z', 'updated_at': '2021-09-18T08:42:02Z', 'revision_number': 4, 'project_id': '4d7fa64820344320b93dffee809df6ff', 'gw_port': {'id': 'c6d050fc-3bc2-4b89-baaf-c1be3438b3f6', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:ae:b8:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 486, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:59Z', 'updated_at': '2021-09-18T08:42:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '4fbf206e-55b5-4ee6-ab2b-e3d758a81072', 'name': '', 'network_id': '381227c0-612c-49cf-a6b8-b4b55d31fb02', 'tenant_id': '4d7fa64820344320b93dffee809df6ff', 'mac_address': 'fa:16:3e:3a:6f:fc', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': '75555034-92fb-4ece-a037-0b068488ec29', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:42:02Z', 'updated_at': '2021-09-18T08:42:06Z', 'revision_number': 4, 'project_id': '4d7fa64820344320b93dffee809df6ff', 'subnets': [{'id': '75555034-92fb-4ece-a037-0b068488ec29', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:42:07.793416 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device c6d050fc-3bc2-4b89-baaf-c1be3438b3f6 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:42:07.845513 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port c6d050fc-3bc2-4b89-baaf-c1be3438b3f6 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:42:07.845906 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:08.036847 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6b64100-4e88-4cb1-837d-1161effcbf86 req-58aca178-b16c-4537-b670-448db0ae71b8 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:08.038538 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a6b64100-4e88-4cb1-837d-1161effcbf86 req-58aca178-b16c-4537-b670-448db0ae71b8 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 944 time: 0.0780797 Sep 18 08:42:08.087683 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a6b64100-4e88-4cb1-837d-1161effcbf86 req-530f92f3-34de-44f3-94cc-f2223333b09a tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409486 Sep 18 08:42:08.475151 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d8fb0d4-49e4-47b5-ba85-b219fc5cd7cb req-39faed72-e36d-4bf0-8188-1059c652885d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:08.476791 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7d8fb0d4-49e4-47b5-ba85-b219fc5cd7cb req-39faed72-e36d-4bf0-8188-1059c652885d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0504794 Sep 18 08:42:08.515769 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7d8fb0d4-49e4-47b5-ba85-b219fc5cd7cb req-f2233b17-4a4c-49c8-8b69-3ca6f6822ff2 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0323339 Sep 18 08:42:08.755051 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device a16828fd-b0f1-4ba0-a92a-61614fabe668 details requested by agent hyperv_hv-cinder-80447 with host hv-cinder-80447 {{(pid=94348) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 18 08:42:08.802363 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08c6799c-0fdc-4bfb-96f7-1517c3581bd0 req-bc4e739b-9791-42c9-aaf0-6bcf9cb6d715 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:08.803879 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-08c6799c-0fdc-4bfb-96f7-1517c3581bd0 req-bc4e739b-9791-42c9-aaf0-6bcf9cb6d715 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.0486689 Sep 18 08:42:08.844788 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-08c6799c-0fdc-4bfb-96f7-1517c3581bd0 req-8160e242-5e74-423b-a1f0-c3aced2b8f3e tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0345020 Sep 18 08:42:08.853644 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port a16828fd-b0f1-4ba0-a92a-61614fabe668, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=a16828fd-b0f1-4ba0-a92a-61614fabe668,segment=NetworkSegment(5d556fd8-f02d-4c49-9c67-863cea39ec4a),segment_id=5d556fd8-f02d-4c49-9c67-863cea39ec4a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:42:08.865155 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Returning: {'device': 'a16828fd-b0f1-4ba0-a92a-61614fabe668', 'network_id': '48bd9423-5b85-4344-9434-17e10e227731', 'port_id': 'a16828fd-b0f1-4ba0-a92a-61614fabe668', 'mac_address': 'fa:16:3e:32:a3:10', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 238, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '95fb2797-9ac9-40f9-9ea9-56d2c5a16291', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94348) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 18 08:42:08.903257 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:08.915573 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a16828fd-b0f1-4ba0-a92a-61614fabe668 {{(pid=94348) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:42:08.934382 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port a16828fd-b0f1-4ba0-a92a-61614fabe668, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=a16828fd-b0f1-4ba0-a92a-61614fabe668,segment=NetworkSegment(5d556fd8-f02d-4c49-9c67-863cea39ec4a),segment_id=5d556fd8-f02d-4c49-9c67-863cea39ec4a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:42:08.937850 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:08.985781 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=a16828fd-b0f1-4ba0-a92a-61614fabe668,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:09.427961 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 4fbf206e-55b5-4ee6-ab2b-e3d758a81072 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:42:09.438906 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7ad9c52-3acd-4c9c-9256-1dcb0a6236d6 req-ed8eb5af-91a4-489b-86fe-d95111e992e0 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:09.440347 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e7ad9c52-3acd-4c9c-9256-1dcb0a6236d6 req-ed8eb5af-91a4-489b-86fe-d95111e992e0 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 945 time: 0.2841234 Sep 18 08:42:09.475057 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 4fbf206e-55b5-4ee6-ab2b-e3d758a81072 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:42:09.475435 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:09.478022 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e7ad9c52-3acd-4c9c-9256-1dcb0a6236d6 req-b7f32052-c172-4d4c-b80c-b4df1f8605f5 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0314364 Sep 18 08:42:09.623894 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['a16828fd-b0f1-4ba0-a92a-61614fabe668'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:42:09.636859 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b72f33f5-ed52-4c96-824f-f2b791899b7b req-f59b9435-23ce-417a-8556-9be86cfcb8ca tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:09.638372 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b72f33f5-ed52-4c96-824f-f2b791899b7b req-f59b9435-23ce-417a-8556-9be86cfcb8ca tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0471327 Sep 18 08:42:09.675372 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b72f33f5-ed52-4c96-824f-f2b791899b7b req-eb1344c9-a4b7-4832-a73b-66fd10636b35 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0310726 Sep 18 08:42:09.955673 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05cd394b-ab87-440d-88cc-ef6d692db0f1 req-3c7efda0-d635-4dc1-859c-47e0c7719b39 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:09.957377 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-05cd394b-ab87-440d-88cc-ef6d692db0f1 req-3c7efda0-d635-4dc1-859c-47e0c7719b39 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.0476668 Sep 18 08:42:10.005362 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-05cd394b-ab87-440d-88cc-ef6d692db0f1 req-4b546af0-ad66-4f16-a440-cd0e37b0b8d0 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0360487 Sep 18 08:42:10.339320 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26e7576e-e822-4c96-9ed6-30a9d0667cf2 req-22748fa8-c4b3-46e7-8ee3-9b800c98df78 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:10.340830 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-26e7576e-e822-4c96-9ed6-30a9d0667cf2 req-22748fa8-c4b3-46e7-8ee3-9b800c98df78 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.13 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 946 time: 0.0471959 Sep 18 08:42:10.432977 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-26e7576e-e822-4c96-9ed6-30a9d0667cf2 req-3f446d67-9332-4cbc-a441-0907d7469a5d tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Deleting port 59d1e8a2-e4aa-44e5-8014-91de86026543 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:42:10.433349 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-26e7576e-e822-4c96-9ed6-30a9d0667cf2 req-3f446d67-9332-4cbc-a441-0907d7469a5d tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:10.524021 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-26e7576e-e822-4c96-9ed6-30a9d0667cf2 req-3f446d67-9332-4cbc-a441-0907d7469a5d tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] For port 59d1e8a2-e4aa-44e5-8014-91de86026543, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=59d1e8a2-e4aa-44e5-8014-91de86026543,segment=NetworkSegment(cb92e74f-7545-44c8-a2d3-634d116af362),segment_id=cb92e74f-7545-44c8-a2d3-634d116af362)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:42:10.524608 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-26e7576e-e822-4c96-9ed6-30a9d0667cf2 req-3f446d67-9332-4cbc-a441-0907d7469a5d tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:10.537578 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-26e7576e-e822-4c96-9ed6-30a9d0667cf2 req-3f446d67-9332-4cbc-a441-0907d7469a5d tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Calling delete_port for 59d1e8a2-e4aa-44e5-8014-91de86026543 owned by compute:nova {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:42:10.637700 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d51879f-4b00-4d84-a951-8ea58dd06e82 req-3bcc8a60-635a-499d-8808-ac57abc08d8e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:10.639192 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2d51879f-4b00-4d84-a951-8ea58dd06e82 req-3bcc8a60-635a-499d-8808-ac57abc08d8e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 945 time: 0.0935118 Sep 18 08:42:10.708232 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2d51879f-4b00-4d84-a951-8ea58dd06e82 req-e8d29509-9d24-4c01-9c04-87a67a284353 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0631616 Sep 18 08:42:10.736420 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-26e7576e-e822-4c96-9ed6-30a9d0667cf2 req-3f446d67-9332-4cbc-a441-0907d7469a5d tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:10.773723 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f446d67-9332-4cbc-a441-0907d7469a5d tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Pushing event deleted for resources: {'Port': ['ID=59d1e8a2-e4aa-44e5-8014-91de86026543,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:10.830743 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-26e7576e-e822-4c96-9ed6-30a9d0667cf2 req-3f446d67-9332-4cbc-a441-0907d7469a5d tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] No DVR routers for this DVR port 59d1e8a2-e4aa-44e5-8014-91de86026543 on host hv-cinder-80447 {{(pid=94347) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:42:10.835150 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-26e7576e-e822-4c96-9ed6-30a9d0667cf2 req-3f446d67-9332-4cbc-a441-0907d7469a5d tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:10.837118 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-26e7576e-e822-4c96-9ed6-30a9d0667cf2 req-3f446d67-9332-4cbc-a441-0907d7469a5d tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.13 "DELETE /v2.0/ports/59d1e8a2-e4aa-44e5-8014-91de86026543 HTTP/1.1" status: 204 len: 173 time: 0.4884236 Sep 18 08:42:10.837577 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a8fb23c6-6606-497f-820d-0643e56a39d1', 'name': 'network-vif-deleted', 'tag': '59d1e8a2-e4aa-44e5-8014-91de86026543'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:42:10.839822 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2c748d8a-5335-433c-9591-3211e9904a5d" -d '{"events": [{"server_uuid": "a8fb23c6-6606-497f-820d-0643e56a39d1", "name": "network-vif-deleted", "tag": "59d1e8a2-e4aa-44e5-8014-91de86026543"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:42:10.855847 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be63e9af-41e4-4047-96c2-299608273049 req-a14c82dd-b048-445c-8949-8395cf385d6b tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:10.857530 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-be63e9af-41e4-4047-96c2-299608273049 req-a14c82dd-b048-445c-8949-8395cf385d6b tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.1097217 Sep 18 08:42:10.881062 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:42:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7ad33d15-8836-4f38-96be-f01e7fb5b85b x-openstack-request-id: req-7ad33d15-8836-4f38-96be-f01e7fb5b85b {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:42:10.881526 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a8fb23c6-6606-497f-820d-0643e56a39d1", "name": "network-vif-deleted", "tag": "59d1e8a2-e4aa-44e5-8014-91de86026543", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:42:10.881640 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-7ad33d15-8836-4f38-96be-f01e7fb5b85b {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:42:10.882011 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a8fb23c6-6606-497f-820d-0643e56a39d1', 'name': 'network-vif-deleted', 'tag': '59d1e8a2-e4aa-44e5-8014-91de86026543', 'status': 'completed', 'code': 200} Sep 18 08:42:10.899620 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-be63e9af-41e4-4047-96c2-299608273049 req-b4c94f36-28da-4779-b76f-a39bc3efa3ea tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0355883 Sep 18 08:42:11.043213 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['59d1e8a2-e4aa-44e5-8014-91de86026543', 'b03411eb-66ff-4691-88c8-2c570d78c323'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:42:11.116809 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-70721251-810f-4f2f-bfee-ddcfd6f4d380 req-1286e298-d3d8-4cd5-b789-45fc7b039bbc tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=a8fb23c6-6606-497f-820d-0643e56a39d1 HTTP/1.1" status: 200 len: 210 time: 0.0258176 Sep 18 08:42:11.824309 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f9299ea-655b-47bd-acaa-58774e968713 req-2c043f46-94c5-43f4-8b7e-901e071f2980 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:11.825841 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9f9299ea-655b-47bd-acaa-58774e968713 req-2c043f46-94c5-43f4-8b7e-901e071f2980 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 945 time: 0.0525339 Sep 18 08:42:11.862541 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9f9299ea-655b-47bd-acaa-58774e968713 req-40a54832-14b3-4e44-b973-a7f426387473 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0309274 Sep 18 08:42:12.018150 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2632c5c-6f06-44b6-87b7-635a2b0c6eff req-6483ce5c-7050-4d95-b131-a0fe7c075ead tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:12.019617 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b2632c5c-6f06-44b6-87b7-635a2b0c6eff req-6483ce5c-7050-4d95-b131-a0fe7c075ead tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0478091 Sep 18 08:42:12.056844 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b2632c5c-6f06-44b6-87b7-635a2b0c6eff req-5770cd0d-3cd9-4ff9-9743-6069c1e2bb31 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0312960 Sep 18 08:42:12.379635 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f50ccdfa-4154-40c9-be82-b5e266caa031 req-2b774efa-cc62-40d1-8d3f-58b1d8e38a60 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:12.381129 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f50ccdfa-4154-40c9-be82-b5e266caa031 req-2b774efa-cc62-40d1-8d3f-58b1d8e38a60 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0484195 Sep 18 08:42:12.418560 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f50ccdfa-4154-40c9-be82-b5e266caa031 req-d7385e5e-1f01-4192-88e4-1cc096364b0d tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0309391 Sep 18 08:42:12.787431 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device a16828fd-b0f1-4ba0-a92a-61614fabe668 up at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:42:12.837388 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning for port a16828fd-b0f1-4ba0-a92a-61614fabe668 completed by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 18 08:42:12.838977 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning complete for port a16828fd-b0f1-4ba0-a92a-61614fabe668 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:42:12.839339 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:12.915529 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:12.942909 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'e85a7284-e6ea-47ab-9674-09d8666b742f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a16828fd-b0f1-4ba0-a92a-61614fabe668'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:42:12.945364 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-277a9c8d-6fb7-4e52-8ca8-a002fe0b643f" -d '{"events": [{"server_uuid": "e85a7284-e6ea-47ab-9674-09d8666b742f", "name": "network-vif-plugged", "status": "completed", "tag": "a16828fd-b0f1-4ba0-a92a-61614fabe668"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:42:12.962708 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port a16828fd-b0f1-4ba0-a92a-61614fabe668, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=a16828fd-b0f1-4ba0-a92a-61614fabe668,segment=NetworkSegment(5d556fd8-f02d-4c49-9c67-863cea39ec4a),segment_id=5d556fd8-f02d-4c49-9c67-863cea39ec4a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:42:12.967324 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:12.998410 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6559026c-e3d6-4884-89bb-80e0ff1296f7 req-61f19731-5077-44f4-ad4a-b727694fbd5e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:13.000003 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6559026c-e3d6-4884-89bb-80e0ff1296f7 req-61f19731-5077-44f4-ad4a-b727694fbd5e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 945 time: 0.0690801 Sep 18 08:42:13.004360 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:42:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5969e070-6643-4d39-8b6b-916b1abac071 x-openstack-request-id: req-5969e070-6643-4d39-8b6b-916b1abac071 {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:42:13.004725 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "e85a7284-e6ea-47ab-9674-09d8666b742f", "name": "network-vif-plugged", "status": "completed", "tag": "a16828fd-b0f1-4ba0-a92a-61614fabe668", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:42:13.005048 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-5969e070-6643-4d39-8b6b-916b1abac071 {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:42:13.005570 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e85a7284-e6ea-47ab-9674-09d8666b742f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a16828fd-b0f1-4ba0-a92a-61614fabe668', 'code': 200} Sep 18 08:42:13.024383 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=a16828fd-b0f1-4ba0-a92a-61614fabe668,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:13.047750 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6559026c-e3d6-4884-89bb-80e0ff1296f7 req-ea2ba27a-dc42-4290-89fe-8ce4c5888148 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388372 Sep 18 08:42:13.182353 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1791725a-6d4a-4d5a-ac8e-9cc61f4f135a req-7745b57f-770f-486a-b22e-42fe546ecf4c tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:13.184447 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1791725a-6d4a-4d5a-ac8e-9cc61f4f135a req-7745b57f-770f-486a-b22e-42fe546ecf4c tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0492826 Sep 18 08:42:13.227817 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1791725a-6d4a-4d5a-ac8e-9cc61f4f135a req-5f5c545f-8a72-470a-8466-e20335e5a398 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0350461 Sep 18 08:42:13.267389 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd03b8cf-5881-4a4d-a3a1-48b3c3c6377f req-097dde43-b1c9-4616-8856-91aa4690dcd5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:13.269472 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bd03b8cf-5881-4a4d-a3a1-48b3c3c6377f req-097dde43-b1c9-4616-8856-91aa4690dcd5 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 1099 time: 0.0406311 Sep 18 08:42:13.309817 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bd03b8cf-5881-4a4d-a3a1-48b3c3c6377f req-30ddc69b-5fb3-48d8-8d22-952a12fc7c2f service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0293207 Sep 18 08:42:13.538490 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24971097-8d4f-470e-8555-edf340e88c87 req-90c496b2-0e21-4665-90a4-90459de9c4e8 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:13.548181 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-24971097-8d4f-470e-8555-edf340e88c87 req-90c496b2-0e21-4665-90a4-90459de9c4e8 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0574238 Sep 18 08:42:13.581247 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-24971097-8d4f-470e-8555-edf340e88c87 req-4bf73e9b-02c7-431d-a4ce-342eebc1d419 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0317883 Sep 18 08:42:14.163646 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-789e2402-b38d-4d52-851c-e2107bb45a48 req-2e90b3d2-b1b0-4769-b8e1-9b972514d2c5 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:14.165142 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-789e2402-b38d-4d52-851c-e2107bb45a48 req-2e90b3d2-b1b0-4769-b8e1-9b972514d2c5 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 946 time: 0.0491405 Sep 18 08:42:14.205179 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-789e2402-b38d-4d52-851c-e2107bb45a48 req-cdbe0d11-7b77-41e6-aca7-8986529b1758 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0338457 Sep 18 08:42:14.348706 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13e0f219-2908-4d85-a3c2-85408a015e44 req-4e174bf2-57b0-44ef-9a86-e29c1dba38d1 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:14.350229 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-13e0f219-2908-4d85-a3c2-85408a015e44 req-4e174bf2-57b0-44ef-9a86-e29c1dba38d1 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0489528 Sep 18 08:42:14.393520 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-13e0f219-2908-4d85-a3c2-85408a015e44 req-0d0b7006-cbed-413e-bb6d-a3f6385d2d8e tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0372527 Sep 18 08:42:14.700789 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-678cea16-6151-4946-8cba-5f1846a50ece req-ff38c118-3ede-4418-b163-885a37b07c34 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:14.702304 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-678cea16-6151-4946-8cba-5f1846a50ece req-ff38c118-3ede-4418-b163-885a37b07c34 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0523090 Sep 18 08:42:14.740097 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-678cea16-6151-4946-8cba-5f1846a50ece req-e53260f8-5f1a-4ac3-9a4e-88da251188ee tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0317206 Sep 18 08:42:14.783821 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 59d1e8a2-e4aa-44e5-8014-91de86026543 no longer exists at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:42:14.804710 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] No Port match for: 59d1e8a2-e4aa-44e5-8014-91de86026543 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:42:14.805060 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 59d1e8a2-e4aa-44e5-8014-91de86026543 not bound to the agent host hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:42:15.325361 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58f9506d-d1ca-4d83-8b86-d2ce30645ec8 req-ffc715be-43c4-4e06-9d29-c4d5a6a25e92 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:15.326853 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-58f9506d-d1ca-4d83-8b86-d2ce30645ec8 req-ffc715be-43c4-4e06-9d29-c4d5a6a25e92 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 946 time: 0.0566754 Sep 18 08:42:15.365917 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-58f9506d-d1ca-4d83-8b86-d2ce30645ec8 req-04d7c6bc-a0cf-486f-ac4c-ecd211a86eab tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0329447 Sep 18 08:42:15.531509 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-010b2017-a95d-4f47-891a-896f7d417f9d req-7df0a052-e772-49cf-8870-3604f7406503 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:15.537811 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-010b2017-a95d-4f47-891a-896f7d417f9d req-7df0a052-e772-49cf-8870-3604f7406503 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0739148 Sep 18 08:42:15.571660 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-010b2017-a95d-4f47-891a-896f7d417f9d req-30e451a0-8d77-4c77-92d9-6e2a40710d58 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0318518 Sep 18 08:42:15.868398 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f6330ad-2585-4e94-8af1-e3c1b5303f5b req-7e7d02c0-facf-409d-9bd4-1024933c7abe tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:15.869960 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6f6330ad-2585-4e94-8af1-e3c1b5303f5b req-7e7d02c0-facf-409d-9bd4-1024933c7abe tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0649648 Sep 18 08:42:15.910561 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6f6330ad-2585-4e94-8af1-e3c1b5303f5b req-25881889-18ab-419f-8bc2-c415d762520b tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0336926 Sep 18 08:42:16.476340 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c87f6523-ccc7-42f0-a238-5b6e708b19b0 req-3810e37a-bf2e-42e4-b524-ceaa94758993 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:16.477813 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c87f6523-ccc7-42f0-a238-5b6e708b19b0 req-3810e37a-bf2e-42e4-b524-ceaa94758993 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 946 time: 0.0466301 Sep 18 08:42:16.515049 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c87f6523-ccc7-42f0-a238-5b6e708b19b0 req-0e23e668-a821-40fd-97d8-ebf235475ca1 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0307775 Sep 18 08:42:16.635151 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25360586-a42c-4524-8e8b-f17b5bcaa284 req-fa44e3ce-17ea-495d-902e-2f0feee6b234 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:16.636768 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-25360586-a42c-4524-8e8b-f17b5bcaa284 req-fa44e3ce-17ea-495d-902e-2f0feee6b234 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 946 time: 0.0564797 Sep 18 08:42:16.707924 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-25360586-a42c-4524-8e8b-f17b5bcaa284 req-2e173551-926a-460c-bc15-02a5e2a88ea5 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0628088 Sep 18 08:42:16.724561 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-183c478c-9f8b-469e-849a-ae414bc76b49 req-d125519c-f6f4-4312-8899-4bca85c4e2cb tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:16.726086 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-183c478c-9f8b-469e-849a-ae414bc76b49 req-d125519c-f6f4-4312-8899-4bca85c4e2cb tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0656483 Sep 18 08:42:16.766943 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-183c478c-9f8b-469e-849a-ae414bc76b49 req-527023c6-6035-4593-96b3-f3b2970564b9 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0336618 Sep 18 08:42:17.086049 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed2bf455-5da8-41ed-a746-e135c9f1923e req-b7713d05-e550-4e20-9da9-d4ee9245660d tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:17.087568 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ed2bf455-5da8-41ed-a746-e135c9f1923e req-b7713d05-e550-4e20-9da9-d4ee9245660d tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0846655 Sep 18 08:42:17.096912 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dd07ad2-01a2-4261-9325-726ec1256cb9 req-e3b45861-9408-4ef9-9dcf-b9a9af19a766 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:17.098378 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2dd07ad2-01a2-4261-9325-726ec1256cb9 req-e3b45861-9408-4ef9-9dcf-b9a9af19a766 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 946 time: 0.0662456 Sep 18 08:42:17.156725 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ed2bf455-5da8-41ed-a746-e135c9f1923e req-b30b0dd3-d447-4e3e-bfdb-5c3729ac1681 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0573530 Sep 18 08:42:17.159995 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2dd07ad2-01a2-4261-9325-726ec1256cb9 req-5873052f-01d9-4a92-8337-c674e7ae8209 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0548296 Sep 18 08:42:17.905695 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48822f16-08b8-43b5-a888-36f4e98ee84e req-4c5b4ddc-319f-4ec2-b2bf-036ded320d99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:17.907119 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-48822f16-08b8-43b5-a888-36f4e98ee84e req-4c5b4ddc-319f-4ec2-b2bf-036ded320d99 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0700a96e9b3f48e8b6bcdd75b820b813&device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 1099 time: 0.0592217 Sep 18 08:42:17.915491 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe19e2ee-9365-4b85-847d-a187e6947087 req-0edb4c65-3c16-41ab-bc36-ea4fe4b0769a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:17.917072 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fe19e2ee-9365-4b85-847d-a187e6947087 req-0edb4c65-3c16-41ab-bc36-ea4fe4b0769a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0789428 Sep 18 08:42:18.014768 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fe19e2ee-9365-4b85-847d-a187e6947087 req-d9add85b-1d73-466a-9d6b-a4f277f150ee tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0900624 Sep 18 08:42:18.043556 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48822f16-08b8-43b5-a888-36f4e98ee84e req-3ffb7629-5991-4567-9952-0df76b2175b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:18.045609 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-48822f16-08b8-43b5-a888-36f4e98ee84e req-3ffb7629-5991-4567-9952-0df76b2175b2 service neutron] 10.222.0.13 "GET /v2.0/networks?id=f430397d-03a8-4da2-bd1d-25890a3a0727 HTTP/1.1" status: 200 len: 917 time: 0.1069379 Sep 18 08:42:18.120972 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-48822f16-08b8-43b5-a888-36f4e98ee84e req-869abca0-d611-4cf3-ba97-ecc7e66d3703 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 HTTP/1.1" status: 200 len: 1002 time: 0.0667081 Sep 18 08:42:18.172792 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48822f16-08b8-43b5-a888-36f4e98ee84e req-81f05ca3-1536-49bf-9eb9-c4fe841c3dd4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:18.174328 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-48822f16-08b8-43b5-a888-36f4e98ee84e req-81f05ca3-1536-49bf-9eb9-c4fe841c3dd4 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=acdeb8a1-5de9-425f-ae0a-890d310246e9 HTTP/1.1" status: 200 len: 855 time: 0.0432301 Sep 18 08:42:18.232154 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48822f16-08b8-43b5-a888-36f4e98ee84e req-02afe3a2-6cdd-4988-bd37-d0716e71d25a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:18.233829 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-48822f16-08b8-43b5-a888-36f4e98ee84e req-02afe3a2-6cdd-4988-bd37-d0716e71d25a service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=f430397d-03a8-4da2-bd1d-25890a3a0727&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0514765 Sep 18 08:42:18.348177 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-458b2737-62fa-4326-a839-caa56a5d3b2a req-9d92fdc7-f1ac-4490-b1d7-6fd9be4903d4 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:18.349723 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-458b2737-62fa-4326-a839-caa56a5d3b2a req-9d92fdc7-f1ac-4490-b1d7-6fd9be4903d4 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.1150131 Sep 18 08:42:18.361638 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 33432) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:18.380430 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-48822f16-08b8-43b5-a888-36f4e98ee84e req-8e078577-8eea-4b21-ba65-3648888ec8ae service neutron] 10.222.0.13 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1368773 Sep 18 08:42:18.406793 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-458b2737-62fa-4326-a839-caa56a5d3b2a req-b7e31ce5-9ae4-4a4e-aeb1-36b769f6a9e7 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0510426 Sep 18 08:42:18.475390 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ca3a95ba-0e6c-439f-b3c6-ad33ffcb19b3 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:18.491930 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-48822f16-08b8-43b5-a888-36f4e98ee84e req-806aaef8-de7a-46ee-a8df-0af2c1797a26 service neutron] 10.222.0.13 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0993397 Sep 18 08:42:18.565720 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ca3a95ba-0e6c-439f-b3c6-ad33ffcb19b3 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:18.569661 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ca3a95ba-0e6c-439f-b3c6-ad33ffcb19b3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:18.610555 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-ca3a95ba-0e6c-439f-b3c6-ad33ffcb19b3 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=fd23cf823f9340179e095b02d2b6183f&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2477648 Sep 18 08:42:18.611406 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca3a95ba-0e6c-439f-b3c6-ad33ffcb19b3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6224d8fa-eba6-4f0f-9ab4-012569f59258,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:18.613286 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 33438) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:18.664708 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-15af343c-492c-4727-8d17-0843db14c44f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:18.687718 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-15af343c-492c-4727-8d17-0843db14c44f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:18.737535 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-15af343c-492c-4727-8d17-0843db14c44f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:18.740051 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-15af343c-492c-4727-8d17-0843db14c44f admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:18.741195 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-15af343c-492c-4727-8d17-0843db14c44f admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/6224d8fa-eba6-4f0f-9ab4-012569f59258 HTTP/1.1" status: 204 len: 168 time: 0.1269219 Sep 18 08:42:18.753196 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15af343c-492c-4727-8d17-0843db14c44f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6224d8fa-eba6-4f0f-9ab4-012569f59258,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:19.130438 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64851cd6-ac46-4fda-ba72-0efdfcfc2eb1 req-b416e670-bd38-4251-84f5-1d704c135a4d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:19.132058 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-64851cd6-ac46-4fda-ba72-0efdfcfc2eb1 req-b416e670-bd38-4251-84f5-1d704c135a4d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0479183 Sep 18 08:42:19.170189 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-64851cd6-ac46-4fda-ba72-0efdfcfc2eb1 req-441c47f8-f461-4840-9256-b293fc601fcd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0313864 Sep 18 08:42:19.530656 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d12a523a-d0f4-4af4-87a6-f655ea951cd9 req-34d7e82d-0bc3-4db0-963e-a123ac69a560 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:19.532398 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d12a523a-d0f4-4af4-87a6-f655ea951cd9 req-34d7e82d-0bc3-4db0-963e-a123ac69a560 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0520835 Sep 18 08:42:19.579739 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d12a523a-d0f4-4af4-87a6-f655ea951cd9 req-9f271cb9-30ab-4f30-836b-d8395ce8b09a tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389457 Sep 18 08:42:19.613527 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-22ecc24c-912c-470b-80ca-e348fa8686eb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:19.908412 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:20.287114 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eda02694-56df-45aa-a869-05930f52b530 req-e2e4588f-6919-4745-baab-d0ad289b38c6 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:20.288608 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-eda02694-56df-45aa-a869-05930f52b530 req-e2e4588f-6919-4745-baab-d0ad289b38c6 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0494430 Sep 18 08:42:20.331059 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-eda02694-56df-45aa-a869-05930f52b530 req-1c099ba1-694a-40bf-8df8-63e26918abc6 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0358124 Sep 18 08:42:20.696105 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28814012-b421-47c8-9856-f614054a88b5 req-5e273c4b-26c6-4a4f-b771-85f878328928 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:20.697613 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-28814012-b421-47c8-9856-f614054a88b5 req-5e273c4b-26c6-4a4f-b771-85f878328928 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0472817 Sep 18 08:42:20.739769 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-28814012-b421-47c8-9856-f614054a88b5 req-47f64b39-cbe3-48c5-87e2-dfe0ebdc555e tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/security-groups?id=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0355613 Sep 18 08:42:20.815893 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ce2ebbb-0bbc-454c-b0c5-8793ce1c303e req-57002c03-5fcb-450e-a470-8279bd6be48a tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:20.817706 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4ce2ebbb-0bbc-454c-b0c5-8793ce1c303e req-57002c03-5fcb-450e-a470-8279bd6be48a tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.13 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 945 time: 0.0534728 Sep 18 08:42:20.910075 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14d25c15-c5b2-4f90-80ea-bd6b1cd7dc25 req-4d274785-c71c-4983-9615-b700ea8d8190 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:20.911449 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-14d25c15-c5b2-4f90-80ea-bd6b1cd7dc25 req-4d274785-c71c-4983-9615-b700ea8d8190 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 946 time: 0.0793040 Sep 18 08:42:20.975978 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-14d25c15-c5b2-4f90-80ea-bd6b1cd7dc25 req-f950339d-f2e8-4d8b-851d-5a037fffed83 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0585172 Sep 18 08:42:20.989026 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-4ce2ebbb-0bbc-454c-b0c5-8793ce1c303e req-2bde10a6-903b-4363-b85d-0bfbcc003b6e tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Deleting port b03411eb-66ff-4691-88c8-2c570d78c323 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:42:20.989404 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-4ce2ebbb-0bbc-454c-b0c5-8793ce1c303e req-2bde10a6-903b-4363-b85d-0bfbcc003b6e tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:21.080828 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-4ce2ebbb-0bbc-454c-b0c5-8793ce1c303e req-2bde10a6-903b-4363-b85d-0bfbcc003b6e tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] For port b03411eb-66ff-4691-88c8-2c570d78c323, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=b03411eb-66ff-4691-88c8-2c570d78c323,segment=NetworkSegment(cb92e74f-7545-44c8-a2d3-634d116af362),segment_id=cb92e74f-7545-44c8-a2d3-634d116af362)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:42:21.081196 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-4ce2ebbb-0bbc-454c-b0c5-8793ce1c303e req-2bde10a6-903b-4363-b85d-0bfbcc003b6e tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:21.094147 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-4ce2ebbb-0bbc-454c-b0c5-8793ce1c303e req-2bde10a6-903b-4363-b85d-0bfbcc003b6e tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Calling delete_port for b03411eb-66ff-4691-88c8-2c570d78c323 owned by compute:nova {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:42:21.222276 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-4ce2ebbb-0bbc-454c-b0c5-8793ce1c303e req-2bde10a6-903b-4363-b85d-0bfbcc003b6e tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:21.249940 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bde10a6-903b-4363-b85d-0bfbcc003b6e tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Pushing event deleted for resources: {'Port': ['ID=b03411eb-66ff-4691-88c8-2c570d78c323,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:21.268207 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['b03411eb-66ff-4691-88c8-2c570d78c323'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:42:21.288441 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-4ce2ebbb-0bbc-454c-b0c5-8793ce1c303e req-2bde10a6-903b-4363-b85d-0bfbcc003b6e tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] No DVR routers for this DVR port b03411eb-66ff-4691-88c8-2c570d78c323 on host hv-cinder-80447 {{(pid=94347) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:42:21.291122 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-4ce2ebbb-0bbc-454c-b0c5-8793ce1c303e req-2bde10a6-903b-4363-b85d-0bfbcc003b6e tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:21.293130 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4ce2ebbb-0bbc-454c-b0c5-8793ce1c303e req-2bde10a6-903b-4363-b85d-0bfbcc003b6e tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.13 "DELETE /v2.0/ports/b03411eb-66ff-4691-88c8-2c570d78c323 HTTP/1.1" status: 204 len: 173 time: 0.4287558 Sep 18 08:42:21.293579 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f8a97551-ea2e-41f9-9a70-491f3e39e166', 'name': 'network-vif-deleted', 'tag': 'b03411eb-66ff-4691-88c8-2c570d78c323'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:42:21.295819 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-51bc4bbf-c95a-4985-bd29-95930425893d" -d '{"events": [{"server_uuid": "f8a97551-ea2e-41f9-9a70-491f3e39e166", "name": "network-vif-deleted", "tag": "b03411eb-66ff-4691-88c8-2c570d78c323"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:42:21.330610 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:42:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1fd95c2f-b2d0-4514-8a7f-c3a57d53b9ba x-openstack-request-id: req-1fd95c2f-b2d0-4514-8a7f-c3a57d53b9ba {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:42:21.330905 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f8a97551-ea2e-41f9-9a70-491f3e39e166", "name": "network-vif-deleted", "tag": "b03411eb-66ff-4691-88c8-2c570d78c323", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:42:21.331157 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-1fd95c2f-b2d0-4514-8a7f-c3a57d53b9ba {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:42:21.331552 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f8a97551-ea2e-41f9-9a70-491f3e39e166', 'name': 'network-vif-deleted', 'tag': 'b03411eb-66ff-4691-88c8-2c570d78c323', 'status': 'completed', 'code': 200} Sep 18 08:42:21.454317 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f407c9e3-b3d6-4145-bd24-56f19f66c148 req-844a75e2-c262-408b-97c9-eadd0f95eed8 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:21.456540 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f407c9e3-b3d6-4145-bd24-56f19f66c148 req-844a75e2-c262-408b-97c9-eadd0f95eed8 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0538375 Sep 18 08:42:21.512416 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f407c9e3-b3d6-4145-bd24-56f19f66c148 req-1831c930-49cd-473c-825c-b16b700bae51 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0499721 Sep 18 08:42:21.847335 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0459094f-6d4e-41e2-a645-7bdfbfd1ec92 req-b91ce3ff-e303-4df9-8bee-bb666ecbaf72 tempest-ServerRescueNegativeTestJSON-802649745 tempest-ServerRescueNegativeTestJSON-802649745-project] 10.222.0.35 "GET /v2.0/ports?device_id=f8a97551-ea2e-41f9-9a70-491f3e39e166 HTTP/1.1" status: 200 len: 210 time: 0.0286624 Sep 18 08:42:22.089255 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0779343e-780d-4fb0-81b1-219e477f698c req-fd504b2a-e35e-4331-98e5-3dcd7b6cb673 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:22.090696 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0779343e-780d-4fb0-81b1-219e477f698c req-fd504b2a-e35e-4331-98e5-3dcd7b6cb673 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 946 time: 0.0469594 Sep 18 08:42:22.127533 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0779343e-780d-4fb0-81b1-219e477f698c req-064e65fe-ad94-4a43-a18e-ba858d6b19a4 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0307744 Sep 18 08:42:22.398430 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-4475e51c-8919-40b7-be2d-f3bcab9e085c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:22.628942 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14c55654-eee7-4516-839d-5e1d9f7e2eb7 req-431c6120-bf43-433a-9d07-31482f69542e tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:22.630432 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-14c55654-eee7-4516-839d-5e1d9f7e2eb7 req-431c6120-bf43-433a-9d07-31482f69542e tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0465178 Sep 18 08:42:22.666404 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-14c55654-eee7-4516-839d-5e1d9f7e2eb7 req-abbeb026-8ff0-48a7-9922-b7ac3fe17199 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0302780 Sep 18 08:42:22.904064 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 33510) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:23.192234 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:23.272998 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e85f42ba-9467-4f49-a661-f90e6ffa17bb req-1defcad0-1232-49ee-baad-a9d6234477ee tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:23.274509 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e85f42ba-9467-4f49-a661-f90e6ffa17bb req-1defcad0-1232-49ee-baad-a9d6234477ee tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 946 time: 0.0800607 Sep 18 08:42:23.337585 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:23.362014 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e85f42ba-9467-4f49-a661-f90e6ffa17bb req-0bafb0e9-29dd-4e35-87cf-00417901d1f5 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0693316 Sep 18 08:42:23.385732 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-84c6c974-f537-47fa-9c8f-9b89b0328c5d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-783372'] for router_interface, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:23.973042 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29da7f94-d1a4-4942-b340-00c345bdfd38 req-120a5fa5-5c0b-43e9-ab37-e064833171d1 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:23.974663 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-29da7f94-d1a4-4942-b340-00c345bdfd38 req-120a5fa5-5c0b-43e9-ab37-e064833171d1 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.13 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 946 time: 0.3417444 Sep 18 08:42:23.993864 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8266633-1f31-4ec1-b9b2-341aea20199a req-f8bc05bc-bb64-4ae5-8fa2-6ac07a837d2a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:23.995312 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8266633-1f31-4ec1-b9b2-341aea20199a req-f8bc05bc-bb64-4ae5-8fa2-6ac07a837d2a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0970049 Sep 18 08:42:24.004013 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-84c6c974-f537-47fa-9c8f-9b89b0328c5d admin admin] Deleting port 5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:42:24.004345 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-84c6c974-f537-47fa-9c8f-9b89b0328c5d admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:24.148663 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8266633-1f31-4ec1-b9b2-341aea20199a req-fbbcc2e4-5a26-455a-967c-4501ab074376 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1140046 Sep 18 08:42:24.174256 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [None req-84c6c974-f537-47fa-9c8f-9b89b0328c5d admin admin] For port 5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e,segment=NetworkSegment(cb92e74f-7545-44c8-a2d3-634d116af362),segment_id=cb92e74f-7545-44c8-a2d3-634d116af362)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:42:24.174624 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-84c6c974-f537-47fa-9c8f-9b89b0328c5d admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:24.192764 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-84c6c974-f537-47fa-9c8f-9b89b0328c5d admin admin] Calling delete_port for 5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e owned by network:router_interface {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:42:24.198377 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-29da7f94-d1a4-4942-b340-00c345bdfd38 req-664c6cba-9af0-4b7e-973d-db779c31093d tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Deleting port 3e95f520-0716-4198-96ec-20bb84895fe7 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:42:24.198709 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-29da7f94-d1a4-4942-b340-00c345bdfd38 req-664c6cba-9af0-4b7e-973d-db779c31093d tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:24.341173 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-29da7f94-d1a4-4942-b340-00c345bdfd38 req-664c6cba-9af0-4b7e-973d-db779c31093d tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] For port 3e95f520-0716-4198-96ec-20bb84895fe7, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=3e95f520-0716-4198-96ec-20bb84895fe7,segment=NetworkSegment(d1432479-9c27-42c4-87db-6905e7868675),segment_id=d1432479-9c27-42c4-87db-6905e7868675)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:42:24.342148 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-29da7f94-d1a4-4942-b340-00c345bdfd38 req-664c6cba-9af0-4b7e-973d-db779c31093d tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:24.384570 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-29da7f94-d1a4-4942-b340-00c345bdfd38 req-664c6cba-9af0-4b7e-973d-db779c31093d tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Calling delete_port for 3e95f520-0716-4198-96ec-20bb84895fe7 owned by compute:nova {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:42:24.552371 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e081e1c3-17c2-4515-8088-cb99459e3e9b req-6f6280e0-1f05-4661-8e06-d42efdcca0c1 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:24.554061 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e081e1c3-17c2-4515-8088-cb99459e3e9b req-6f6280e0-1f05-4661-8e06-d42efdcca0c1 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=d29eb9fe-297b-417b-af91-cdeca7c4c612 HTTP/1.1" status: 200 len: 946 time: 0.1163328 Sep 18 08:42:24.581076 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-84c6c974-f537-47fa-9c8f-9b89b0328c5d admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:24.650609 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84c6c974-f537-47fa-9c8f-9b89b0328c5d admin admin] Pushing event deleted for resources: {'Port': ['ID=5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:24.699773 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e081e1c3-17c2-4515-8088-cb99459e3e9b req-740ca491-b62d-48db-a2ba-b5b0193896fb tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1373723 Sep 18 08:42:24.708295 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:42:24.720489 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-29da7f94-d1a4-4942-b340-00c345bdfd38 req-664c6cba-9af0-4b7e-973d-db779c31093d tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:24.756307 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-664c6cba-9af0-4b7e-973d-db779c31093d tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Pushing event deleted for resources: {'Port': ['ID=3e95f520-0716-4198-96ec-20bb84895fe7,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:24.762622 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['9a4f8ce9-f706-4c25-b3f4-05f2173cf516', '1f9a3d54-fb75-4f0c-8013-46a939823a2e', '711ec98d-b2bf-4c0b-b015-9df1011dd8ce', '3e95f520-0716-4198-96ec-20bb84895fe7'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:42:24.807595 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 details requested by agent hyperv_hv-cinder-80447 with host hv-cinder-80447 {{(pid=94348) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 18 08:42:24.823647 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device b03411eb-66ff-4691-88c8-2c570d78c323 no longer exists at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:42:24.833435 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-29da7f94-d1a4-4942-b340-00c345bdfd38 req-664c6cba-9af0-4b7e-973d-db779c31093d tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] No DVR routers for this DVR port 3e95f520-0716-4198-96ec-20bb84895fe7 on host hv-cinder-80447 {{(pid=94347) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:42:24.836920 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-29da7f94-d1a4-4942-b340-00c345bdfd38 req-664c6cba-9af0-4b7e-973d-db779c31093d tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:24.838904 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-29da7f94-d1a4-4942-b340-00c345bdfd38 req-664c6cba-9af0-4b7e-973d-db779c31093d tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.13 "DELETE /v2.0/ports/3e95f520-0716-4198-96ec-20bb84895fe7 HTTP/1.1" status: 204 len: 173 time: 0.8427331 Sep 18 08:42:24.839332 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd29eb9fe-297b-417b-af91-cdeca7c4c612', 'name': 'network-vif-deleted', 'tag': '3e95f520-0716-4198-96ec-20bb84895fe7'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:42:24.841607 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-77d3900c-29c0-485d-80d1-4ec0d1326168" -d '{"events": [{"server_uuid": "d29eb9fe-297b-417b-af91-cdeca7c4c612", "name": "network-vif-deleted", "tag": "3e95f520-0716-4198-96ec-20bb84895fe7"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:42:24.846917 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] No Port match for: b03411eb-66ff-4691-88c8-2c570d78c323 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:42:24.847268 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device b03411eb-66ff-4691-88c8-2c570d78c323 not bound to the agent host hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:42:24.905166 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:24.907946 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:42:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-771cdc6a-47ab-4c55-9879-9852fe04d3b8 x-openstack-request-id: req-771cdc6a-47ab-4c55-9879-9852fe04d3b8 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:42:24.908243 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d29eb9fe-297b-417b-af91-cdeca7c4c612", "name": "network-vif-deleted", "tag": "3e95f520-0716-4198-96ec-20bb84895fe7", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:42:24.908664 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-771cdc6a-47ab-4c55-9879-9852fe04d3b8 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:42:24.909138 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd29eb9fe-297b-417b-af91-cdeca7c4c612', 'name': 'network-vif-deleted', 'tag': '3e95f520-0716-4198-96ec-20bb84895fe7', 'status': 'completed', 'code': 200} Sep 18 08:42:24.927506 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-84c6c974-f537-47fa-9c8f-9b89b0328c5d admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-580042', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-785084'] for router_interface, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:24.997143 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:42:25.018760 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Returning: {'device': '2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'port_id': '2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1', 'mac_address': 'fa:16:3e:de:30:b5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 214, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94348) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 18 08:42:25.092536 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:25.115348 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 {{(pid=94348) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:42:25.147353 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:42:25.152257 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:25.176808 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-84c6c974-f537-47fa-9c8f-9b89b0328c5d admin admin] Router 98715ef0-5893-4888-ae9b-2e8029479489 has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94347) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:42:25.225759 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1,revision_number=6']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:25.241422 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:25.241778 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:25.242125 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:25.242467 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:25.242803 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:25.243136 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:25.243468 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:25.243798 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:25.244157 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:25.244490 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:25.244817 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:25.245141 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:25.330753 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0924309-6763-49a5-ab79-de22b13636d5 req-24387bb6-775d-4897-99dc-f97d52a55d46 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:25.331705 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e0924309-6763-49a5-ab79-de22b13636d5 req-24387bb6-775d-4897-99dc-f97d52a55d46 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 945 time: 0.0957880 Sep 18 08:42:25.332682 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-84c6c974-f537-47fa-9c8f-9b89b0328c5d admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94347) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:42:25.341105 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-84c6c974-f537-47fa-9c8f-9b89b0328c5d admin admin] 10.222.0.35 "PUT /v2.0/routers/98715ef0-5893-4888-ae9b-2e8029479489/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4332144 Sep 18 08:42:25.341311 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 33540) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:25.344106 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d98acf3c-0ced-42d3-ac7b-dda68c155ac9 None None] Sync routers for ids ['98715ef0-5893-4888-ae9b-2e8029479489'] in dv-cinder-804470-6-iscsi {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:42:25.358958 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d98acf3c-0ced-42d3-ac7b-dda68c155ac9 None None] Routers {'98715ef0-5893-4888-ae9b-2e8029479489'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:42:25.359693 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-d98acf3c-0ced-42d3-ac7b-dda68c155ac9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:42:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['98715ef0-5893-4888-ae9b-2e8029479489'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:42:25.373659 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e0924309-6763-49a5-ab79-de22b13636d5 req-d82c3206-97f5-4ab8-b3fb-41afba0bf919 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0342870 Sep 18 08:42:25.466710 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-82202ecb-08e4-4e12-ab55-e20dbffdad81 admin admin] Notify callbacks [] for router, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:25.485680 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-d98acf3c-0ced-42d3-ac7b-dda68c155ac9 None None] Set router 98715ef0-5893-4888-ae9b-2e8029479489 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:42:25.558442 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:42:25.571189 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-82202ecb-08e4-4e12-ab55-e20dbffdad81 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:25.640340 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.plugin [None req-82202ecb-08e4-4e12-ab55-e20dbffdad81 admin admin] Deleting port b660dcf0-57cb-4753-901e-b44b4269de3e {{(pid=94346) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:42:25.640589 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-82202ecb-08e4-4e12-ab55-e20dbffdad81 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:25.680542 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-d98acf3c-0ced-42d3-ac7b-dda68c155ac9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98715ef0-5893-4888-ae9b-2e8029479489', 'name': 'tempest-ServerRescueNegativeTestJSON-381458811-router', 'tenant_id': 'f439efa4eed0456ab2a914377e490fad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.70'}], 'enable_snat': True}, 'gw_port_id': 'b660dcf0-57cb-4753-901e-b44b4269de3e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:06Z', 'updated_at': '2021-09-18T08:42:24Z', 'revision_number': 5, 'project_id': 'f439efa4eed0456ab2a914377e490fad', 'gw_port': {'id': 'b660dcf0-57cb-4753-901e-b44b4269de3e', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:39:33:bb', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '98715ef0-5893-4888-ae9b-2e8029479489', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.70', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:07Z', 'updated_at': '2021-09-18T08:38:15Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:42:25.712565 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d98acf3c-0ced-42d3-ac7b-dda68c155ac9 None None] Checking router: 98715ef0-5893-4888-ae9b-2e8029479489 for host: dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:42:25.719776 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.db [None req-82202ecb-08e4-4e12-ab55-e20dbffdad81 admin admin] For port b660dcf0-57cb-4753-901e-b44b4269de3e, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=b660dcf0-57cb-4753-901e-b44b4269de3e,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94346) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:42:25.720255 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-82202ecb-08e4-4e12-ab55-e20dbffdad81 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:25.722880 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d98acf3c-0ced-42d3-ac7b-dda68c155ac9 None None] Routers {'98715ef0-5893-4888-ae9b-2e8029479489'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:42:25.723532 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-d98acf3c-0ced-42d3-ac7b-dda68c155ac9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:42:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['98715ef0-5893-4888-ae9b-2e8029479489'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:42:25.735212 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.plugin [None req-82202ecb-08e4-4e12-ab55-e20dbffdad81 admin admin] Calling delete_port for b660dcf0-57cb-4753-901e-b44b4269de3e owned by network:router_gateway {{(pid=94346) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:42:25.810096 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-d98acf3c-0ced-42d3-ac7b-dda68c155ac9 None None] Set router 98715ef0-5893-4888-ae9b-2e8029479489 gateway port host: None {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:42:25.866238 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-d98acf3c-0ced-42d3-ac7b-dda68c155ac9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '98715ef0-5893-4888-ae9b-2e8029479489', 'name': 'tempest-ServerRescueNegativeTestJSON-381458811-router', 'tenant_id': 'f439efa4eed0456ab2a914377e490fad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:06Z', 'updated_at': '2021-09-18T08:42:25Z', 'revision_number': 6, 'project_id': 'f439efa4eed0456ab2a914377e490fad', 'gw_port_host': None}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:42:25.894779 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d98acf3c-0ced-42d3-ac7b-dda68c155ac9 None None] The sync data for ids ['98715ef0-5893-4888-ae9b-2e8029479489'] in dv-cinder-804470-6-iscsi is: [{'id': '98715ef0-5893-4888-ae9b-2e8029479489', 'name': 'tempest-ServerRescueNegativeTestJSON-381458811-router', 'tenant_id': 'f439efa4eed0456ab2a914377e490fad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:06Z', 'updated_at': '2021-09-18T08:42:25Z', 'revision_number': 6, 'project_id': 'f439efa4eed0456ab2a914377e490fad', 'gw_port_host': None}] {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:42:25.940609 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-82202ecb-08e4-4e12-ab55-e20dbffdad81 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:25.964294 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82202ecb-08e4-4e12-ab55-e20dbffdad81 admin admin] Pushing event deleted for resources: {'Port': ['ID=b660dcf0-57cb-4753-901e-b44b4269de3e,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:26.021515 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-82202ecb-08e4-4e12-ab55-e20dbffdad81 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-785018'] for router_gateway, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:26.122742 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-82202ecb-08e4-4e12-ab55-e20dbffdad81 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-782379', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2977'] for router, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:26.124796 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-82202ecb-08e4-4e12-ab55-e20dbffdad81 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:26.182580 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-82202ecb-08e4-4e12-ab55-e20dbffdad81 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-782544'] for router, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:26.183068 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-82202ecb-08e4-4e12-ab55-e20dbffdad81 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 98715ef0-5893-4888-ae9b-2e8029479489 {{(pid=94346) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 18 08:42:26.187728 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-82202ecb-08e4-4e12-ab55-e20dbffdad81 admin admin] Notify callbacks [] for router, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:26.188947 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-82202ecb-08e4-4e12-ab55-e20dbffdad81 admin admin] 10.222.0.35 "DELETE /v2.0/routers/98715ef0-5893-4888-ae9b-2e8029479489 HTTP/1.1" status: 204 len: 168 time: 0.8466547 Sep 18 08:42:26.191491 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 33550) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:26.233251 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_v2 [None req-868d93f5-b185-4631-a746-9779e4acb77c admin admin] Deleting subnet e5dc6eef-e778-41a2-a708-c7810ade97db {{(pid=94346) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 18 08:42:26.236052 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-868d93f5-b185-4631-a746-9779e4acb77c admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:26.274256 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-868d93f5-b185-4631-a746-9779e4acb77c admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14122726'] for subnet, precommit_delete_associations {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:26.313648 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-868d93f5-b185-4631-a746-9779e4acb77c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1821528'] for subnet, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:26.366775 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-868d93f5-b185-4631-a746-9779e4acb77c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1821519', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14290141', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14198653'] for subnet, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:26.391962 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-868d93f5-b185-4631-a746-9779e4acb77c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e5dc6eef-e778-41a2-a708-c7810ade97db,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:26.393951 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-868d93f5-b185-4631-a746-9779e4acb77c admin admin] Notify callbacks [] for subnet, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:26.395795 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-868d93f5-b185-4631-a746-9779e4acb77c admin admin] 10.222.0.35 "DELETE /v2.0/subnets/e5dc6eef-e778-41a2-a708-c7810ade97db HTTP/1.1" status: 204 len: 168 time: 0.2034066 Sep 18 08:42:26.398476 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 33552) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:26.476261 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-482a3267-c2a1-44f2-8821-4bd9e773b164 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1861545'] for network, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:26.498957 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f35bad9a-38e7-4d09-942f-61e2d1e8c0e5 req-d47d374e-90b7-4b60-9dab-5f3dae6a3a21 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:26.500568 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f35bad9a-38e7-4d09-942f-61e2d1e8c0e5 req-d47d374e-90b7-4b60-9dab-5f3dae6a3a21 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 945 time: 0.0505164 Sep 18 08:42:26.539150 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f35bad9a-38e7-4d09-942f-61e2d1e8c0e5 req-b641c7a4-a36b-4067-aed4-efbf12b5f0e2 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0326319 Sep 18 08:42:26.545168 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-482a3267-c2a1-44f2-8821-4bd9e773b164 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1806559', 'neutron.services.segments.db._delete_segments_for_network-8732885752733'] for network, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:26.567628 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-482a3267-c2a1-44f2-8821-4bd9e773b164 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fdcbc66e-323e-4b44-be97-566949f4f2ef']}} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:42:26.577404 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-482a3267-c2a1-44f2-8821-4bd9e773b164 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'cb92e74f-7545-44c8-a2d3-634d116af362') {'for_net_delete': True} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:42:26.577726 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-482a3267-c2a1-44f2-8821-4bd9e773b164 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'cb92e74f-7545-44c8-a2d3-634d116af362') {} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:42:26.586654 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-482a3267-c2a1-44f2-8821-4bd9e773b164 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732885753254', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14122733'] for segment, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:26.599918 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-482a3267-c2a1-44f2-8821-4bd9e773b164 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:26.605596 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-482a3267-c2a1-44f2-8821-4bd9e773b164 admin admin] Releasing vlan 204 on physical network physnet1 to pool {{(pid=94346) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 18 08:42:26.605979 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-482a3267-c2a1-44f2-8821-4bd9e773b164 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14289667'] for segment, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: Traceback (most recent call last): Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: timer() Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: cb(*args, **kw) Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: return func(*args, **kwargs) Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: self._notify() Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: self.callback(batched_events) Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: event.method(event) Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: aggregate_uuid = self.p_client.list_aggregates( Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: return f(self, *a, **k) Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: return self._get(url).json() Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: return self.request(url, 'GET', **kwargs) Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: base_url = self.get_endpoint(auth, allow=allow, Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 18 08:42:26.607582 dv-cinder-804470-6-iscsi neutron-server[94346]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 18 08:42:26.658602 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-482a3267-c2a1-44f2-8821-4bd9e773b164 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1806534', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-784926'] for network, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:26.664643 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-482a3267-c2a1-44f2-8821-4bd9e773b164 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:26.668821 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-482a3267-c2a1-44f2-8821-4bd9e773b164 admin admin] 10.222.0.35 "DELETE /v2.0/networks/fdcbc66e-323e-4b44-be97-566949f4f2ef HTTP/1.1" status: 204 len: 168 time: 0.2671893 Sep 18 08:42:26.678628 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-482a3267-c2a1-44f2-8821-4bd9e773b164 admin admin] Pushing event deleted for resources: {'Network': ['ID=fdcbc66e-323e-4b44-be97-566949f4f2ef,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:26.802975 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 up at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:42:26.831329 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 33560) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:26.851411 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning complete for port 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:42:26.851787 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:26.880868 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-a41ac9e5-a87b-4713-80fe-5842ae794f51 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=f439efa4eed0456ab2a914377e490fad&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0482075 Sep 18 08:42:26.881358 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 33566) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:26.942850 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c66c07ac-f204-40e6-8d2c-bdcc2d34c1d9 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:26.961827 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:26.966101 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c66c07ac-f204-40e6-8d2c-bdcc2d34c1d9 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:26.987582 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4248ac92-ce7b-4560-9f83-de05a7069a99', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:42:26.989847 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-099caef9-8985-4f21-bbc1-4aeccf1d3cd8" -d '{"events": [{"server_uuid": "4248ac92-ce7b-4560-9f83-de05a7069a99", "name": "network-vif-plugged", "status": "completed", "tag": "2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:42:27.009601 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:42:27.013988 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:27.014873 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 3e95f520-0716-4198-96ec-20bb84895fe7 no longer exists at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:42:27.031255 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c66c07ac-f204-40e6-8d2c-bdcc2d34c1d9 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:27.033964 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c66c07ac-f204-40e6-8d2c-bdcc2d34c1d9 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:27.035192 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-c66c07ac-f204-40e6-8d2c-bdcc2d34c1d9 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/a3cd9a1a-0a1d-4623-a97b-f340b7e3e788 HTTP/1.1" status: 204 len: 168 time: 0.1528492 Sep 18 08:42:27.042986 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c66c07ac-f204-40e6-8d2c-bdcc2d34c1d9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a3cd9a1a-0a1d-4623-a97b-f340b7e3e788,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:27.044178 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:42:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b3797eb8-e491-460c-b9b5-982be75c063e x-openstack-request-id: req-b3797eb8-e491-460c-b9b5-982be75c063e {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:42:27.045085 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4248ac92-ce7b-4560-9f83-de05a7069a99", "name": "network-vif-plugged", "status": "completed", "tag": "2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:42:27.045390 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-b3797eb8-e491-460c-b9b5-982be75c063e {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:42:27.045920 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4248ac92-ce7b-4560-9f83-de05a7069a99', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1', 'code': 200} Sep 18 08:42:27.066030 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] No Port match for: 3e95f520-0716-4198-96ec-20bb84895fe7 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:42:27.066395 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 3e95f520-0716-4198-96ec-20bb84895fe7 not bound to the agent host hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:42:27.098889 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1,revision_number=7']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:27.429417 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e no longer exists at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:42:27.449237 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-536c997d-2873-442a-81bf-9fe918803742 None None] No Port match for: 5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:42:27.449510 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 5e3399a6-59fe-4685-9cd5-4e6f4f2d4b0e not bound to the agent host dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:42:27.449928 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device b660dcf0-57cb-4753-901e-b44b4269de3e no longer exists at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:42:27.468692 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-536c997d-2873-442a-81bf-9fe918803742 None None] No Port match for: b660dcf0-57cb-4753-901e-b44b4269de3e {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:42:27.469042 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device b660dcf0-57cb-4753-901e-b44b4269de3e not bound to the agent host dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:42:27.659097 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d201434-4fb7-477a-a6ca-088674dc11da req-b1ae8bd8-75aa-489f-ad2a-7378af20a6eb tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:27.660670 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7d201434-4fb7-477a-a6ca-088674dc11da req-b1ae8bd8-75aa-489f-ad2a-7378af20a6eb tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0528586 Sep 18 08:42:27.698774 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7d201434-4fb7-477a-a6ca-088674dc11da req-7f29f331-b01f-4e58-acb4-8b2b9f50d393 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0321589 Sep 18 08:42:28.184255 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ce10627-904a-419e-8455-803b38405588 req-ec505bed-c279-4cba-ad89-fd78fa55077c tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:28.186409 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3ce10627-904a-419e-8455-803b38405588 req-ec505bed-c279-4cba-ad89-fd78fa55077c tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=a884b539-9c6e-40b3-87ef-28ca4a9daf7a HTTP/1.1" status: 200 len: 946 time: 0.0509763 Sep 18 08:42:28.229303 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3ce10627-904a-419e-8455-803b38405588 req-e33eaf49-d2d0-4a98-968c-477bf8ec12bf tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0365975 Sep 18 08:42:28.278536 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 33634) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:28.381996 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ad782718-d8dd-4237-a4a5-65d24666a83e admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:28.466897 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ad782718-d8dd-4237-a4a5-65d24666a83e admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:28.470733 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ad782718-d8dd-4237-a4a5-65d24666a83e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:28.507613 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-ad782718-d8dd-4237-a4a5-65d24666a83e admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=b285db0ef8874066a94e336480bc1bfa&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2270236 Sep 18 08:42:28.508481 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad782718-d8dd-4237-a4a5-65d24666a83e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=36708ac4-e2a4-4c2d-a545-7c6cf8b0c77a,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:28.510425 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 33638) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:28.515992 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad782718-d8dd-4237-a4a5-65d24666a83e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:28.516348 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad782718-d8dd-4237-a4a5-65d24666a83e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:28.516692 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad782718-d8dd-4237-a4a5-65d24666a83e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:28.517030 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad782718-d8dd-4237-a4a5-65d24666a83e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:28.517396 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad782718-d8dd-4237-a4a5-65d24666a83e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:28.517730 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad782718-d8dd-4237-a4a5-65d24666a83e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:28.518060 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad782718-d8dd-4237-a4a5-65d24666a83e admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:28.518387 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad782718-d8dd-4237-a4a5-65d24666a83e admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:28.518718 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad782718-d8dd-4237-a4a5-65d24666a83e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:28.519046 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad782718-d8dd-4237-a4a5-65d24666a83e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:28.519366 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad782718-d8dd-4237-a4a5-65d24666a83e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:28.519687 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ad782718-d8dd-4237-a4a5-65d24666a83e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:28.564903 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0d9594bd-7dd5-4396-af10-701a4408ff9f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:28.593610 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0d9594bd-7dd5-4396-af10-701a4408ff9f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:28.635919 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0d9594bd-7dd5-4396-af10-701a4408ff9f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:28.639004 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0d9594bd-7dd5-4396-af10-701a4408ff9f admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:28.640231 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-0d9594bd-7dd5-4396-af10-701a4408ff9f admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/36708ac4-e2a4-4c2d-a545-7c6cf8b0c77a HTTP/1.1" status: 204 len: 168 time: 0.1287527 Sep 18 08:42:28.648090 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d9594bd-7dd5-4396-af10-701a4408ff9f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=36708ac4-e2a4-4c2d-a545-7c6cf8b0c77a,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:28.841122 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-effd4ec5-e808-4552-af8e-df4f889583ac req-be6734b9-f1ce-4d61-932f-8d6aeb9b23f8 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:28.842781 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-effd4ec5-e808-4552-af8e-df4f889583ac req-be6734b9-f1ce-4d61-932f-8d6aeb9b23f8 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 946 time: 0.0776811 Sep 18 08:42:28.854757 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1431ff1-41cf-43a3-baf7-3aec9c3795d2 req-732bd2ec-736d-46e2-816f-3aef5586f4a1 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:28.856241 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e1431ff1-41cf-43a3-baf7-3aec9c3795d2 req-732bd2ec-736d-46e2-816f-3aef5586f4a1 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0807869 Sep 18 08:42:28.910236 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-effd4ec5-e808-4552-af8e-df4f889583ac req-6d550900-16f0-4e9e-8a90-0608decdd7ed tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0530357 Sep 18 08:42:28.921387 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e1431ff1-41cf-43a3-baf7-3aec9c3795d2 req-4e6ebe5c-25f3-47c4-9367-f137d4d802a3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0570722 Sep 18 08:42:28.932425 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 33660) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:29.178777 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-40ac6774-b314-458c-8698-fe2383ffdaa7 tempest-TestMinimumBasicScenario-94533468 tempest-TestMinimumBasicScenario-94533468-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:29.180333 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-40ac6774-b314-458c-8698-fe2383ffdaa7 tempest-TestMinimumBasicScenario-94533468 tempest-TestMinimumBasicScenario-94533468-project-admin] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 1094 time: 0.2469134 Sep 18 08:42:29.183366 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 33672) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:29.188268 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-b6da7481-fec6-4e39-969a-0c587d8e9771 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Request body: {'floatingip': {'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'port_id': 'a16828fd-b0f1-4ba0-a92a-61614fabe668', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'fixed_ip_address': '172.20.0.10'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:42:29.210699 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b6da7481-fec6-4e39-969a-0c587d8e9771 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for floatingip, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:29.324502 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b6da7481-fec6-4e39-969a-0c587d8e9771 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:29.384617 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a79dd4b-a58d-4459-bca6-88495e8f0a15 req-b1e38ea7-ad3f-4cd3-96a2-3e8efc4d051d tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:29.386945 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0a79dd4b-a58d-4459-bca6-88495e8f0a15 req-b1e38ea7-ad3f-4cd3-96a2-3e8efc4d051d tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=a884b539-9c6e-40b3-87ef-28ca4a9daf7a HTTP/1.1" status: 200 len: 946 time: 0.0626307 Sep 18 08:42:29.434848 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_common [None req-b6da7481-fec6-4e39-969a-0c587d8e9771 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Allocated IP 172.27.1.115 (2e3b3f85-63e4-4380-917a-8c90c80b3e38/cd525bb9-7f93-490c-a5d6-a08911817e54/67a080af-449c-444f-93d0-5cb66582b807) {{(pid=94346) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:42:29.449548 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0a79dd4b-a58d-4459-bca6-88495e8f0a15 req-ad490d1f-8d06-4cb0-be62-146798cad396 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508890 Sep 18 08:42:29.750575 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b6da7481-fec6-4e39-969a-0c587d8e9771 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for port, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:29.783265 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b6da7481-fec6-4e39-969a-0c587d8e9771 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:29.818727 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b6da7481-fec6-4e39-969a-0c587d8e9771 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:42:29.821436 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-b6da7481-fec6-4e39-969a-0c587d8e9771 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:42:29.824848 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6da7481-fec6-4e39-969a-0c587d8e9771 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Received port after_create {{(pid=94346) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:42:29.853983 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6da7481-fec6-4e39-969a-0c587d8e9771 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Pushing event updated for resources: {'Port': ['ID=67a080af-449c-444f-93d0-5cb66582b807,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:30.053358 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e83a4980-2e48-432b-a8dd-5fcfbe6fc187 req-123546b7-f407-4edf-bd3b-d40ddb6ce25d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:30.055039 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e83a4980-2e48-432b-a8dd-5fcfbe6fc187 req-123546b7-f407-4edf-bd3b-d40ddb6ce25d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0508268 Sep 18 08:42:30.108144 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e83a4980-2e48-432b-a8dd-5fcfbe6fc187 req-fe2e14f8-3ac3-4f79-8280-7034c6698168 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0469856 Sep 18 08:42:30.223026 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b6da7481-fec6-4e39-969a-0c587d8e9771 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for floatingip, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:30.293359 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b6da7481-fec6-4e39-969a-0c587d8e9771 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:30.459032 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b6da7481-fec6-4e39-969a-0c587d8e9771 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for port, precommit_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:30.467282 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b6da7481-fec6-4e39-969a-0c587d8e9771 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14290155'] for port, after_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:30.519654 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b6da7481-fec6-4e39-969a-0c587d8e9771 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Pushing event updated for resources: {'Port': ['ID=67a080af-449c-444f-93d0-5cb66582b807,revision_number=2']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:30.572365 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b6da7481-fec6-4e39-969a-0c587d8e9771 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-784908'] for floatingip, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:30.593181 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df5104be-b551-400f-9f6a-523f68dd638f req-24a64c0e-aff3-4ccd-8e8d-51706da0f233 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:30.595321 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-df5104be-b551-400f-9f6a-523f68dd638f req-24a64c0e-aff3-4ccd-8e8d-51706da0f233 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=a884b539-9c6e-40b3-87ef-28ca4a9daf7a HTTP/1.1" status: 200 len: 946 time: 0.0732696 Sep 18 08:42:30.646520 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-df5104be-b551-400f-9f6a-523f68dd638f req-2bd5002d-7d62-4879-a241-d4c35113a0da tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403171 Sep 18 08:42:30.682009 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.db.l3_db [None req-b6da7481-fec6-4e39-969a-0c587d8e9771 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Floating IP 4ba4ba6b-76bb-404f-89a3-659445347a63 associated. External IP: 172.27.1.115, port: a16828fd-b0f1-4ba0-a92a-61614fabe668. Sep 18 08:42:30.903336 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b6da7481-fec6-4e39-969a-0c587d8e9771 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Router 2406a855-e08c-4bcc-974c-cd88788039b3 has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94346) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:42:30.948448 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f5fb309-43aa-464c-a0de-a42e28a74527 req-f8f623f2-c4de-450b-986f-5465c8728749 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:30.950275 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4f5fb309-43aa-464c-a0de-a42e28a74527 req-f8f623f2-c4de-450b-986f-5465c8728749 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.13 "GET /v2.0/ports?device_id=a884b539-9c6e-40b3-87ef-28ca4a9daf7a HTTP/1.1" status: 200 len: 946 time: 0.0516415 Sep 18 08:42:31.028096 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 33756) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:31.036820 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b6da7481-fec6-4e39-969a-0c587d8e9771 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94346) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:42:31.049593 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc075b18-f33d-4a4b-9968-e3b8fa9de99a None None] Sync routers for ids ['2406a855-e08c-4bcc-974c-cd88788039b3'] in dv-cinder-804470-6-iscsi {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:42:31.056557 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b6da7481-fec6-4e39-969a-0c587d8e9771 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for floatingip, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:31.061639 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc075b18-f33d-4a4b-9968-e3b8fa9de99a None None] Routers {'2406a855-e08c-4bcc-974c-cd88788039b3'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:42:31.062548 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-bc075b18-f33d-4a4b-9968-e3b8fa9de99a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:42:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['2406a855-e08c-4bcc-974c-cd88788039b3'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:42:31.066301 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-4f5fb309-43aa-464c-a0de-a42e28a74527 req-2be87cb5-6569-4fa6-8de9-26b3bf28b02f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Deleting port 711ec98d-b2bf-4c0b-b015-9df1011dd8ce {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:42:31.066301 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-4f5fb309-43aa-464c-a0de-a42e28a74527 req-2be87cb5-6569-4fa6-8de9-26b3bf28b02f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:31.121071 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-b6da7481-fec6-4e39-969a-0c587d8e9771 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.9366331 Sep 18 08:42:31.121693 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 33760) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:31.122145 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e85a7284-e6ea-47ab-9674-09d8666b742f', 'tag': 'a16828fd-b0f1-4ba0-a92a-61614fabe668'}] {{(pid=94346) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:42:31.124987 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9c65146fa140f7f105fbfe1cfc0ed8a4aa4ddea85af05f4a70363726e3aa059" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-95768ec0-60ca-4792-8295-03216c4dc7d5" -d '{"events": [{"name": "network-changed", "server_uuid": "e85a7284-e6ea-47ab-9674-09d8666b742f", "tag": "a16828fd-b0f1-4ba0-a92a-61614fabe668"}]}' {{(pid=94346) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:42:31.131692 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-0bc79070-83a8-4c3f-9bb4-fe03c5749fdf tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1101793206', 'description': 'tempest-secgroup-smoke-1101793206 description', 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:42:31.166994 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0bc79070-83a8-4c3f-9bb4-fe03c5749fdf tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:31.190236 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-bc075b18-f33d-4a4b-9968-e3b8fa9de99a None None] Set router 2406a855-e08c-4bcc-974c-cd88788039b3 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:42:31.198553 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-4f5fb309-43aa-464c-a0de-a42e28a74527 req-2be87cb5-6569-4fa6-8de9-26b3bf28b02f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] For port 711ec98d-b2bf-4c0b-b015-9df1011dd8ce, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=711ec98d-b2bf-4c0b-b015-9df1011dd8ce,segment=NetworkSegment(d1432479-9c27-42c4-87db-6905e7868675),segment_id=d1432479-9c27-42c4-87db-6905e7868675)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:42:31.198959 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-4f5fb309-43aa-464c-a0de-a42e28a74527 req-2be87cb5-6569-4fa6-8de9-26b3bf28b02f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:31.228709 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-4f5fb309-43aa-464c-a0de-a42e28a74527 req-2be87cb5-6569-4fa6-8de9-26b3bf28b02f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Calling delete_port for 711ec98d-b2bf-4c0b-b015-9df1011dd8ce owned by compute:nova {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:42:31.237109 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:42:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9066a875-2b66-4b08-85aa-9d66f2c1cf9b x-openstack-request-id: req-9066a875-2b66-4b08-85aa-9d66f2c1cf9b {{(pid=94346) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:42:31.237332 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e85a7284-e6ea-47ab-9674-09d8666b742f", "tag": "a16828fd-b0f1-4ba0-a92a-61614fabe668", "status": "completed", "code": 200}]} {{(pid=94346) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:42:31.237555 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-9066a875-2b66-4b08-85aa-9d66f2c1cf9b {{(pid=94346) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:42:31.238478 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e85a7284-e6ea-47ab-9674-09d8666b742f', 'tag': 'a16828fd-b0f1-4ba0-a92a-61614fabe668', 'status': 'completed', 'code': 200} Sep 18 08:42:31.251487 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1afdf2dc-fc51-460d-84bb-8779832c712c admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:31.389965 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0bc79070-83a8-4c3f-9bb4-fe03c5749fdf tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:31.408084 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0bc79070-83a8-4c3f-9bb4-fe03c5749fdf tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:31.436204 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05c0a8d4-6e9d-4859-a244-a40988a42e58 req-7c7eb0c4-3fd4-4d2f-aed7-df6c917765a3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:31.438462 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-05c0a8d4-6e9d-4859-a244-a40988a42e58 req-7c7eb0c4-3fd4-4d2f-aed7-df6c917765a3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.1343660 Sep 18 08:42:31.459197 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95768ec0-60ca-4792-8295-03216c4dc7d5 req-4e082281-2ec7-4142-a8ec-8495bb8364a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:31.461009 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-95768ec0-60ca-4792-8295-03216c4dc7d5 req-4e082281-2ec7-4142-a8ec-8495bb8364a6 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=62a8d3b5ed4d4fe085db724f264e25c4&device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 1099 time: 0.1557591 Sep 18 08:42:31.496337 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bc79070-83a8-4c3f-9bb4-fe03c5749fdf tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a1773be7-b5fe-42cf-af53-72ae4a128df3,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:31.579208 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-05c0a8d4-6e9d-4859-a244-a40988a42e58 req-8ad6918a-69a5-4c59-ad30-50e4d9ff5fcb tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1232102 Sep 18 08:42:31.582636 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-bc075b18-f33d-4a4b-9968-e3b8fa9de99a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'name': 'tempest-TestMinimumBasicScenario-2061029967-router', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '1c451dba-c399-4ceb-a969-412896a38aec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:12Z', 'revision_number': 4, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'gw_port': {'id': '1c451dba-c399-4ceb-a969-412896a38aec', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:c3:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 441, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': '4ba4ba6b-76bb-404f-89a3-659445347a63', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'floating_ip_address': '172.27.1.115', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'port_id': 'a16828fd-b0f1-4ba0-a92a-61614fabe668', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 513, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '48bd9423-5b85-4344-9434-17e10e227731', 'mac_address': 'fa:16:3e:32:a3:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e85a7284-e6ea-47ab-9674-09d8666b742f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:42:30Z', 'updated_at': '2021-09-18T08:42:30Z', 'revision_number': 0, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'cda97d8d-7e99-46b1-937f-0a3ae975c076', 'name': '', 'network_id': '48bd9423-5b85-4344-9434-17e10e227731', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'mac_address': 'fa:16:3e:f2:78:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': '95fb2797-9ac9-40f9-9ea9-56d2c5a16291', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:11Z', 'updated_at': '2021-09-18T08:41:17Z', 'revision_number': 5, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'subnets': [{'id': '95fb2797-9ac9-40f9-9ea9-56d2c5a16291', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:42:31.614356 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1afdf2dc-fc51-460d-84bb-8779832c712c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:31.629170 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1afdf2dc-fc51-460d-84bb-8779832c712c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:31.638677 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc075b18-f33d-4a4b-9968-e3b8fa9de99a None None] Checking router: 2406a855-e08c-4bcc-974c-cd88788039b3 for host: dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:42:31.647886 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc075b18-f33d-4a4b-9968-e3b8fa9de99a None None] Routers {'2406a855-e08c-4bcc-974c-cd88788039b3'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:42:31.648517 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-bc075b18-f33d-4a4b-9968-e3b8fa9de99a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 9, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 9, "log_agent_heartbeats": false, "routers": 9},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:42:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['2406a855-e08c-4bcc-974c-cd88788039b3'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:42:31.659924 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1afdf2dc-fc51-460d-84bb-8779832c712c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2c9668d3-e3ed-4d8d-b250-37929aeec073,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:31.664660 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0bc79070-83a8-4c3f-9bb4-fe03c5749fdf tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:31.666035 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-0bc79070-83a8-4c3f-9bb4-fe03c5749fdf tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.5380883 Sep 18 08:42:31.668861 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 33774) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:31.669168 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95768ec0-60ca-4792-8295-03216c4dc7d5 req-798faef4-d263-47d8-913f-8703dfef26b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:31.671482 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-95768ec0-60ca-4792-8295-03216c4dc7d5 req-798faef4-d263-47d8-913f-8703dfef26b8 service neutron] 10.222.0.13 "GET /v2.0/networks?id=48bd9423-5b85-4344-9434-17e10e227731 HTTP/1.1" status: 200 len: 916 time: 0.1812918 Sep 18 08:42:31.673104 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-4f5fb309-43aa-464c-a0de-a42e28a74527 req-2be87cb5-6569-4fa6-8de9-26b3bf28b02f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:31.674648 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-1bb80872-4c2d-4f7f-a4a4-7103e1c1c431 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Request body: {'security_group_rule': {'security_group_id': 'a1773be7-b5fe-42cf-af53-72ae4a128df3', 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:42:31.705660 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-1afdf2dc-fc51-460d-84bb-8779832c712c admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=9331a120b429410486a245394b377a4e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.6756840 Sep 18 08:42:31.709451 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 33778) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:31.761282 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1bb80872-4c2d-4f7f-a4a4-7103e1c1c431 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:31.797833 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2be87cb5-6569-4fa6-8de9-26b3bf28b02f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Pushing event deleted for resources: {'Port': ['ID=711ec98d-b2bf-4c0b-b015-9df1011dd8ce,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:31.827401 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1bb80872-4c2d-4f7f-a4a4-7103e1c1c431 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:31.828708 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-4f5fb309-43aa-464c-a0de-a42e28a74527 req-2be87cb5-6569-4fa6-8de9-26b3bf28b02f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] No DVR routers for this DVR port 711ec98d-b2bf-4c0b-b015-9df1011dd8ce on host hv-cinder-80447 {{(pid=94347) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:42:31.837248 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1bb80872-4c2d-4f7f-a4a4-7103e1c1c431 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-561193'] for security_group_rule, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:31.861578 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bb80872-4c2d-4f7f-a4a4-7103e1c1c431 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4cbba4b8-291e-4afb-8e17-d17fb6aa2fa0,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:31.868875 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-17bce2ba-3966-480e-a23b-9111249e3968 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:31.873561 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9f025ffa-6d01-41b8-abe2-4530e2d7a145 req-73e5f437-2fed-480b-aaf3-994b937146e2 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=a884b539-9c6e-40b3-87ef-28ca4a9daf7a HTTP/1.1" status: 200 len: 210 time: 0.0803499 Sep 18 08:42:31.882028 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-4f5fb309-43aa-464c-a0de-a42e28a74527 req-2be87cb5-6569-4fa6-8de9-26b3bf28b02f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:31.895060 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4f5fb309-43aa-464c-a0de-a42e28a74527 req-2be87cb5-6569-4fa6-8de9-26b3bf28b02f tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.13 "DELETE /v2.0/ports/711ec98d-b2bf-4c0b-b015-9df1011dd8ce HTTP/1.1" status: 204 len: 173 time: 0.9373188 Sep 18 08:42:31.895305 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-17bce2ba-3966-480e-a23b-9111249e3968 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:31.897873 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a884b539-9c6e-40b3-87ef-28ca4a9daf7a', 'name': 'network-vif-deleted', 'tag': '711ec98d-b2bf-4c0b-b015-9df1011dd8ce'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:42:31.913646 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ffce8a21-3b88-4e7a-b606-b18d4ae35c70" -d '{"events": [{"server_uuid": "a884b539-9c6e-40b3-87ef-28ca4a9daf7a", "name": "network-vif-deleted", "tag": "711ec98d-b2bf-4c0b-b015-9df1011dd8ce"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:42:31.963052 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-95768ec0-60ca-4792-8295-03216c4dc7d5 req-d2905907-9dae-4e39-9ac9-8882d8382399 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a16828fd-b0f1-4ba0-a92a-61614fabe668 HTTP/1.1" status: 200 len: 1000 time: 0.2720082 Sep 18 08:42:31.986984 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-bc075b18-f33d-4a4b-9968-e3b8fa9de99a None None] Set router 2406a855-e08c-4bcc-974c-cd88788039b3 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:42:31.993223 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-17bce2ba-3966-480e-a23b-9111249e3968 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:31.996523 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-17bce2ba-3966-480e-a23b-9111249e3968 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:31.997285 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:42:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f6c4681d-9661-4ad9-8c5d-45840fbfd557 x-openstack-request-id: req-f6c4681d-9661-4ad9-8c5d-45840fbfd557 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:42:31.998155 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a884b539-9c6e-40b3-87ef-28ca4a9daf7a", "name": "network-vif-deleted", "tag": "711ec98d-b2bf-4c0b-b015-9df1011dd8ce", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:42:31.998482 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-f6c4681d-9661-4ad9-8c5d-45840fbfd557 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:42:31.999359 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-17bce2ba-3966-480e-a23b-9111249e3968 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/2c9668d3-e3ed-4d8d-b250-37929aeec073 HTTP/1.1" status: 204 len: 168 time: 0.2886863 Sep 18 08:42:32.010294 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a884b539-9c6e-40b3-87ef-28ca4a9daf7a', 'name': 'network-vif-deleted', 'tag': '711ec98d-b2bf-4c0b-b015-9df1011dd8ce', 'status': 'completed', 'code': 200} Sep 18 08:42:32.010574 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17bce2ba-3966-480e-a23b-9111249e3968 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2c9668d3-e3ed-4d8d-b250-37929aeec073,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:32.013909 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1bb80872-4c2d-4f7f-a4a4-7103e1c1c431 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:32.015482 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-1bb80872-4c2d-4f7f-a4a4-7103e1c1c431 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3449254 Sep 18 08:42:32.018239 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 33784) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:32.030708 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-0d498d61-4ba0-4dda-9b0b-6906ee815e7e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Request body: {'security_group_rule': {'security_group_id': 'a1773be7-b5fe-42cf-af53-72ae4a128df3', 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:42:32.090282 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0d498d61-4ba0-4dda-9b0b-6906ee815e7e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:32.095364 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95768ec0-60ca-4792-8295-03216c4dc7d5 req-f3898f67-3c3e-4e35-a779-04426bdc8efb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:32.097074 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-95768ec0-60ca-4792-8295-03216c4dc7d5 req-f3898f67-3c3e-4e35-a779-04426bdc8efb service neutron] 10.222.0.13 "GET /v2.0/subnets?id=95fb2797-9ac9-40f9-9ea9-56d2c5a16291 HTTP/1.1" status: 200 len: 854 time: 0.0863307 Sep 18 08:42:32.160712 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['9a4f8ce9-f706-4c25-b3f4-05f2173cf516', '1f9a3d54-fb75-4f0c-8013-46a939823a2e', '711ec98d-b2bf-4c0b-b015-9df1011dd8ce'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:42:32.173807 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0d498d61-4ba0-4dda-9b0b-6906ee815e7e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:32.179568 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0d498d61-4ba0-4dda-9b0b-6906ee815e7e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-561193'] for security_group_rule, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:32.191484 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95768ec0-60ca-4792-8295-03216c4dc7d5 req-719ef1c1-3788-4941-abf7-7fce3b1daebc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:32.197989 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-95768ec0-60ca-4792-8295-03216c4dc7d5 req-719ef1c1-3788-4941-abf7-7fce3b1daebc service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=48bd9423-5b85-4344-9434-17e10e227731&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0929086 Sep 18 08:42:32.234082 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d498d61-4ba0-4dda-9b0b-6906ee815e7e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=47bb2fa6-045b-43ee-ab43-e133f5e99e2f,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:32.244511 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0d498d61-4ba0-4dda-9b0b-6906ee815e7e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:32.249816 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-0d498d61-4ba0-4dda-9b0b-6906ee815e7e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2301223 Sep 18 08:42:32.250622 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 33788) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:32.256918 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-c8b53379-97eb-42b4-aa3d-02139ef2a61f tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Request body: {'security_group_rule': {'security_group_id': 'a1773be7-b5fe-42cf-af53-72ae4a128df3', 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:42:32.291002 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c8b53379-97eb-42b4-aa3d-02139ef2a61f tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:32.407987 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c8b53379-97eb-42b4-aa3d-02139ef2a61f tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:32.411833 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-95768ec0-60ca-4792-8295-03216c4dc7d5 req-1a8c2c29-a6b0-4996-9696-a1e23c332f9f service neutron] 10.222.0.13 "GET /v2.0/networks/48bd9423-5b85-4344-9434-17e10e227731?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2039657 Sep 18 08:42:32.421064 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c8b53379-97eb-42b4-aa3d-02139ef2a61f tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-561193'] for security_group_rule, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:32.472677 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8b53379-97eb-42b4-aa3d-02139ef2a61f tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f916a3a1-815d-47c8-b621-9c14658ee509,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:32.523227 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c8b53379-97eb-42b4-aa3d-02139ef2a61f tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:32.538325 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-c8b53379-97eb-42b4-aa3d-02139ef2a61f tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2861125 Sep 18 08:42:32.541307 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 33792) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:32.548719 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-bc075b18-f33d-4a4b-9968-e3b8fa9de99a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'name': 'tempest-TestMinimumBasicScenario-2061029967-router', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '1c451dba-c399-4ceb-a969-412896a38aec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:12Z', 'revision_number': 4, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'gw_port': {'id': '1c451dba-c399-4ceb-a969-412896a38aec', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:c3:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 441, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': '4ba4ba6b-76bb-404f-89a3-659445347a63', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'floating_ip_address': '172.27.1.115', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'port_id': 'a16828fd-b0f1-4ba0-a92a-61614fabe668', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 513, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '48bd9423-5b85-4344-9434-17e10e227731', 'mac_address': 'fa:16:3e:32:a3:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e85a7284-e6ea-47ab-9674-09d8666b742f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:42:30Z', 'updated_at': '2021-09-18T08:42:30Z', 'revision_number': 0, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'cda97d8d-7e99-46b1-937f-0a3ae975c076', 'name': '', 'network_id': '48bd9423-5b85-4344-9434-17e10e227731', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'mac_address': 'fa:16:3e:f2:78:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': '95fb2797-9ac9-40f9-9ea9-56d2c5a16291', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:11Z', 'updated_at': '2021-09-18T08:41:17Z', 'revision_number': 5, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'subnets': [{'id': '95fb2797-9ac9-40f9-9ea9-56d2c5a16291', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:42:32.561649 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-1cec89b3-eed5-467e-a64c-3d4e9cce6e73 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Request body: {'security_group_rule': {'security_group_id': 'a1773be7-b5fe-42cf-af53-72ae4a128df3', 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:42:32.595867 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bc075b18-f33d-4a4b-9968-e3b8fa9de99a None None] The sync data for ids ['2406a855-e08c-4bcc-974c-cd88788039b3'] in dv-cinder-804470-6-iscsi is: [{'id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'name': 'tempest-TestMinimumBasicScenario-2061029967-router', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '1c451dba-c399-4ceb-a969-412896a38aec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:12Z', 'revision_number': 4, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'gw_port': {'id': '1c451dba-c399-4ceb-a969-412896a38aec', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:c3:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 441, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': '4ba4ba6b-76bb-404f-89a3-659445347a63', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'floating_ip_address': '172.27.1.115', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'port_id': 'a16828fd-b0f1-4ba0-a92a-61614fabe668', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 513, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '48bd9423-5b85-4344-9434-17e10e227731', 'mac_address': 'fa:16:3e:32:a3:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'e85a7284-e6ea-47ab-9674-09d8666b742f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:42:30Z', 'updated_at': '2021-09-18T08:42:30Z', 'revision_number': 0, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'cda97d8d-7e99-46b1-937f-0a3ae975c076', 'name': '', 'network_id': '48bd9423-5b85-4344-9434-17e10e227731', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'mac_address': 'fa:16:3e:f2:78:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': '95fb2797-9ac9-40f9-9ea9-56d2c5a16291', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:11Z', 'updated_at': '2021-09-18T08:41:17Z', 'revision_number': 5, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'subnets': [{'id': '95fb2797-9ac9-40f9-9ea9-56d2c5a16291', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:42:32.637565 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 33796) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:32.663747 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-95768ec0-60ca-4792-8295-03216c4dc7d5 req-d98a1235-7345-4d7b-91e5-03327b1f6968 service neutron] 10.222.0.13 "GET /v2.0/networks/48bd9423-5b85-4344-9434-17e10e227731?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2320528 Sep 18 08:42:32.683596 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c5c79568-b97e-47f0-803c-d4d1e0f11326 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:32.714071 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1cec89b3-eed5-467e-a64c-3d4e9cce6e73 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:32.800068 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48f3b3b2-cc33-41a7-8556-3e9c330ca1f0 req-1654a0e1-88ff-4ea9-830f-b2e97149fb2d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:32.802473 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-48f3b3b2-cc33-41a7-8556-3e9c330ca1f0 req-1654a0e1-88ff-4ea9-830f-b2e97149fb2d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.1073356 Sep 18 08:42:32.895258 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-48f3b3b2-cc33-41a7-8556-3e9c330ca1f0 req-a9759abd-a2bc-4850-80f9-a775b65c470a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0821965 Sep 18 08:42:32.963907 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1cec89b3-eed5-467e-a64c-3d4e9cce6e73 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:32.967398 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c13335a9-e894-4602-b8cb-153b6c46b5ff None None] New status for floating IP 4ba4ba6b-76bb-404f-89a3-659445347a63: ACTIVE {{(pid=94349) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 18 08:42:32.979463 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1cec89b3-eed5-467e-a64c-3d4e9cce6e73 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-561193'] for security_group_rule, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:33.005575 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c5c79568-b97e-47f0-803c-d4d1e0f11326 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:33.010783 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cec89b3-eed5-467e-a64c-3d4e9cce6e73 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=476a98f8-9c21-42bc-89bb-a99cbde512a9,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:33.025076 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c5c79568-b97e-47f0-803c-d4d1e0f11326 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:33.079606 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1cec89b3-eed5-467e-a64c-3d4e9cce6e73 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:33.088861 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-1cec89b3-eed5-467e-a64c-3d4e9cce6e73 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.5440764 Sep 18 08:42:33.089422 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 33802) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:33.094233 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-a7d6a044-6dc5-4f7f-9007-3f6467c3cf6d tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Request body: {'security_group_rule': {'security_group_id': 'a1773be7-b5fe-42cf-af53-72ae4a128df3', 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:42:33.097195 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-c5c79568-b97e-47f0-803c-d4d1e0f11326 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=98af93beb0f843998a3585712337b5bb&name=default HTTP/1.1" status: 200 len: 2979 time: 0.4560912 Sep 18 08:42:33.097878 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 33804) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:33.101899 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5c79568-b97e-47f0-803c-d4d1e0f11326 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a4d28da6-4979-4a46-93de-ef1d7f3b3314,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:33.135471 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.db.securitygroups_db [None req-a7d6a044-6dc5-4f7f-9007-3f6467c3cf6d tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Project 62a8d3b5ed4d4fe085db724f264e25c4 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Sep 18 08:42:33.157672 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a7d6a044-6dc5-4f7f-9007-3f6467c3cf6d tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:33.209379 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ca3ad800-b7ca-410a-b3eb-a909751c1602 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:33.238418 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ca3ad800-b7ca-410a-b3eb-a909751c1602 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:33.255371 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a7d6a044-6dc5-4f7f-9007-3f6467c3cf6d tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:33.290391 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a7d6a044-6dc5-4f7f-9007-3f6467c3cf6d tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-561193'] for security_group_rule, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:33.329596 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ca3ad800-b7ca-410a-b3eb-a909751c1602 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:33.335231 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ca3ad800-b7ca-410a-b3eb-a909751c1602 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:33.338786 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-ca3ad800-b7ca-410a-b3eb-a909751c1602 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/a4d28da6-4979-4a46-93de-ef1d7f3b3314 HTTP/1.1" status: 204 len: 168 time: 0.2364459 Sep 18 08:42:33.352119 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca3ad800-b7ca-410a-b3eb-a909751c1602 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a4d28da6-4979-4a46-93de-ef1d7f3b3314,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:33.352529 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7d6a044-6dc5-4f7f-9007-3f6467c3cf6d tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=63550288-55b0-493d-adb8-3e9528a2d85d,revision_number=0']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:33.373569 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a7d6a044-6dc5-4f7f-9007-3f6467c3cf6d tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:33.378934 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 33810) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:33.381958 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-a7d6a044-6dc5-4f7f-9007-3f6467c3cf6d tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.2856379 Sep 18 08:42:33.384565 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-7b467f6b-ce67-43ed-a2bf-d60726b3c883 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Request body: {'security_group_rule': {'security_group_id': 'a1773be7-b5fe-42cf-af53-72ae4a128df3', 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:42:33.419732 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a641b01-baf3-4c70-987c-e378fd40fefe req-9be4e63e-06ed-44a2-bdb3-4340528cb4b9 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:33.421611 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3a641b01-baf3-4c70-987c-e378fd40fefe req-9be4e63e-06ed-44a2-bdb3-4340528cb4b9 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=ed593970-f617-452d-95b7-c2fd7615fd0a HTTP/1.1" status: 200 len: 946 time: 0.1372685 Sep 18 08:42:33.435753 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.db.securitygroups_db [None req-7b467f6b-ce67-43ed-a2bf-d60726b3c883 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Project 62a8d3b5ed4d4fe085db724f264e25c4 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Sep 18 08:42:33.443086 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-7b467f6b-ce67-43ed-a2bf-d60726b3c883 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:33.489772 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3a641b01-baf3-4c70-987c-e378fd40fefe req-84de0697-5368-420d-95a1-3fc0dc66d5a1 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0603230 Sep 18 08:42:33.498144 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-7b467f6b-ce67-43ed-a2bf-d60726b3c883 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:33.504377 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-7b467f6b-ce67-43ed-a2bf-d60726b3c883 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-561193'] for security_group_rule, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:33.524255 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b467f6b-ce67-43ed-a2bf-d60726b3c883 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2d76ed27-68b7-49cb-9986-d4683bee461a,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:33.534962 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-7b467f6b-ce67-43ed-a2bf-d60726b3c883 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:33.537284 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-7b467f6b-ce67-43ed-a2bf-d60726b3c883 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1564379 Sep 18 08:42:33.628567 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-368b78c8-31d6-41f8-9a6f-71e5362e8b6e req-11f893dd-cd94-4813-907c-e1abbcc3073b tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1101793206&fields=id&tenant_id=62a8d3b5ed4d4fe085db724f264e25c4 HTTP/1.1" status: 200 len: 267 time: 0.0328002 Sep 18 08:42:33.707830 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-368b78c8-31d6-41f8-9a6f-71e5362e8b6e req-1abde068-c9fd-4651-92be-0e356ce71d51 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:33.709635 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-368b78c8-31d6-41f8-9a6f-71e5362e8b6e req-1abde068-c9fd-4651-92be-0e356ce71d51 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 946 time: 0.0704093 Sep 18 08:42:33.723375 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-368b78c8-31d6-41f8-9a6f-71e5362e8b6e req-ada41246-fe2d-46b3-a505-3e2fcb87d071 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Request body: {'port': {'security_groups': ['207d68f0-4931-4c69-8d7d-61006b3de552', 'a1773be7-b5fe-42cf-af53-72ae4a128df3']}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:42:33.815797 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-368b78c8-31d6-41f8-9a6f-71e5362e8b6e req-ada41246-fe2d-46b3-a505-3e2fcb87d071 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:34.099059 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1fc824e-0380-4535-b98f-045196d9de78 req-97a13b00-205b-4e56-8165-0e413c3c7aee tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:34.100667 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d1fc824e-0380-4535-b98f-045196d9de78 req-97a13b00-205b-4e56-8165-0e413c3c7aee tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0816798 Sep 18 08:42:34.106160 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-368b78c8-31d6-41f8-9a6f-71e5362e8b6e req-ada41246-fe2d-46b3-a505-3e2fcb87d071 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] For port a16828fd-b0f1-4ba0-a92a-61614fabe668, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=a16828fd-b0f1-4ba0-a92a-61614fabe668,segment=NetworkSegment(5d556fd8-f02d-4c49-9c67-863cea39ec4a),segment_id=5d556fd8-f02d-4c49-9c67-863cea39ec4a)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:42:34.166914 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-368b78c8-31d6-41f8-9a6f-71e5362e8b6e req-ada41246-fe2d-46b3-a505-3e2fcb87d071 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for port, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:34.172474 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d1fc824e-0380-4535-b98f-045196d9de78 req-adccfcd8-6cce-46db-8c30-c0259d9cde6a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0632954 Sep 18 08:42:34.174452 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-368b78c8-31d6-41f8-9a6f-71e5362e8b6e req-ada41246-fe2d-46b3-a505-3e2fcb87d071 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:34.220130 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['a16828fd-b0f1-4ba0-a92a-61614fabe668'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:42:34.489855 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-368b78c8-31d6-41f8-9a6f-71e5362e8b6e req-ada41246-fe2d-46b3-a505-3e2fcb87d071 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:34.490502 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-368b78c8-31d6-41f8-9a6f-71e5362e8b6e req-ada41246-fe2d-46b3-a505-3e2fcb87d071 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:34.491893 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-368b78c8-31d6-41f8-9a6f-71e5362e8b6e req-ada41246-fe2d-46b3-a505-3e2fcb87d071 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "PUT /v2.0/ports/a16828fd-b0f1-4ba0-a92a-61614fabe668 HTTP/1.1" status: 200 len: 982 time: 0.7745869 Sep 18 08:42:34.492351 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e85a7284-e6ea-47ab-9674-09d8666b742f', 'tag': 'a16828fd-b0f1-4ba0-a92a-61614fabe668'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:42:34.494625 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3dae3b08-0126-4137-ab85-f532229dd342" -d '{"events": [{"name": "network-changed", "server_uuid": "e85a7284-e6ea-47ab-9674-09d8666b742f", "tag": "a16828fd-b0f1-4ba0-a92a-61614fabe668"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:42:34.585964 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ada41246-fe2d-46b3-a505-3e2fcb87d071 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Pushing event updated for resources: {'Port': ['ID=a16828fd-b0f1-4ba0-a92a-61614fabe668,revision_number=6']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:34.598846 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:42:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f96475fc-fd15-458b-8ea8-445f20247e57 x-openstack-request-id: req-f96475fc-fd15-458b-8ea8-445f20247e57 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:42:34.604663 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e85a7284-e6ea-47ab-9674-09d8666b742f", "tag": "a16828fd-b0f1-4ba0-a92a-61614fabe668", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:42:34.605034 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-f96475fc-fd15-458b-8ea8-445f20247e57 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:42:34.605608 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e85a7284-e6ea-47ab-9674-09d8666b742f', 'tag': 'a16828fd-b0f1-4ba0-a92a-61614fabe668', 'status': 'completed', 'code': 200} Sep 18 08:42:34.717198 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['a16828fd-b0f1-4ba0-a92a-61614fabe668'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:42:34.821796 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 711ec98d-b2bf-4c0b-b015-9df1011dd8ce no longer exists at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:42:34.858212 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] No Port match for: 711ec98d-b2bf-4c0b-b015-9df1011dd8ce {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:42:34.858829 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 711ec98d-b2bf-4c0b-b015-9df1011dd8ce not bound to the agent host hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:42:34.886190 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f2eccc2-44e9-4ec8-b7a5-026e5ecff7b0 req-f084b373-28a0-40a0-8dff-8bc5fd93f2f8 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:34.887892 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8f2eccc2-44e9-4ec8-b7a5-026e5ecff7b0 req-f084b373-28a0-40a0-8dff-8bc5fd93f2f8 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 985 time: 0.2503147 Sep 18 08:42:34.913128 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dae3b08-0126-4137-ab85-f532229dd342 req-b999b02b-4737-4340-a879-7c3f38aa6e59 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:34.915388 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3dae3b08-0126-4137-ab85-f532229dd342 req-b999b02b-4737-4340-a879-7c3f38aa6e59 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=62a8d3b5ed4d4fe085db724f264e25c4&device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 1138 time: 0.2284548 Sep 18 08:42:34.936319 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79833210-c434-4892-963b-8ad9daeeb23b req-0dc8db09-850c-41a4-a1a7-4c55865a3ea3 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:34.943670 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-79833210-c434-4892-963b-8ad9daeeb23b req-0dc8db09-850c-41a4-a1a7-4c55865a3ea3 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=ed593970-f617-452d-95b7-c2fd7615fd0a HTTP/1.1" status: 200 len: 946 time: 0.2124765 Sep 18 08:42:34.958527 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-c5ccf139-1b55-4811-bf6f-3be48d09c2c9 None None] Provisioning complete for port a16828fd-b0f1-4ba0-a92a-61614fabe668 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:42:34.958717 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-c5ccf139-1b55-4811-bf6f-3be48d09c2c9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:35.033150 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8f2eccc2-44e9-4ec8-b7a5-026e5ecff7b0 req-3ee2abb7-2383-4d81-9898-9d17ff239cbc tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&id=a1773be7-b5fe-42cf-af53-72ae4a128df3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1344585 Sep 18 08:42:35.093064 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-79833210-c434-4892-963b-8ad9daeeb23b req-c9d20ba2-b8b3-435a-8354-9facd6afbedb tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1484301 Sep 18 08:42:35.154787 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dae3b08-0126-4137-ab85-f532229dd342 req-9ef6cb86-9ac6-4575-a928-04cd0ae24db4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:35.159314 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3dae3b08-0126-4137-ab85-f532229dd342 req-9ef6cb86-9ac6-4575-a928-04cd0ae24db4 service neutron] 10.222.0.13 "GET /v2.0/networks?id=48bd9423-5b85-4344-9434-17e10e227731 HTTP/1.1" status: 200 len: 916 time: 0.2111278 Sep 18 08:42:35.256507 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3dae3b08-0126-4137-ab85-f532229dd342 req-a525aca2-375a-4464-9cf9-0e1033d49b50 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a16828fd-b0f1-4ba0-a92a-61614fabe668 HTTP/1.1" status: 200 len: 1002 time: 0.0845523 Sep 18 08:42:35.355398 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dae3b08-0126-4137-ab85-f532229dd342 req-ac0d5b3b-23e2-4d99-b3ec-7c93682ecca8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:35.358129 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3dae3b08-0126-4137-ab85-f532229dd342 req-ac0d5b3b-23e2-4d99-b3ec-7c93682ecca8 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=95fb2797-9ac9-40f9-9ea9-56d2c5a16291 HTTP/1.1" status: 200 len: 854 time: 0.0903282 Sep 18 08:42:35.371202 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e28b73d4-00fa-489e-af1a-49f798c21d00 req-db9d1c61-067d-48af-a503-a5b2a2cf1c9b tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:35.372763 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e28b73d4-00fa-489e-af1a-49f798c21d00 req-db9d1c61-067d-48af-a503-a5b2a2cf1c9b tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0698652 Sep 18 08:42:35.432970 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e28b73d4-00fa-489e-af1a-49f798c21d00 req-d7ac6798-5c9b-4caa-ba68-8c0670630ba9 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0513473 Sep 18 08:42:35.440031 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dae3b08-0126-4137-ab85-f532229dd342 req-e73a3cf1-5cee-4956-bef0-962e83aed433 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:35.442508 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3dae3b08-0126-4137-ab85-f532229dd342 req-e73a3cf1-5cee-4956-bef0-962e83aed433 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=48bd9423-5b85-4344-9434-17e10e227731&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0686867 Sep 18 08:42:35.649397 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0865477-9ec9-41f0-b9f5-b47e0a88dd19 req-f01c230a-d4d7-4c49-b2cb-b7a9f6db16a2 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:35.650844 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a0865477-9ec9-41f0-b9f5-b47e0a88dd19 req-f01c230a-d4d7-4c49-b2cb-b7a9f6db16a2 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.13 "GET /v2.0/ports?device_id=ed593970-f617-452d-95b7-c2fd7615fd0a HTTP/1.1" status: 200 len: 946 time: 0.0973887 Sep 18 08:42:35.692885 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3dae3b08-0126-4137-ab85-f532229dd342 req-592c3e98-48a0-4d8b-9991-cb8069e67040 service neutron] 10.222.0.13 "GET /v2.0/networks/48bd9423-5b85-4344-9434-17e10e227731?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1467781 Sep 18 08:42:35.826570 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3dae3b08-0126-4137-ab85-f532229dd342 req-77984551-5ae9-4091-9296-c6b6bf55d999 service neutron] 10.222.0.13 "GET /v2.0/networks/48bd9423-5b85-4344-9434-17e10e227731?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1202908 Sep 18 08:42:35.829765 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-a0865477-9ec9-41f0-b9f5-b47e0a88dd19 req-17aede69-c0f7-4457-aad6-7b19f5e98c71 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Deleting port 1f9a3d54-fb75-4f0c-8013-46a939823a2e {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:42:35.830108 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a0865477-9ec9-41f0-b9f5-b47e0a88dd19 req-17aede69-c0f7-4457-aad6-7b19f5e98c71 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:35.924171 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-a0865477-9ec9-41f0-b9f5-b47e0a88dd19 req-17aede69-c0f7-4457-aad6-7b19f5e98c71 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] For port 1f9a3d54-fb75-4f0c-8013-46a939823a2e, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=1f9a3d54-fb75-4f0c-8013-46a939823a2e,segment=NetworkSegment(d1432479-9c27-42c4-87db-6905e7868675),segment_id=d1432479-9c27-42c4-87db-6905e7868675)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:42:35.924508 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a0865477-9ec9-41f0-b9f5-b47e0a88dd19 req-17aede69-c0f7-4457-aad6-7b19f5e98c71 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:35.937475 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-a0865477-9ec9-41f0-b9f5-b47e0a88dd19 req-17aede69-c0f7-4457-aad6-7b19f5e98c71 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Calling delete_port for 1f9a3d54-fb75-4f0c-8013-46a939823a2e owned by compute:nova {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:42:36.064417 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a0865477-9ec9-41f0-b9f5-b47e0a88dd19 req-17aede69-c0f7-4457-aad6-7b19f5e98c71 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:36.097329 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17aede69-c0f7-4457-aad6-7b19f5e98c71 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Pushing event deleted for resources: {'Port': ['ID=1f9a3d54-fb75-4f0c-8013-46a939823a2e,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:36.110377 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['9a4f8ce9-f706-4c25-b3f4-05f2173cf516', '1f9a3d54-fb75-4f0c-8013-46a939823a2e'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:42:36.140502 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-a0865477-9ec9-41f0-b9f5-b47e0a88dd19 req-17aede69-c0f7-4457-aad6-7b19f5e98c71 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] No DVR routers for this DVR port 1f9a3d54-fb75-4f0c-8013-46a939823a2e on host hv-cinder-80447 {{(pid=94347) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:42:36.144083 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a0865477-9ec9-41f0-b9f5-b47e0a88dd19 req-17aede69-c0f7-4457-aad6-7b19f5e98c71 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:36.146390 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a0865477-9ec9-41f0-b9f5-b47e0a88dd19 req-17aede69-c0f7-4457-aad6-7b19f5e98c71 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.13 "DELETE /v2.0/ports/1f9a3d54-fb75-4f0c-8013-46a939823a2e HTTP/1.1" status: 204 len: 173 time: 0.4856055 Sep 18 08:42:36.203563 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c0c7650d-3c0b-4090-9a1d-14d5eb29ac8e req-bbb37800-d981-4e2f-a2b7-2d3baaa8cd90 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=ed593970-f617-452d-95b7-c2fd7615fd0a HTTP/1.1" status: 200 len: 210 time: 0.0384865 Sep 18 08:42:36.556630 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a11f00ea-7efa-4e81-87b9-4d38b11c5149 req-3968671e-ec00-48cd-9ad5-ff861468f1fc tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:36.558342 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a11f00ea-7efa-4e81-87b9-4d38b11c5149 req-3968671e-ec00-48cd-9ad5-ff861468f1fc tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0546327 Sep 18 08:42:36.601565 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a11f00ea-7efa-4e81-87b9-4d38b11c5149 req-33a5c0c0-078a-4bd5-80b8-8be96a7fa940 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0370510 Sep 18 08:42:36.607086 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ed593970-f617-452d-95b7-c2fd7615fd0a', 'name': 'network-vif-deleted', 'tag': '1f9a3d54-fb75-4f0c-8013-46a939823a2e'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:42:36.609426 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6eff8802-e34c-403a-8371-db39d986f7d5" -d '{"events": [{"server_uuid": "ed593970-f617-452d-95b7-c2fd7615fd0a", "name": "network-vif-deleted", "tag": "1f9a3d54-fb75-4f0c-8013-46a939823a2e"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:42:36.645947 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:42:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5a6ea3e2-1161-411f-9bd4-c4a3a626e69f x-openstack-request-id: req-5a6ea3e2-1161-411f-9bd4-c4a3a626e69f {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:42:36.646243 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ed593970-f617-452d-95b7-c2fd7615fd0a", "name": "network-vif-deleted", "tag": "1f9a3d54-fb75-4f0c-8013-46a939823a2e", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:42:36.646495 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-5a6ea3e2-1161-411f-9bd4-c4a3a626e69f {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:42:36.646893 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ed593970-f617-452d-95b7-c2fd7615fd0a', 'name': 'network-vif-deleted', 'tag': '1f9a3d54-fb75-4f0c-8013-46a939823a2e', 'status': 'completed', 'code': 200} Sep 18 08:42:37.765297 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9d7c562-b29b-4d3c-87fa-362714919d32 req-2eb1d57a-29e3-4e91-9638-3ed4a81fd85d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:37.769753 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e9d7c562-b29b-4d3c-87fa-362714919d32 req-2eb1d57a-29e3-4e91-9638-3ed4a81fd85d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0623698 Sep 18 08:42:37.813129 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e9d7c562-b29b-4d3c-87fa-362714919d32 req-5834216f-0ec0-4de1-9a5d-f3eebbdd297f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0375767 Sep 18 08:42:38.262387 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-11d720d4-85c8-4ada-827a-32b712b86aec tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-143517560&fields=id&tenant_id=0c7c58787ad549afa94b716f4c2f187b HTTP/1.1" status: 200 len: 267 time: 0.0330443 Sep 18 08:42:38.383909 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-34b66d23-c43c-45be-8f09-65337b7bb427 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:38.385588 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-34b66d23-c43c-45be-8f09-65337b7bb427 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/networks?id=000f3583-b7de-458d-9146-0010cd28b00d HTTP/1.1" status: 200 len: 812 time: 0.1161284 Sep 18 08:42:38.402738 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-4a3685b4-7be5-43ed-b74e-9a812382b71c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/quotas/0c7c58787ad549afa94b716f4c2f187b HTTP/1.1" status: 200 len: 375 time: 0.0111413 Sep 18 08:42:38.465756 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-f713a6cd-1699-41ef-9d44-3fb762c71145 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?tenant_id=0c7c58787ad549afa94b716f4c2f187b&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0556295 Sep 18 08:42:38.627006 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-cd8d4742-1b6e-4c60-b830-dbb90088b0a3 service neutron] 10.222.0.35 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1462057 Sep 18 08:42:38.747716 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfbf27f1-1f5d-4ef8-82ee-b98d05edfe36 req-5e533b89-f056-4508-aaa2-2d85f4a35370 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:38.749567 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cfbf27f1-1f5d-4ef8-82ee-b98d05edfe36 req-5e533b89-f056-4508-aaa2-2d85f4a35370 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 946 time: 0.0956645 Sep 18 08:42:38.778201 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-4c9b8bf2-8b9f-4b7c-9e1d-6c931d4215cf service neutron] 10.222.0.35 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1430013 Sep 18 08:42:38.802552 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cfbf27f1-1f5d-4ef8-82ee-b98d05edfe36 req-4e24177f-49d4-4328-8389-8a844aaaf706 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465016 Sep 18 08:42:38.979047 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c2030fa-9266-4b0f-9d18-aa6ed9442afa req-4fa7b1bc-21b7-4b28-b62d-8cba42882a4e tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:38.980858 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7c2030fa-9266-4b0f-9d18-aa6ed9442afa req-4fa7b1bc-21b7-4b28-b62d-8cba42882a4e tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0657053 Sep 18 08:42:39.034768 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7c2030fa-9266-4b0f-9d18-aa6ed9442afa req-abe22662-9f57-44cd-9f95-5410f884b6e2 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0478325 Sep 18 08:42:39.159305 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1e2eb402-37fe-4c19-a777-06c56afec227 req-1e038d49-f272-4b3e-aa26-03ec284a46fe tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 210 time: 0.0259185 Sep 18 08:42:39.712380 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 1f9a3d54-fb75-4f0c-8013-46a939823a2e no longer exists at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:42:39.736471 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] No Port match for: 1f9a3d54-fb75-4f0c-8013-46a939823a2e {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:42:39.736842 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 1f9a3d54-fb75-4f0c-8013-46a939823a2e not bound to the agent host hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:42:39.922869 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8521e1fe-e18c-40ce-b1d0-83257755dcc5 req-89f4f4f7-ee40-48fb-9343-e56b5c4e028b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:39.925233 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8521e1fe-e18c-40ce-b1d0-83257755dcc5 req-89f4f4f7-ee40-48fb-9343-e56b5c4e028b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 946 time: 0.0534053 Sep 18 08:42:39.965762 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8521e1fe-e18c-40ce-b1d0-83257755dcc5 req-b55a72e4-f2f1-4774-8837-9ea132569222 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0342200 Sep 18 08:42:40.162909 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5198b87e-db20-4ef6-a020-eada03897c1d req-1cbf52c7-2d0f-445f-a23c-d399e83c34d8 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:40.164287 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5198b87e-db20-4ef6-a020-eada03897c1d req-1cbf52c7-2d0f-445f-a23c-d399e83c34d8 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0504026 Sep 18 08:42:40.208913 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5198b87e-db20-4ef6-a020-eada03897c1d req-7338f269-5d02-45c8-aae6-33e8b7253feb tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0385683 Sep 18 08:42:40.274464 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1e93f047-8471-476f-9260-6d01f6dfd192 req-16a1b4b3-899b-43d0-87d4-03e6f8477736 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 210 time: 0.0289643 Sep 18 08:42:41.089357 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0c52f09-55db-4306-97d4-b5cb3759a7de req-e2a6118f-ca6b-4500-acf8-2ce261299fac tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:41.093673 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e0c52f09-55db-4306-97d4-b5cb3759a7de req-e2a6118f-ca6b-4500-acf8-2ce261299fac tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 946 time: 0.0556698 Sep 18 08:42:41.130808 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e0c52f09-55db-4306-97d4-b5cb3759a7de req-1b5ba0f2-62d3-4e72-a6e6-af2898f2928b tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0331206 Sep 18 08:42:41.350416 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dfa301e-3171-4671-902d-83a1488dc5e5 req-e4a70acb-6b86-4d13-b8b6-233d750b9700 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:41.352605 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1dfa301e-3171-4671-902d-83a1488dc5e5 req-e4a70acb-6b86-4d13-b8b6-233d750b9700 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0681250 Sep 18 08:42:41.395073 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-513da24b-521b-4894-a9e7-2edeafa73f08 req-0ae062a1-50c4-4e5b-b528-d99d18fe4108 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 210 time: 0.0414588 Sep 18 08:42:41.420792 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1dfa301e-3171-4671-902d-83a1488dc5e5 req-19b8e4aa-bf15-43dc-a1e8-a2c3080332ac tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0557375 Sep 18 08:42:42.264990 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21526342-c873-48e9-abbd-fca652400c4b req-d57db108-7d2d-45c2-a009-185eb4f2d1e3 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:42.266592 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-21526342-c873-48e9-abbd-fca652400c4b req-d57db108-7d2d-45c2-a009-185eb4f2d1e3 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 946 time: 0.0564661 Sep 18 08:42:42.321947 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-21526342-c873-48e9-abbd-fca652400c4b req-1c0c9f13-d2fe-4473-bcae-52e760f9a39d tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0489309 Sep 18 08:42:42.538469 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2d9231a4-5664-4b18-9a75-09e2044bebb6 req-7b38e2cb-da93-48ae-9783-0c4e3e44a50a tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 210 time: 0.0629871 Sep 18 08:42:42.593885 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc575b77-e27e-4151-87e1-446d65521e23 req-6d721055-16d6-43aa-a203-68d8e3bf5ef4 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:42.595708 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cc575b77-e27e-4151-87e1-446d65521e23 req-6d721055-16d6-43aa-a203-68d8e3bf5ef4 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0518017 Sep 18 08:42:42.636472 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cc575b77-e27e-4151-87e1-446d65521e23 req-ee7c5675-b987-4bb3-801a-3084a455f00e tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0344005 Sep 18 08:42:43.004701 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-d4c6d629-4c1f-4486-9951-7e695552c02c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:43.010141 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-d4c6d629-4c1f-4486-9951-7e695552c02c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.13 "GET /v2.0/networks?id=000f3583-b7de-458d-9146-0010cd28b00d HTTP/1.1" status: 200 len: 812 time: 0.1526115 Sep 18 08:42:43.078474 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-013a247e-c9cc-4da3-99b2-69c74d558ebf tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.13 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=0c7c58787ad549afa94b716f4c2f187b HTTP/1.1" status: 200 len: 379 time: 0.0376878 Sep 18 08:42:43.092141 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-052c0e44-d971-4657-a1d8-a197bdc2536d tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Request body: {'port': {'device_id': '5c332939-c954-4f64-97d5-07d5b2cb727d', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'admin_state_up': True, 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'security_groups': ['c480fa62-0ee8-4f20-8da2-07bbb721cd7c']}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:42:43.218162 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-052c0e44-d971-4657-a1d8-a197bdc2536d tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Made reservation on behalf of 0c7c58787ad549afa94b716f4c2f187b for: {'port': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:42:43.222293 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-052c0e44-d971-4657-a1d8-a197bdc2536d tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:43.357244 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_common [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-052c0e44-d971-4657-a1d8-a197bdc2536d tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Allocated IP 172.20.0.5 (000f3583-b7de-458d-9146-0010cd28b00d/a4c047cf-cba6-4b94-8339-59469f96c92a/3f56fe96-8f0e-4410-8e3c-da651c794d50) {{(pid=94347) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:42:43.499404 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0a61b63-300d-44ce-bcb9-878f67ff9069 req-db34805e-1cee-4f96-8ca4-301f8e43ab55 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:43.500866 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a0a61b63-300d-44ce-bcb9-878f67ff9069 req-db34805e-1cee-4f96-8ca4-301f8e43ab55 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 946 time: 0.1080060 Sep 18 08:42:43.549281 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-052c0e44-d971-4657-a1d8-a197bdc2536d tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for port, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:43.558949 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a0a61b63-300d-44ce-bcb9-878f67ff9069 req-549c86e0-1658-4600-aae6-2829596355c1 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0500083 Sep 18 08:42:43.590077 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-052c0e44-d971-4657-a1d8-a197bdc2536d tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:43.644317 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-052c0e44-d971-4657-a1d8-a197bdc2536d tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Network 000f3583-b7de-458d-9146-0010cd28b00d is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:42:43.664564 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-052c0e44-d971-4657-a1d8-a197bdc2536d tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:42:43.669663 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-052c0e44-d971-4657-a1d8-a197bdc2536d tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Received port after_create {{(pid=94347) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:42:43.675859 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-052c0e44-d971-4657-a1d8-a197bdc2536d tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Pushing event updated for resources: {'Port': ['ID=3f56fe96-8f0e-4410-8e3c-da651c794d50,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:43.726749 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b893db94-aeaf-4d5d-a029-f7db2865a896 req-0e1a744c-73c8-4cb4-a30c-f6d519b44578 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:43.728327 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b893db94-aeaf-4d5d-a029-f7db2865a896 req-0e1a744c-73c8-4cb4-a30c-f6d519b44578 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 931 time: 0.1082571 Sep 18 08:42:43.745856 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-052c0e44-d971-4657-a1d8-a197bdc2536d tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:43.746477 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-052c0e44-d971-4657-a1d8-a197bdc2536d tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:43.801076 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-052c0e44-d971-4657-a1d8-a197bdc2536d tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7136185 Sep 18 08:42:43.817141 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b893db94-aeaf-4d5d-a029-f7db2865a896 req-c184cfce-c338-4d8b-98c6-f14dce22ce10 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0663631 Sep 18 08:42:43.830486 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70fbd0bc-3e2b-4e9f-b33f-8cbc71c89db5 req-d5ae092f-5d63-425b-97c6-401e15dc0c1a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:43.832054 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-70fbd0bc-3e2b-4e9f-b33f-8cbc71c89db5 req-d5ae092f-5d63-425b-97c6-401e15dc0c1a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.1008084 Sep 18 08:42:43.855656 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-9e6674c2-2f28-4e0c-a9eb-e912cdb1094a None None] Provisioning complete for port 3f56fe96-8f0e-4410-8e3c-da651c794d50 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:42:43.856250 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-9e6674c2-2f28-4e0c-a9eb-e912cdb1094a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:43.873721 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-70fbd0bc-3e2b-4e9f-b33f-8cbc71c89db5 req-8d1a9544-ad4a-47f5-808e-83734f000905 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0353191 Sep 18 08:42:43.892169 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-9e6674c2-2f28-4e0c-a9eb-e912cdb1094a None None] Port 3f56fe96-8f0e-4410-8e3c-da651c794d50 cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:42:44.671355 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-898ae09a-1924-4bbe-8c0c-86a04e9c838c req-a5fbee6f-5e14-4491-bd22-87d9798f8bac tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:44.672864 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-898ae09a-1924-4bbe-8c0c-86a04e9c838c req-a5fbee6f-5e14-4491-bd22-87d9798f8bac tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 946 time: 0.0477641 Sep 18 08:42:44.710439 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-898ae09a-1924-4bbe-8c0c-86a04e9c838c req-cb4c4abc-9a2c-480a-bc75-627c4cc79883 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0316358 Sep 18 08:42:44.934493 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17d9800e-cdf7-40cb-8502-4e36d2810f37 req-4553e556-d77f-4e0b-a1ec-5bad6516b597 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:44.936083 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-17d9800e-cdf7-40cb-8502-4e36d2810f37 req-4553e556-d77f-4e0b-a1ec-5bad6516b597 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 931 time: 0.0534921 Sep 18 08:42:45.005358 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-17d9800e-cdf7-40cb-8502-4e36d2810f37 req-0c8e5f04-bb5c-4efe-bb1e-81068942c429 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0634153 Sep 18 08:42:45.016662 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4228a3bf-b05d-421e-9eb9-6c51739767e5 req-f32da58c-f631-41cb-9010-63146ba4c233 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:45.018180 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4228a3bf-b05d-421e-9eb9-6c51739767e5 req-f32da58c-f631-41cb-9010-63146ba4c233 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0706546 Sep 18 08:42:45.055853 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4228a3bf-b05d-421e-9eb9-6c51739767e5 req-9282cf01-7ec4-4a45-9ee1-8a8ebdc169ca tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0320380 Sep 18 08:42:45.820705 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b92426-f06b-4f5b-ae97-4a44e913c691 req-20c98c46-950d-4fe8-80cf-889ca28fae4a tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:45.822173 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-31b92426-f06b-4f5b-ae97-4a44e913c691 req-20c98c46-950d-4fe8-80cf-889ca28fae4a tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 946 time: 0.0462215 Sep 18 08:42:45.858562 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-31b92426-f06b-4f5b-ae97-4a44e913c691 req-7c463464-acba-45c3-b8a3-1ada5d6e0f54 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0300615 Sep 18 08:42:46.115599 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-157b8209-9cd0-4e96-915c-279e49f9c02b req-968ecfe4-1927-44fe-836a-bdd82d2eb1be tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:46.117083 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-157b8209-9cd0-4e96-915c-279e49f9c02b req-968ecfe4-1927-44fe-836a-bdd82d2eb1be tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 931 time: 0.0481055 Sep 18 08:42:46.182849 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-157b8209-9cd0-4e96-915c-279e49f9c02b req-7e302864-d639-4fa5-8706-dc655bfe4ac6 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0593519 Sep 18 08:42:46.197506 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d42668b-5a41-457d-ae8f-bc68092f12e7 req-ff3dfcf7-44ee-4663-8103-60ffbfcc5e3e tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:46.198975 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2d42668b-5a41-457d-ae8f-bc68092f12e7 req-ff3dfcf7-44ee-4663-8103-60ffbfcc5e3e tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0698605 Sep 18 08:42:46.236900 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2d42668b-5a41-457d-ae8f-bc68092f12e7 req-3b6f19f3-e433-4a98-8ff0-45d9a1746f9d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0322168 Sep 18 08:42:46.775840 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-5a023920-b663-471c-96c4-b935485c8c9b service neutron] Request body: {'port': {'device_id': '5c332939-c954-4f64-97d5-07d5b2cb727d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80447'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:42:46.827745 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-5a023920-b663-471c-96c4-b935485c8c9b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:47.003476 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28450fb2-41ff-4c6a-ad2d-5a643902a4c3 req-c0ae40ba-1e64-4ca1-bd47-16e855c93fb1 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:47.004976 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-28450fb2-41ff-4c6a-ad2d-5a643902a4c3 req-c0ae40ba-1e64-4ca1-bd47-16e855c93fb1 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 946 time: 0.0796502 Sep 18 08:42:47.088015 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-28450fb2-41ff-4c6a-ad2d-5a643902a4c3 req-85ac98df-7aee-4b59-98d0-8cc84f51a072 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0511739 Sep 18 08:42:47.144748 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-5a023920-b663-471c-96c4-b935485c8c9b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3f56fe96-8f0e-4410-8e3c-da651c794d50 {{(pid=94347) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:42:47.152034 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-5a023920-b663-471c-96c4-b935485c8c9b service neutron] Notify callbacks [] for port, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:47.163224 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.provisioning_blocks [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-5a023920-b663-471c-96c4-b935485c8c9b service neutron] Transition to ACTIVE for port object 3f56fe96-8f0e-4410-8e3c-da651c794d50 will not be triggered until provisioned by entity L2. {{(pid=94347) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 18 08:42:47.167126 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-5a023920-b663-471c-96c4-b935485c8c9b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:47.219785 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a023920-b663-471c-96c4-b935485c8c9b service neutron] Pushing event updated for resources: {'Port': ['ID=3f56fe96-8f0e-4410-8e3c-da651c794d50,revision_number=2']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:47.328190 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-5a023920-b663-471c-96c4-b935485c8c9b service neutron] Attempting to bind port 3f56fe96-8f0e-4410-8e3c-da651c794d50 on host hv-cinder-80447 for vnic_type normal with profile {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:42:47.328525 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-5a023920-b663-471c-96c4-b935485c8c9b service neutron] Attempting to bind port 3f56fe96-8f0e-4410-8e3c-da651c794d50 by drivers openvswitch,hyperv on host hv-cinder-80447 at level 0 using segments [{'id': 'c215153d-2878-4c82-8dc0-2a92b453bf12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 200, 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d'}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:42:47.328855 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-5a023920-b663-471c-96c4-b935485c8c9b service neutron] Attempting to bind port 3f56fe96-8f0e-4410-8e3c-da651c794d50 on network 000f3583-b7de-458d-9146-0010cd28b00d {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:42:47.337654 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f60eabd1-2148-45b2-8cb6-d73cb49a4840 req-27525564-9a5b-42d6-8c70-df4c715ebf36 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:47.339233 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f60eabd1-2148-45b2-8cb6-d73cb49a4840 req-27525564-9a5b-42d6-8c70-df4c715ebf36 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 943 time: 0.0811176 Sep 18 08:42:47.362761 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-5a023920-b663-471c-96c4-b935485c8c9b service neutron] Port 3f56fe96-8f0e-4410-8e3c-da651c794d50 on network 000f3583-b7de-458d-9146-0010cd28b00d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80447 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 18 08:42:47.363088 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-5a023920-b663-471c-96c4-b935485c8c9b service neutron] Attempting to bind port 3f56fe96-8f0e-4410-8e3c-da651c794d50 on network 000f3583-b7de-458d-9146-0010cd28b00d {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:42:47.385876 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-5a023920-b663-471c-96c4-b935485c8c9b service neutron] Checking agent: {'id': '8d51fdc4-974b-4200-9c3f-5dddea60a869', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80447', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'started_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 42, 20), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:42:47.386218 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-5a023920-b663-471c-96c4-b935485c8c9b service neutron] Checking segment: {'id': 'c215153d-2878-4c82-8dc0-2a92b453bf12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 200, 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94347) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:42:47.386603 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-5a023920-b663-471c-96c4-b935485c8c9b service neutron] Bound using segment: {'id': 'c215153d-2878-4c82-8dc0-2a92b453bf12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 200, 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d'} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:42:47.387036 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-5a023920-b663-471c-96c4-b935485c8c9b service neutron] Bound port: 3f56fe96-8f0e-4410-8e3c-da651c794d50, host: hv-cinder-80447, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c215153d-2878-4c82-8dc0-2a92b453bf12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 200, 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d'}}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:42:47.387396 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-5a023920-b663-471c-96c4-b935485c8c9b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:47.445833 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8043e61-6a9c-42fc-a093-756ad63629eb req-9ee895d7-0175-42ac-936f-c90b034b90b3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:47.447334 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f8043e61-6a9c-42fc-a093-756ad63629eb req-9ee895d7-0175-42ac-936f-c90b034b90b3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.1324687 Sep 18 08:42:47.452579 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f60eabd1-2148-45b2-8cb6-d73cb49a4840 req-28764807-7080-4f7b-be87-28474abc7236 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0910778 Sep 18 08:42:47.505803 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f8043e61-6a9c-42fc-a093-756ad63629eb req-a2364faf-9c79-498c-a973-d77580fb64e6 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0507276 Sep 18 08:42:47.508119 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-5a023920-b663-471c-96c4-b935485c8c9b service neutron] For port 3f56fe96-8f0e-4410-8e3c-da651c794d50, host hv-cinder-80447, cleared binding levels {{(pid=94347) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:42:47.511252 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-5a023920-b663-471c-96c4-b935485c8c9b service neutron] For port 3f56fe96-8f0e-4410-8e3c-da651c794d50, host hv-cinder-80447, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=3f56fe96-8f0e-4410-8e3c-da651c794d50,segment=NetworkSegment(c215153d-2878-4c82-8dc0-2a92b453bf12),segment_id=c215153d-2878-4c82-8dc0-2a92b453bf12)] {{(pid=94347) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:42:47.515546 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-5a023920-b663-471c-96c4-b935485c8c9b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:47.550650 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-5a023920-b663-471c-96c4-b935485c8c9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:47.551270 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-5a023920-b663-471c-96c4-b935485c8c9b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:47.552699 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-5a023920-b663-471c-96c4-b935485c8c9b service neutron] 10.222.0.13 "PUT /v2.0/ports/3f56fe96-8f0e-4410-8e3c-da651c794d50 HTTP/1.1" status: 200 len: 1093 time: 0.7811406 Sep 18 08:42:47.553131 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5c332939-c954-4f64-97d5-07d5b2cb727d', 'tag': '3f56fe96-8f0e-4410-8e3c-da651c794d50'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:42:47.555436 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d271d316-219f-4156-b2ff-25b3a5cecae1" -d '{"events": [{"name": "network-changed", "server_uuid": "5c332939-c954-4f64-97d5-07d5b2cb727d", "tag": "3f56fe96-8f0e-4410-8e3c-da651c794d50"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:42:47.581332 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a023920-b663-471c-96c4-b935485c8c9b service neutron] Pushing event updated for resources: {'Port': ['ID=3f56fe96-8f0e-4410-8e3c-da651c794d50,revision_number=3']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:47.593828 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:42:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-03d651a1-b0ea-432c-9d01-bb0036149bec x-openstack-request-id: req-03d651a1-b0ea-432c-9d01-bb0036149bec {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:42:47.594169 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5c332939-c954-4f64-97d5-07d5b2cb727d", "tag": "3f56fe96-8f0e-4410-8e3c-da651c794d50", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:42:47.594428 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-03d651a1-b0ea-432c-9d01-bb0036149bec {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:42:47.595084 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5c332939-c954-4f64-97d5-07d5b2cb727d', 'tag': '3f56fe96-8f0e-4410-8e3c-da651c794d50', 'status': 'completed', 'code': 200} Sep 18 08:42:47.678233 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-831c0969-f70c-4609-9f45-55cd89c58b18 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:47.680776 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-831c0969-f70c-4609-9f45-55cd89c58b18 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0c7c58787ad549afa94b716f4c2f187b&device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 1096 time: 0.0440037 Sep 18 08:42:47.730465 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-6927d0c6-95a9-4084-a955-b332ab44fb92 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=3f56fe96-8f0e-4410-8e3c-da651c794d50 HTTP/1.1" status: 200 len: 217 time: 0.0345545 Sep 18 08:42:47.783186 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-3caefc3f-5e45-4193-a59c-e0f6d6aef6ef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:47.784641 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-3caefc3f-5e45-4193-a59c-e0f6d6aef6ef service neutron] 10.222.0.13 "GET /v2.0/subnets?id=a4c047cf-cba6-4b94-8339-59469f96c92a HTTP/1.1" status: 200 len: 851 time: 0.0441475 Sep 18 08:42:47.832224 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-72f3b6f8-51c6-46b1-8705-7fce69fab3f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:47.833621 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-72f3b6f8-51c6-46b1-8705-7fce69fab3f8 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=000f3583-b7de-458d-9146-0010cd28b00d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0416374 Sep 18 08:42:47.929047 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-403466e1-93cb-4d3d-9804-bba8c09ce303 service neutron] 10.222.0.13 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0866220 Sep 18 08:42:48.030355 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d92778f4-36bb-472e-a58c-4f4ceea9037a req-ec25fd8e-67cf-428c-b4de-bb1eca29f06b service neutron] 10.222.0.13 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0916228 Sep 18 08:42:48.151478 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d271d316-219f-4156-b2ff-25b3a5cecae1 req-cc24c187-67a3-47af-b8f7-7bac13405258 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:48.153900 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d271d316-219f-4156-b2ff-25b3a5cecae1 req-cc24c187-67a3-47af-b8f7-7bac13405258 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0c7c58787ad549afa94b716f4c2f187b&device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 1096 time: 0.0416992 Sep 18 08:42:48.259956 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c63c8c00-f41d-4768-a179-a6193d7a8076 req-27ee48a7-56e0-4855-b547-039a37932f85 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:48.262433 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c63c8c00-f41d-4768-a179-a6193d7a8076 req-27ee48a7-56e0-4855-b547-039a37932f85 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 946 time: 0.1065354 Sep 18 08:42:48.305433 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d271d316-219f-4156-b2ff-25b3a5cecae1 req-4230017e-444f-4118-be1e-e363e4409fd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:48.306852 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d271d316-219f-4156-b2ff-25b3a5cecae1 req-4230017e-444f-4118-be1e-e363e4409fd8 service neutron] 10.222.0.13 "GET /v2.0/networks?id=000f3583-b7de-458d-9146-0010cd28b00d HTTP/1.1" status: 200 len: 913 time: 0.1417353 Sep 18 08:42:48.314338 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c63c8c00-f41d-4768-a179-a6193d7a8076 req-944aa8f8-43a2-4caf-8b8d-f4631b3bcc3c tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451691 Sep 18 08:42:48.469261 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d271d316-219f-4156-b2ff-25b3a5cecae1 req-b8fef4a2-75d4-45eb-8363-d1f03c89947e service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=3f56fe96-8f0e-4410-8e3c-da651c794d50 HTTP/1.1" status: 200 len: 217 time: 0.0367501 Sep 18 08:42:48.566158 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d271d316-219f-4156-b2ff-25b3a5cecae1 req-fc00227e-b61d-4608-baeb-edfdc57f31c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:48.567647 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d271d316-219f-4156-b2ff-25b3a5cecae1 req-fc00227e-b61d-4608-baeb-edfdc57f31c9 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=a4c047cf-cba6-4b94-8339-59469f96c92a HTTP/1.1" status: 200 len: 851 time: 0.0827770 Sep 18 08:42:48.613682 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-248b211d-7800-438d-b1d0-1b702c0ea751 req-b8f2b30e-eaff-4845-98a2-0db5a9d30942 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:48.615159 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-248b211d-7800-438d-b1d0-1b702c0ea751 req-b8f2b30e-eaff-4845-98a2-0db5a9d30942 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 943 time: 0.0907016 Sep 18 08:42:48.684365 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d271d316-219f-4156-b2ff-25b3a5cecae1 req-b2182d3f-7490-45a9-9394-87f6e9ef0b7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:48.685902 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d271d316-219f-4156-b2ff-25b3a5cecae1 req-b2182d3f-7490-45a9-9394-87f6e9ef0b7b service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=000f3583-b7de-458d-9146-0010cd28b00d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1073403 Sep 18 08:42:48.693883 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-248b211d-7800-438d-b1d0-1b702c0ea751 req-a82d24dc-9fe1-4884-a5bc-7b28965bf682 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0700724 Sep 18 08:42:48.702178 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99da391f-ee31-44f6-9e05-b00f56f8b238 req-b4bc70b9-9dc8-482e-bee1-f5adb57fbda8 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:48.703645 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-99da391f-ee31-44f6-9e05-b00f56f8b238 req-b4bc70b9-9dc8-482e-bee1-f5adb57fbda8 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.1127102 Sep 18 08:42:49.031399 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-99da391f-ee31-44f6-9e05-b00f56f8b238 req-26a1ce15-4547-4bcd-b9a4-6ead573615b3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.3214059 Sep 18 08:42:49.073296 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e47a018-0f3c-46eb-b44a-52a5dd8c6521 req-b5744bce-c590-41ee-aba7-ac61793ffccd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:49.074776 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8e47a018-0f3c-46eb-b44a-52a5dd8c6521 req-b5744bce-c590-41ee-aba7-ac61793ffccd service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0700a96e9b3f48e8b6bcdd75b820b813&device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 1099 time: 0.1128845 Sep 18 08:42:49.096710 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d271d316-219f-4156-b2ff-25b3a5cecae1 req-bb5ebec0-8c09-4a57-8fff-14a6aa8f6573 service neutron] 10.222.0.13 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1359560 Sep 18 08:42:49.322921 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20eb7155-9bf1-40d6-819d-f2a07b1f7557 req-3acf0a2e-8691-41d6-8542-f851b537055a tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:49.324354 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-20eb7155-9bf1-40d6-819d-f2a07b1f7557 req-3acf0a2e-8691-41d6-8542-f851b537055a tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.13 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 946 time: 0.1592426 Sep 18 08:42:49.383609 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e47a018-0f3c-46eb-b44a-52a5dd8c6521 req-9898bbd5-11ba-4e8f-b6d7-2535437e464f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:49.385046 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8e47a018-0f3c-46eb-b44a-52a5dd8c6521 req-9898bbd5-11ba-4e8f-b6d7-2535437e464f service neutron] 10.222.0.13 "GET /v2.0/networks?id=f430397d-03a8-4da2-bd1d-25890a3a0727 HTTP/1.1" status: 200 len: 917 time: 0.2208714 Sep 18 08:42:49.390007 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d271d316-219f-4156-b2ff-25b3a5cecae1 req-a7f68c0e-991d-4da7-84d2-ef71f54e84bb service neutron] 10.222.0.13 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2333369 Sep 18 08:42:49.509229 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea918013-01c5-4712-9fb2-18bf0f86f3ff req-7796d33e-4fa1-4216-b1b2-fde78fb1a4e2 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:49.510703 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ea918013-01c5-4712-9fb2-18bf0f86f3ff req-7796d33e-4fa1-4216-b1b2-fde78fb1a4e2 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 946 time: 0.1285388 Sep 18 08:42:49.535762 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8e47a018-0f3c-46eb-b44a-52a5dd8c6521 req-6be8faac-df68-4aa1-b063-8610d6b056de service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 HTTP/1.1" status: 200 len: 1002 time: 0.1162426 Sep 18 08:42:49.553644 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-20eb7155-9bf1-40d6-819d-f2a07b1f7557 req-20ba8af5-9da7-424b-97ab-e47fdd5abfa0 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Deleting port 9a4f8ce9-f706-4c25-b3f4-05f2173cf516 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:42:49.553983 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-20eb7155-9bf1-40d6-819d-f2a07b1f7557 req-20ba8af5-9da7-424b-97ab-e47fdd5abfa0 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:49.606051 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-f9fd3e91-97e1-480f-bacb-216cc09704b0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:49.625470 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ea918013-01c5-4712-9fb2-18bf0f86f3ff req-50158f78-85d1-4196-89b1-fa89a074e5f2 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/security-groups?id=ca2e95d1-6615-46ef-a777-ca8d0c034440&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1052222 Sep 18 08:42:49.667702 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e47a018-0f3c-46eb-b44a-52a5dd8c6521 req-df2874a5-372d-4289-a6b7-82512fa2170b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:49.669164 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8e47a018-0f3c-46eb-b44a-52a5dd8c6521 req-df2874a5-372d-4289-a6b7-82512fa2170b service neutron] 10.222.0.13 "GET /v2.0/subnets?id=acdeb8a1-5de9-425f-ae0a-890d310246e9 HTTP/1.1" status: 200 len: 855 time: 0.1126001 Sep 18 08:42:49.718850 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-20eb7155-9bf1-40d6-819d-f2a07b1f7557 req-20ba8af5-9da7-424b-97ab-e47fdd5abfa0 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] For port 9a4f8ce9-f706-4c25-b3f4-05f2173cf516, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=9a4f8ce9-f706-4c25-b3f4-05f2173cf516,segment=NetworkSegment(d1432479-9c27-42c4-87db-6905e7868675),segment_id=d1432479-9c27-42c4-87db-6905e7868675)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:42:49.719214 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-20eb7155-9bf1-40d6-819d-f2a07b1f7557 req-20ba8af5-9da7-424b-97ab-e47fdd5abfa0 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:49.734713 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-20eb7155-9bf1-40d6-819d-f2a07b1f7557 req-20ba8af5-9da7-424b-97ab-e47fdd5abfa0 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Calling delete_port for 9a4f8ce9-f706-4c25-b3f4-05f2173cf516 owned by compute:nova {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:42:49.747803 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e47a018-0f3c-46eb-b44a-52a5dd8c6521 req-1baa52b1-6af3-40bb-9578-54c9f4c047c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:49.749331 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8e47a018-0f3c-46eb-b44a-52a5dd8c6521 req-1baa52b1-6af3-40bb-9578-54c9f4c047c1 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=f430397d-03a8-4da2-bd1d-25890a3a0727&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0713265 Sep 18 08:42:49.899919 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7aad33d-3d71-4d39-82d4-b9b22d17033a req-d9276074-72fb-49e7-99a3-82b2a77ab7a7 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:49.901438 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c7aad33d-3d71-4d39-82d4-b9b22d17033a req-d9276074-72fb-49e7-99a3-82b2a77ab7a7 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 943 time: 0.1204207 Sep 18 08:42:49.918657 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:49.951921 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8e47a018-0f3c-46eb-b44a-52a5dd8c6521 req-42bd2ad8-d3b9-4edf-938f-f8e116c03f74 service neutron] 10.222.0.13 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1719260 Sep 18 08:42:50.011703 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c7aad33d-3d71-4d39-82d4-b9b22d17033a req-4e5a68da-98fc-42ea-b595-1921c4e39f1b tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0974972 Sep 18 08:42:50.065374 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-20eb7155-9bf1-40d6-819d-f2a07b1f7557 req-20ba8af5-9da7-424b-97ab-e47fdd5abfa0 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:50.102583 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['9a4f8ce9-f706-4c25-b3f4-05f2173cf516'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:42:50.115967 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20ba8af5-9da7-424b-97ab-e47fdd5abfa0 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Pushing event deleted for resources: {'Port': ['ID=9a4f8ce9-f706-4c25-b3f4-05f2173cf516,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:50.165744 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8e47a018-0f3c-46eb-b44a-52a5dd8c6521 req-709b66c6-1c2f-4de3-8412-de28a4a6095a service neutron] 10.222.0.13 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1927731 Sep 18 08:42:50.180483 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-20eb7155-9bf1-40d6-819d-f2a07b1f7557 req-20ba8af5-9da7-424b-97ab-e47fdd5abfa0 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] No DVR routers for this DVR port 9a4f8ce9-f706-4c25-b3f4-05f2173cf516 on host hv-cinder-80447 {{(pid=94347) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:42:50.182995 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-20eb7155-9bf1-40d6-819d-f2a07b1f7557 req-20ba8af5-9da7-424b-97ab-e47fdd5abfa0 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:50.185371 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-20eb7155-9bf1-40d6-819d-f2a07b1f7557 req-20ba8af5-9da7-424b-97ab-e47fdd5abfa0 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.13 "DELETE /v2.0/ports/9a4f8ce9-f706-4c25-b3f4-05f2173cf516 HTTP/1.1" status: 204 len: 173 time: 0.8527558 Sep 18 08:42:50.186937 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c2476c0-3321-4eb3-a42d-df9f52eeb4f8', 'name': 'network-vif-deleted', 'tag': '9a4f8ce9-f706-4c25-b3f4-05f2173cf516'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:42:50.190497 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8b1d3451-dc1c-4a97-bbda-25ca43597185" -d '{"events": [{"server_uuid": "1c2476c0-3321-4eb3-a42d-df9f52eeb4f8", "name": "network-vif-deleted", "tag": "9a4f8ce9-f706-4c25-b3f4-05f2173cf516"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:42:50.212362 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88a85d14-5667-451b-b609-defb26760574 req-3c33ae49-1f6c-4828-b440-4f643a38105b tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:50.213907 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-88a85d14-5667-451b-b609-defb26760574 req-3c33ae49-1f6c-4828-b440-4f643a38105b tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.1057959 Sep 18 08:42:50.235646 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:42:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0015421b-363d-4f3b-aa60-9192a737c535 x-openstack-request-id: req-0015421b-363d-4f3b-aa60-9192a737c535 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:42:50.235932 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1c2476c0-3321-4eb3-a42d-df9f52eeb4f8", "name": "network-vif-deleted", "tag": "9a4f8ce9-f706-4c25-b3f4-05f2173cf516", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:42:50.236208 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-0015421b-363d-4f3b-aa60-9192a737c535 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:42:50.236589 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c2476c0-3321-4eb3-a42d-df9f52eeb4f8', 'name': 'network-vif-deleted', 'tag': '9a4f8ce9-f706-4c25-b3f4-05f2173cf516', 'status': 'completed', 'code': 200} Sep 18 08:42:50.260235 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-88a85d14-5667-451b-b609-defb26760574 req-901c9875-3a47-4887-adf1-10c2e4ad7307 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0351784 Sep 18 08:42:50.727771 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-55ccac81-46cf-451b-866e-9cd8df562714 req-2092c53d-db61-4903-be3c-de713b1735a3 tempest-AttachVolumeNegativeTest-625552550 tempest-AttachVolumeNegativeTest-625552550-project] 10.222.0.35 "GET /v2.0/ports?device_id=1c2476c0-3321-4eb3-a42d-df9f52eeb4f8 HTTP/1.1" status: 200 len: 210 time: 0.0256803 Sep 18 08:42:51.126570 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f847b3c8-0f5e-4364-a8c2-d6a2b594d393 req-343e4b6a-b702-4f48-b223-9e076a8998fb tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:51.128054 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f847b3c8-0f5e-4364-a8c2-d6a2b594d393 req-343e4b6a-b702-4f48-b223-9e076a8998fb tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 943 time: 0.0509999 Sep 18 08:42:51.164337 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f847b3c8-0f5e-4364-a8c2-d6a2b594d393 req-24d99792-c00d-435a-a187-7a00a9ccd7c8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0303912 Sep 18 08:42:51.373644 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-014d9dce-9d9c-410b-802e-799247c5333d req-c4f4e323-fe26-449b-8633-cb0361ac0578 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:51.375129 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-014d9dce-9d9c-410b-802e-799247c5333d req-c4f4e323-fe26-449b-8633-cb0361ac0578 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 946 time: 0.0480378 Sep 18 08:42:51.411887 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-014d9dce-9d9c-410b-802e-799247c5333d req-f810c113-3e1b-4f41-b949-d4a433401c7c tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0309362 Sep 18 08:42:51.500677 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 no longer exists at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:42:51.576870 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:51.599170 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4248ac92-ce7b-4560-9f83-de05a7069a99', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:42:51.601423 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-083c4af6-7ca9-4e9e-ad32-05abe1b12b91" -d '{"events": [{"server_uuid": "4248ac92-ce7b-4560-9f83-de05a7069a99", "name": "network-vif-unplugged", "status": "completed", "tag": "2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:42:51.615321 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:42:51.619656 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:51.642179 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Sat, 18 Sep 2021 08:42:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-edc9a976-0783-49bc-b554-b1b34652188c x-openstack-request-id: req-edc9a976-0783-49bc-b554-b1b34652188c {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:42:51.642497 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4248ac92-ce7b-4560-9f83-de05a7069a99", "name": "network-vif-unplugged", "status": "completed", "tag": "2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:42:51.642754 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-edc9a976-0783-49bc-b554-b1b34652188c {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:42:51.643141 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4248ac92-ce7b-4560-9f83-de05a7069a99', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1', 'code': 200} Sep 18 08:42:51.670165 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1,revision_number=8']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:51.780649 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 34062) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:51.823565 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_v2 [None req-9167249b-6fa5-4b9a-941a-18f3363fb74e admin admin] Deleting subnet b96e08ba-91b8-4c1f-bd27-4a1270ccbde2 {{(pid=94347) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 18 08:42:51.826492 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9167249b-6fa5-4b9a-941a-18f3363fb74e admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:51.863671 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9167249b-6fa5-4b9a-941a-18f3363fb74e admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-13659316'] for subnet, precommit_delete_associations {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:51.900095 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9167249b-6fa5-4b9a-941a-18f3363fb74e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1821528'] for subnet, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:51.952224 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9167249b-6fa5-4b9a-941a-18f3363fb74e admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1821519', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15069100', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-13996283'] for subnet, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:51.978802 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9167249b-6fa5-4b9a-941a-18f3363fb74e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b96e08ba-91b8-4c1f-bd27-4a1270ccbde2,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:51.980783 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9167249b-6fa5-4b9a-941a-18f3363fb74e admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for subnet, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:51.983235 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-9167249b-6fa5-4b9a-941a-18f3363fb74e admin admin] 10.222.0.35 "DELETE /v2.0/subnets/b96e08ba-91b8-4c1f-bd27-4a1270ccbde2 HTTP/1.1" status: 204 len: 168 time: 0.2014368 Sep 18 08:42:51.985692 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 34064) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:52.055410 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7f46674a-fff4-4ac5-bc42-89b22bfe5369 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1861545'] for network, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:52.131956 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7f46674a-fff4-4ac5-bc42-89b22bfe5369 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1806559', 'neutron.services.segments.db._delete_segments_for_network-8732885752733'] for network, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:52.151207 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.services.segments.db [None req-7f46674a-fff4-4ac5-bc42-89b22bfe5369 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['fe2753d3-7f3b-4739-adbf-6643a840c73e']}} {{(pid=94347) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:42:52.160904 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.services.segments.db [None req-7f46674a-fff4-4ac5-bc42-89b22bfe5369 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd1432479-9c27-42c4-87db-6905e7868675') {'for_net_delete': True} {{(pid=94347) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:42:52.161200 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.services.segments.db [None req-7f46674a-fff4-4ac5-bc42-89b22bfe5369 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd1432479-9c27-42c4-87db-6905e7868675') {} {{(pid=94347) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:42:52.170212 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7f46674a-fff4-4ac5-bc42-89b22bfe5369 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732885753254', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-13659327'] for segment, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:52.183045 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7f46674a-fff4-4ac5-bc42-89b22bfe5369 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:52.188836 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7f46674a-fff4-4ac5-bc42-89b22bfe5369 admin admin] Releasing vlan 233 on physical network physnet1 to pool {{(pid=94347) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 18 08:42:52.189232 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7f46674a-fff4-4ac5-bc42-89b22bfe5369 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15067250'] for segment, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: Traceback (most recent call last): Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: timer() Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: cb(*args, **kw) Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: return func(*args, **kwargs) Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: self._notify() Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: self.callback(batched_events) Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: event.method(event) Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: aggregate_uuid = self.p_client.list_aggregates( Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: return f(self, *a, **k) Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: return self._get(url).json() Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: return self.request(url, 'GET', **kwargs) Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: base_url = self.get_endpoint(auth, allow=allow, Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 18 08:42:52.190876 dv-cinder-804470-6-iscsi neutron-server[94347]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 18 08:42:52.275520 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7f46674a-fff4-4ac5-bc42-89b22bfe5369 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1806534', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-784926'] for network, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:52.284729 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7f46674a-fff4-4ac5-bc42-89b22bfe5369 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:52.288955 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-7f46674a-fff4-4ac5-bc42-89b22bfe5369 admin admin] 10.222.0.35 "DELETE /v2.0/networks/fe2753d3-7f3b-4739-adbf-6643a840c73e HTTP/1.1" status: 204 len: 168 time: 0.3000615 Sep 18 08:42:52.297275 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f46674a-fff4-4ac5-bc42-89b22bfe5369 admin admin] Pushing event deleted for resources: {'Network': ['ID=fe2753d3-7f3b-4739-adbf-6643a840c73e,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:52.313025 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4ee1bb0-8eb7-493f-bb4f-78d29fbb068b req-97b831ea-e65b-4403-8854-d06371ef7bf8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:52.314580 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b4ee1bb0-8eb7-493f-bb4f-78d29fbb068b req-97b831ea-e65b-4403-8854-d06371ef7bf8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 943 time: 0.0701108 Sep 18 08:42:52.352535 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b4ee1bb0-8eb7-493f-bb4f-78d29fbb068b req-c4aac187-851b-4635-94ce-4a8dd5049668 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0321047 Sep 18 08:42:52.400682 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-2545727e-4b91-45fc-8869-61763704d892 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:52.447669 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 34072) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:52.496042 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-2799785f-3669-465f-9ae3-e9b25f3cbdee admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=38bd82e43ad3497aa14e8e4e68a29009&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0472331 Sep 18 08:42:52.499159 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 34074) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:52.535091 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbe76ac0-b9ef-4d70-9c28-c4cfa00c06ba req-1d79febc-aa16-402b-8765-5ecdd5f755f1 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:52.536620 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dbe76ac0-b9ef-4d70-9c28-c4cfa00c06ba req-1d79febc-aa16-402b-8765-5ecdd5f755f1 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0523725 Sep 18 08:42:52.551243 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-e4546f91-40aa-48b8-ba47-8d7c3f230980 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:52.571596 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-e4546f91-40aa-48b8-ba47-8d7c3f230980 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:52.576285 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dbe76ac0-b9ef-4d70-9c28-c4cfa00c06ba req-0d829e53-f44d-4f44-8b66-d05c1aad95ad tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0324833 Sep 18 08:42:52.616411 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-e4546f91-40aa-48b8-ba47-8d7c3f230980 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:52.618886 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-e4546f91-40aa-48b8-ba47-8d7c3f230980 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:52.620016 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-e4546f91-40aa-48b8-ba47-8d7c3f230980 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/ca2e95d1-6615-46ef-a777-ca8d0c034440 HTTP/1.1" status: 204 len: 168 time: 0.1198115 Sep 18 08:42:52.627780 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4546f91-40aa-48b8-ba47-8d7c3f230980 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ca2e95d1-6615-46ef-a777-ca8d0c034440,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:52.634574 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4546f91-40aa-48b8-ba47-8d7c3f230980 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:52.634970 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4546f91-40aa-48b8-ba47-8d7c3f230980 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:52.635273 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4546f91-40aa-48b8-ba47-8d7c3f230980 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:52.635660 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4546f91-40aa-48b8-ba47-8d7c3f230980 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:52.635918 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4546f91-40aa-48b8-ba47-8d7c3f230980 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:52.636253 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4546f91-40aa-48b8-ba47-8d7c3f230980 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:52.636582 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4546f91-40aa-48b8-ba47-8d7c3f230980 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:52.636905 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4546f91-40aa-48b8-ba47-8d7c3f230980 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:52.637249 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4546f91-40aa-48b8-ba47-8d7c3f230980 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:52.638210 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4546f91-40aa-48b8-ba47-8d7c3f230980 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:52.638535 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4546f91-40aa-48b8-ba47-8d7c3f230980 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:52.638856 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e4546f91-40aa-48b8-ba47-8d7c3f230980 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:42:53.198153 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:53.340220 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:53.466869 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16456171-3df2-461a-8879-7187c9ca574e req-deb92640-1101-4a15-baea-bca4f6b5e5bf tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:53.468439 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-16456171-3df2-461a-8879-7187c9ca574e req-deb92640-1101-4a15-baea-bca4f6b5e5bf tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 943 time: 0.0475771 Sep 18 08:42:53.505719 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-16456171-3df2-461a-8879-7187c9ca574e req-e01d3dca-f656-4718-b953-56d77854d8eb tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0309439 Sep 18 08:42:53.707092 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67b41fa3-ca09-4c48-b5b9-913655d6d07a req-d409554a-bef6-465e-b3a9-bb9e9fc2a70f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:53.708757 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-67b41fa3-ca09-4c48-b5b9-913655d6d07a req-d409554a-bef6-465e-b3a9-bb9e9fc2a70f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0597618 Sep 18 08:42:53.750205 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-67b41fa3-ca09-4c48-b5b9-913655d6d07a req-0dcc4481-540c-4d7b-ab74-27a64b73792c tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0350201 Sep 18 08:42:54.450013 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 9a4f8ce9-f706-4c25-b3f4-05f2173cf516 no longer exists at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:42:54.470066 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] No Port match for: 9a4f8ce9-f706-4c25-b3f4-05f2173cf516 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:42:54.470415 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 9a4f8ce9-f706-4c25-b3f4-05f2173cf516 not bound to the agent host hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:42:54.621980 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54066c2e-674a-4d80-96b3-5446f2f810c6 req-d9fc6334-a7d6-4d09-bef3-a057c5a526cd tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:54.623434 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-54066c2e-674a-4d80-96b3-5446f2f810c6 req-d9fc6334-a7d6-4d09-bef3-a057c5a526cd tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 943 time: 0.0508869 Sep 18 08:42:54.659371 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-54066c2e-674a-4d80-96b3-5446f2f810c6 req-dd13ca52-8339-4bfe-b81a-457a41bfb0ad tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0301394 Sep 18 08:42:54.867987 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:54.869666 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39c83ccb-adff-47e6-a761-e45e760d8452 req-e9d6c482-a15d-4d6e-8351-42fb4c7f43b1 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:54.871159 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-39c83ccb-adff-47e6-a761-e45e760d8452 req-e9d6c482-a15d-4d6e-8351-42fb4c7f43b1 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0498693 Sep 18 08:42:54.909163 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-39c83ccb-adff-47e6-a761-e45e760d8452 req-b94f374d-4ed9-4e18-8b5f-510db81697b6 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0321083 Sep 18 08:42:55.769288 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9d07483-3027-4b6b-9dfd-72a157915560 req-fbc74f01-49b2-4865-9f44-476b0fd8390f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:55.770797 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f9d07483-3027-4b6b-9dfd-72a157915560 req-fbc74f01-49b2-4865-9f44-476b0fd8390f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 943 time: 0.0472205 Sep 18 08:42:55.807258 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f9d07483-3027-4b6b-9dfd-72a157915560 req-d477016e-de3a-4667-be1a-635f7d8ce404 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0307403 Sep 18 08:42:55.857379 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 no longer exists at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:42:56.029499 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d5f474a-940f-4eee-b577-a8de3cc9a287 req-9f8c377b-1b75-4060-bb02-9197d630ee56 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:56.030978 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1d5f474a-940f-4eee-b577-a8de3cc9a287 req-9f8c377b-1b75-4060-bb02-9197d630ee56 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0514030 Sep 18 08:42:56.067146 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1d5f474a-940f-4eee-b577-a8de3cc9a287 req-a97f5674-4530-460f-9b55-a1b852b61654 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0303173 Sep 18 08:42:56.923559 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9823580b-4324-4702-a47a-add3b7bd6072 req-084cd7b6-34ce-4c54-a8a2-4645058aeb45 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:56.925645 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9823580b-4324-4702-a47a-add3b7bd6072 req-084cd7b6-34ce-4c54-a8a2-4645058aeb45 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 943 time: 0.0524662 Sep 18 08:42:56.968125 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9823580b-4324-4702-a47a-add3b7bd6072 req-5afd841a-2516-48a2-aa80-5b732bcce1e7 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0362847 Sep 18 08:42:57.208117 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebae1a21-11bc-46af-8d6e-b7476121d629 req-734bd29d-2209-4a52-a370-96d263642543 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:57.208117 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ebae1a21-11bc-46af-8d6e-b7476121d629 req-734bd29d-2209-4a52-a370-96d263642543 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0638859 Sep 18 08:42:57.242375 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ebae1a21-11bc-46af-8d6e-b7476121d629 req-c6621707-c958-4cb2-83a9-1cfa4be094be tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0325308 Sep 18 08:42:57.704049 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [req-f17b9223-b95e-4c7b-8b68-5d88d26ed1cf req-4090f2d8-882d-4451-a9eb-63219d8d08b3 service neutron] http://10.222.0.35:9696/v2.0/extensions returned with HTTP 200 {{(pid=94347) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 18 08:42:57.705043 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f17b9223-b95e-4c7b-8b68-5d88d26ed1cf req-4090f2d8-882d-4451-a9eb-63219d8d08b3 service neutron] 10.222.0.35 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0054438 Sep 18 08:42:57.859864 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef483d07-1717-4a87-9681-c5d9ca7db347 req-5126668f-d7e2-4f63-8bb5-941b7b853ccc tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:57.861469 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ef483d07-1717-4a87-9681-c5d9ca7db347 req-5126668f-d7e2-4f63-8bb5-941b7b853ccc tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0516546 Sep 18 08:42:57.901014 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ef483d07-1717-4a87-9681-c5d9ca7db347 req-1b7f4bb7-010a-4254-8f47-6db3db5e96f6 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0326071 Sep 18 08:42:58.086633 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65ab3408-79a3-4a01-84f6-c54e3bd662ed req-9d20b6bf-2047-4e3d-901c-38d8c293bea1 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:58.088138 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-65ab3408-79a3-4a01-84f6-c54e3bd662ed req-9d20b6bf-2047-4e3d-901c-38d8c293bea1 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 943 time: 0.0495818 Sep 18 08:42:58.126316 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-65ab3408-79a3-4a01-84f6-c54e3bd662ed req-7bbea7a1-1edb-4562-acfc-9da69cdc1ed9 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0320542 Sep 18 08:42:58.155262 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 34206) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:58.238975 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-49481ba2-48ce-4dcd-b5d8-6a11aefdd2bc req-f1307aa4-729c-4346-8aa3-65bfe5677e1b service neutron] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0824416 Sep 18 08:42:58.248370 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [req-49481ba2-48ce-4dcd-b5d8-6a11aefdd2bc req-6edad6f2-87a5-4c04-ad88-acf7f1c18315 service neutron] http://10.222.0.35:9696/v2.0/extensions returned with HTTP 200 {{(pid=94346) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 18 08:42:58.249379 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-49481ba2-48ce-4dcd-b5d8-6a11aefdd2bc req-6edad6f2-87a5-4c04-ad88-acf7f1c18315 service neutron] 10.222.0.35 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0052543 Sep 18 08:42:58.492075 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 34232) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:58.601397 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6af65c17-0d24-4256-869f-4445ad30c848 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:58.698133 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6af65c17-0d24-4256-869f-4445ad30c848 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:58.702135 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-6af65c17-0d24-4256-869f-4445ad30c848 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:58.739730 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-6af65c17-0d24-4256-869f-4445ad30c848 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=c660f65aacfa467e99ec382133cdfe9d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2465279 Sep 18 08:42:58.740626 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6af65c17-0d24-4256-869f-4445ad30c848 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5aae5ca1-f829-427a-8c25-8f5e0f6077f8,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:58.743591 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 34236) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:42:58.792827 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c4974abe-639e-4fad-88c4-338eb4b3c78d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:58.815925 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c4974abe-639e-4fad-88c4-338eb4b3c78d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:58.865041 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c4974abe-639e-4fad-88c4-338eb4b3c78d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:58.867516 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c4974abe-639e-4fad-88c4-338eb4b3c78d admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:42:58.868662 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-c4974abe-639e-4fad-88c4-338eb4b3c78d admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/5aae5ca1-f829-427a-8c25-8f5e0f6077f8 HTTP/1.1" status: 204 len: 168 time: 0.1239216 Sep 18 08:42:58.876769 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4974abe-639e-4fad-88c4-338eb4b3c78d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5aae5ca1-f829-427a-8c25-8f5e0f6077f8,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:42:59.029736 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44de18f5-00b2-444d-a0e1-30d8fed6743a req-cc4a7a3a-70dc-4b3b-a581-fda1691f0233 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:59.031264 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-44de18f5-00b2-444d-a0e1-30d8fed6743a req-cc4a7a3a-70dc-4b3b-a581-fda1691f0233 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0578136 Sep 18 08:42:59.070844 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-44de18f5-00b2-444d-a0e1-30d8fed6743a req-4d4959ba-4bc2-49ec-961c-3e949e46f59a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0327990 Sep 18 08:42:59.241995 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b993edc3-4c0c-4ab1-bbce-840b668dda6d req-142bb583-9ff4-4185-ae5f-7f6e13156394 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:42:59.243618 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b993edc3-4c0c-4ab1-bbce-840b668dda6d req-142bb583-9ff4-4185-ae5f-7f6e13156394 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 943 time: 0.0486698 Sep 18 08:42:59.282643 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b993edc3-4c0c-4ab1-bbce-840b668dda6d req-9f966cd4-8faa-438b-9cef-b16d9cae708c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0330465 Sep 18 08:42:59.880324 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 3f56fe96-8f0e-4410-8e3c-da651c794d50 details requested by agent hyperv_hv-cinder-80447 with host hv-cinder-80447 {{(pid=94348) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 18 08:42:59.995573 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 3f56fe96-8f0e-4410-8e3c-da651c794d50, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=3f56fe96-8f0e-4410-8e3c-da651c794d50,segment=NetworkSegment(c215153d-2878-4c82-8dc0-2a92b453bf12),segment_id=c215153d-2878-4c82-8dc0-2a92b453bf12)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:43:00.008598 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Returning: {'device': '3f56fe96-8f0e-4410-8e3c-da651c794d50', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'port_id': '3f56fe96-8f0e-4410-8e3c-da651c794d50', 'mac_address': 'fa:16:3e:44:d5:01', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 200, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94348) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 18 08:43:00.048652 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:00.063014 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3f56fe96-8f0e-4410-8e3c-da651c794d50 {{(pid=94348) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:43:00.083468 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 3f56fe96-8f0e-4410-8e3c-da651c794d50, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=3f56fe96-8f0e-4410-8e3c-da651c794d50,segment=NetworkSegment(c215153d-2878-4c82-8dc0-2a92b453bf12),segment_id=c215153d-2878-4c82-8dc0-2a92b453bf12)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:43:00.087726 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:00.096127 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49481ba2-48ce-4dcd-b5d8-6a11aefdd2bc req-c2329fbd-d27b-4962-897a-550ec7168a23 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:00.099131 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-49481ba2-48ce-4dcd-b5d8-6a11aefdd2bc req-c2329fbd-d27b-4962-897a-550ec7168a23 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99&tenant_id=0700a96e9b3f48e8b6bcdd75b820b813 HTTP/1.1" status: 200 len: 1097 time: 0.0780995 Sep 18 08:43:00.137650 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=3f56fe96-8f0e-4410-8e3c-da651c794d50,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:43:00.214672 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49481ba2-48ce-4dcd-b5d8-6a11aefdd2bc req-63080a66-4727-4b13-bafd-ce11e1b85aa0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:00.216720 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-49481ba2-48ce-4dcd-b5d8-6a11aefdd2bc req-63080a66-4727-4b13-bafd-ce11e1b85aa0 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0700a96e9b3f48e8b6bcdd75b820b813&device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 1097 time: 0.0769949 Sep 18 08:43:00.225992 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74c7ab7f-de33-46cb-beef-cd5407d183f7 req-6c727ec3-983c-48f4-9049-7d75b1b35fae tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:00.227432 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-74c7ab7f-de33-46cb-beef-cd5407d183f7 req-6c727ec3-983c-48f4-9049-7d75b1b35fae tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0781040 Sep 18 08:43:00.324788 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-74c7ab7f-de33-46cb-beef-cd5407d183f7 req-1b9059fb-34e4-4041-85db-ff8e762a48aa tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0877624 Sep 18 08:43:00.345319 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49481ba2-48ce-4dcd-b5d8-6a11aefdd2bc req-3a4e0ef7-19f1-4daf-9c73-5f3b386a5c24 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:00.346817 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-49481ba2-48ce-4dcd-b5d8-6a11aefdd2bc req-3a4e0ef7-19f1-4daf-9c73-5f3b386a5c24 service neutron] 10.222.0.13 "GET /v2.0/networks?id=f430397d-03a8-4da2-bd1d-25890a3a0727 HTTP/1.1" status: 200 len: 917 time: 0.1184416 Sep 18 08:43:00.452518 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-49481ba2-48ce-4dcd-b5d8-6a11aefdd2bc req-195bb2c3-b17e-4c70-8b4e-6e4330c867d6 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 HTTP/1.1" status: 200 len: 1000 time: 0.0974691 Sep 18 08:43:00.464294 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fcd26d4-1c3e-4f36-9a6b-b3a8eb1ec5ae req-083044fa-51e6-4c8e-8847-e03a5bb8f1e7 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:00.465792 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2fcd26d4-1c3e-4f36-9a6b-b3a8eb1ec5ae req-083044fa-51e6-4c8e-8847-e03a5bb8f1e7 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 944 time: 0.1015949 Sep 18 08:43:00.526398 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['3f56fe96-8f0e-4410-8e3c-da651c794d50'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:43:00.538235 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49481ba2-48ce-4dcd-b5d8-6a11aefdd2bc req-79ed48c0-c812-4c88-b291-261b9359fa3a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:00.539904 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-49481ba2-48ce-4dcd-b5d8-6a11aefdd2bc req-79ed48c0-c812-4c88-b291-261b9359fa3a service neutron] 10.222.0.13 "GET /v2.0/subnets?id=acdeb8a1-5de9-425f-ae0a-890d310246e9 HTTP/1.1" status: 200 len: 855 time: 0.0731792 Sep 18 08:43:00.543418 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2fcd26d4-1c3e-4f36-9a6b-b3a8eb1ec5ae req-04de8f8f-ea66-4639-8ded-0e1bf88648b6 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0686471 Sep 18 08:43:00.568459 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 34304) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:43:00.594341 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49481ba2-48ce-4dcd-b5d8-6a11aefdd2bc req-1d800a54-0cc5-4afc-b2de-ac32cfe039e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:00.596128 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-49481ba2-48ce-4dcd-b5d8-6a11aefdd2bc req-1d800a54-0cc5-4afc-b2de-ac32cfe039e4 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=f430397d-03a8-4da2-bd1d-25890a3a0727&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0470974 Sep 18 08:43:00.693162 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d34ecbd3-b19d-4f18-9269-478478b1e205 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:00.697151 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-49481ba2-48ce-4dcd-b5d8-6a11aefdd2bc req-86aebefa-6dce-4e9f-9676-36d85bee7fc5 service neutron] 10.222.0.13 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0922289 Sep 18 08:43:00.802230 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d34ecbd3-b19d-4f18-9269-478478b1e205 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:00.806905 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d34ecbd3-b19d-4f18-9269-478478b1e205 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:00.815684 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-49481ba2-48ce-4dcd-b5d8-6a11aefdd2bc req-cab9c4e4-705e-4661-9003-7da0f69babc5 service neutron] 10.222.0.13 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1108210 Sep 18 08:43:00.847882 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-d34ecbd3-b19d-4f18-9269-478478b1e205 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=af363ca7b8b04404b205a587f5b6e23d&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2780178 Sep 18 08:43:00.849057 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d34ecbd3-b19d-4f18-9269-478478b1e205 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e97c24bc-8e98-4175-9686-1f5b79f02b0c,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:43:00.850549 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 34322) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:43:00.910009 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-6c2ca885-7e2e-46d6-b40b-7f883bc269bd admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:00.936843 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-6c2ca885-7e2e-46d6-b40b-7f883bc269bd admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:00.984479 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-6c2ca885-7e2e-46d6-b40b-7f883bc269bd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:00.987185 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-6c2ca885-7e2e-46d6-b40b-7f883bc269bd admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:00.988338 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-6c2ca885-7e2e-46d6-b40b-7f883bc269bd admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/e97c24bc-8e98-4175-9686-1f5b79f02b0c HTTP/1.1" status: 204 len: 168 time: 0.1367953 Sep 18 08:43:00.995872 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c2ca885-7e2e-46d6-b40b-7f883bc269bd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e97c24bc-8e98-4175-9686-1f5b79f02b0c,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:43:01.043047 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 34332) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:43:01.259091 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0010e594-9e78-45ea-ba7a-e74e1b46ccf8 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:01.354024 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 34348) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:43:01.365293 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0010e594-9e78-45ea-ba7a-e74e1b46ccf8 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:01.367715 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b47bfc15-40be-4f08-ae69-5ab77ea42c34 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:01.370487 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0010e594-9e78-45ea-ba7a-e74e1b46ccf8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:01.431066 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-0010e594-9e78-45ea-ba7a-e74e1b46ccf8 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=55300c1fa5c04326b54321538d411f51&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3868861 Sep 18 08:43:01.434720 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 34358) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:43:01.435151 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0010e594-9e78-45ea-ba7a-e74e1b46ccf8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=46f792c0-8d51-4f1e-a319-d9e5bb9b8093,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:43:01.505804 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7eb72d5-5717-4c71-bc1c-6e317cf5188f req-342a356f-5bfc-4378-ab37-9945a6b96552 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:01.507569 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a7eb72d5-5717-4c71-bc1c-6e317cf5188f req-342a356f-5bfc-4378-ab37-9945a6b96552 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0746508 Sep 18 08:43:01.532232 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-9cfe496a-87ed-45c2-979d-e9b959193929 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:01.560042 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-9cfe496a-87ed-45c2-979d-e9b959193929 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:01.564749 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a7eb72d5-5717-4c71-bc1c-6e317cf5188f req-a6831b5c-45b6-4a96-bfe0-3102f00adb7d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0461850 Sep 18 08:43:01.617393 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-9cfe496a-87ed-45c2-979d-e9b959193929 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:01.620099 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-9cfe496a-87ed-45c2-979d-e9b959193929 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:01.632649 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-9cfe496a-87ed-45c2-979d-e9b959193929 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/46f792c0-8d51-4f1e-a319-d9e5bb9b8093 HTTP/1.1" status: 204 len: 168 time: 0.1889784 Sep 18 08:43:01.646907 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b47bfc15-40be-4f08-ae69-5ab77ea42c34 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:01.653166 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cfe496a-87ed-45c2-979d-e9b959193929 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=46f792c0-8d51-4f1e-a319-d9e5bb9b8093,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:43:01.673106 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b47bfc15-40be-4f08-ae69-5ab77ea42c34 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:01.711837 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f8f962d-17d0-45e3-a2ad-b3f943109f57 req-c54cc932-15ce-4e8d-a49a-d9d1e3df0fdf tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:01.719862 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:43:01.720771 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7f8f962d-17d0-45e3-a2ad-b3f943109f57 req-c54cc932-15ce-4e8d-a49a-d9d1e3df0fdf tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 944 time: 0.0852613 Sep 18 08:43:01.740947 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-b47bfc15-40be-4f08-ae69-5ab77ea42c34 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=ced51b04cace4d748a069a70628d83f0&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3859830 Sep 18 08:43:01.742517 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 34364) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:43:01.742790 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b47bfc15-40be-4f08-ae69-5ab77ea42c34 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5d55d035-716e-41d9-91d9-6dfb7712d5fe,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:43:01.800607 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7f8f962d-17d0-45e3-a2ad-b3f943109f57 req-15b827bb-640d-4dde-ac19-ade77dcdacfa tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0785329 Sep 18 08:43:01.828222 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-733db239-a19e-4b77-83ab-98fe0b268e60 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:01.852519 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-733db239-a19e-4b77-83ab-98fe0b268e60 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:01.879213 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 3f56fe96-8f0e-4410-8e3c-da651c794d50 up at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:43:01.932338 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-733db239-a19e-4b77-83ab-98fe0b268e60 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:01.935045 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-733db239-a19e-4b77-83ab-98fe0b268e60 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:01.936143 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-733db239-a19e-4b77-83ab-98fe0b268e60 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/5d55d035-716e-41d9-91d9-6dfb7712d5fe HTTP/1.1" status: 204 len: 168 time: 0.1926734 Sep 18 08:43:01.947285 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-733db239-a19e-4b77-83ab-98fe0b268e60 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5d55d035-716e-41d9-91d9-6dfb7712d5fe,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:43:01.955348 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning for port 3f56fe96-8f0e-4410-8e3c-da651c794d50 completed by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 18 08:43:01.969268 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning complete for port 3f56fe96-8f0e-4410-8e3c-da651c794d50 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:43:01.970419 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:02.079635 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:02.125858 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 3f56fe96-8f0e-4410-8e3c-da651c794d50, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=3f56fe96-8f0e-4410-8e3c-da651c794d50,segment=NetworkSegment(c215153d-2878-4c82-8dc0-2a92b453bf12),segment_id=c215153d-2878-4c82-8dc0-2a92b453bf12)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:43:02.127034 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5c332939-c954-4f64-97d5-07d5b2cb727d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3f56fe96-8f0e-4410-8e3c-da651c794d50'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:43:02.130675 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-da8e1111-d345-41c7-8533-cfd592bac940" -d '{"events": [{"server_uuid": "5c332939-c954-4f64-97d5-07d5b2cb727d", "name": "network-vif-plugged", "status": "completed", "tag": "3f56fe96-8f0e-4410-8e3c-da651c794d50"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:43:02.135456 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:02.224195 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=3f56fe96-8f0e-4410-8e3c-da651c794d50,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:43:02.239594 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:43:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b8330191-48f8-4d0d-8f04-172c49a2cd8f x-openstack-request-id: req-b8330191-48f8-4d0d-8f04-172c49a2cd8f {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:43:02.240414 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5c332939-c954-4f64-97d5-07d5b2cb727d", "name": "network-vif-plugged", "status": "completed", "tag": "3f56fe96-8f0e-4410-8e3c-da651c794d50", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:43:02.241059 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-b8330191-48f8-4d0d-8f04-172c49a2cd8f {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:43:02.253621 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5c332939-c954-4f64-97d5-07d5b2cb727d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3f56fe96-8f0e-4410-8e3c-da651c794d50', 'code': 200} Sep 18 08:43:03.113094 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97e9e696-b2dc-4c0b-803d-365d05b69bb6 req-3a752d17-d5e1-46d1-837d-241b28246cf7 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:03.120596 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-97e9e696-b2dc-4c0b-803d-365d05b69bb6 req-3a752d17-d5e1-46d1-837d-241b28246cf7 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 945 time: 0.0654547 Sep 18 08:43:03.130131 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea59e856-89e0-490d-84bd-1a9a21561f87 req-748e7ae9-1277-4fa0-9f5c-924284df8a33 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:03.131653 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ea59e856-89e0-490d-84bd-1a9a21561f87 req-748e7ae9-1277-4fa0-9f5c-924284df8a33 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.4722588 Sep 18 08:43:03.191376 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-97e9e696-b2dc-4c0b-803d-365d05b69bb6 req-723a80b3-45d6-4c92-9766-cef6d82a0b8a tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0661001 Sep 18 08:43:03.207787 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ea59e856-89e0-490d-84bd-1a9a21561f87 req-0728a993-c53a-4acc-859b-526157236692 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0637486 Sep 18 08:43:04.351676 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbbd005c-36d8-43cc-be56-b800e414d4c1 req-d426bc56-6ed4-4a4e-bd80-cd2e4439697c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:04.353462 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cbbd005c-36d8-43cc-be56-b800e414d4c1 req-d426bc56-6ed4-4a4e-bd80-cd2e4439697c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 945 time: 0.0841877 Sep 18 08:43:04.373969 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43c09775-a943-4655-9df8-9d5b0f35270c req-ab41d829-3f3b-49ce-a561-0c78db92b788 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:04.376880 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-43c09775-a943-4655-9df8-9d5b0f35270c req-ab41d829-3f3b-49ce-a561-0c78db92b788 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0687201 Sep 18 08:43:04.439673 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cbbd005c-36d8-43cc-be56-b800e414d4c1 req-e6c6ddf5-a4cd-47e2-9cfd-e5979bedea1e tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0613270 Sep 18 08:43:04.448146 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-43c09775-a943-4655-9df8-9d5b0f35270c req-dc29fe02-af49-4f5b-a4e0-8c67a693d40b tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0627770 Sep 18 08:43:05.360650 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 34500) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:43:05.495393 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-2cf332dc-c658-4ace-a44d-830a2c8a0dfa admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:05.603984 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-2cf332dc-c658-4ace-a44d-830a2c8a0dfa admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:05.608075 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc0b2550-a03a-4feb-bc09-f7d77dc6a8cd req-6495ed27-f1df-4677-a00c-f67fcc8f8c5f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:05.609635 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fc0b2550-a03a-4feb-bc09-f7d77dc6a8cd req-6495ed27-f1df-4677-a00c-f67fcc8f8c5f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 945 time: 0.0707438 Sep 18 08:43:05.612711 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-2cf332dc-c658-4ace-a44d-830a2c8a0dfa admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:05.652457 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fc0b2550-a03a-4feb-bc09-f7d77dc6a8cd req-4bca7976-7245-496a-848f-b5d2467566f3 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0358853 Sep 18 08:43:05.667856 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-2cf332dc-c658-4ace-a44d-830a2c8a0dfa admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=25270493e1324b65bfaf5aa698a82b29&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3060679 Sep 18 08:43:05.668960 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cf332dc-c658-4ace-a44d-830a2c8a0dfa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c0ffb8f-c5df-4b66-9a87-8ea3e86d184b,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:43:05.671629 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 34512) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:43:05.794444 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-34d53045-8a42-40a2-9253-843c1eb132a7 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:05.808350 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a061a4a8-1c1d-42bf-af3d-555ed1ea0013 req-2f3ec6be-a496-46d3-8e3e-3110a74dff66 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:05.809924 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a061a4a8-1c1d-42bf-af3d-555ed1ea0013 req-2f3ec6be-a496-46d3-8e3e-3110a74dff66 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.2430007 Sep 18 08:43:05.844382 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-34d53045-8a42-40a2-9253-843c1eb132a7 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:05.879033 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a061a4a8-1c1d-42bf-af3d-555ed1ea0013 req-d5a18415-6035-4269-b442-29f7fd4838fe tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0627728 Sep 18 08:43:05.918631 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-34d53045-8a42-40a2-9253-843c1eb132a7 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:05.921977 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-34d53045-8a42-40a2-9253-843c1eb132a7 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:05.923405 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-34d53045-8a42-40a2-9253-843c1eb132a7 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/0c0ffb8f-c5df-4b66-9a87-8ea3e86d184b HTTP/1.1" status: 204 len: 168 time: 0.2503538 Sep 18 08:43:05.941830 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34d53045-8a42-40a2-9253-843c1eb132a7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c0ffb8f-c5df-4b66-9a87-8ea3e86d184b,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:43:06.355470 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 34530) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:43:06.369639 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-afcd88e2-0082-4294-9785-33c71623897b admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:06.469395 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-afcd88e2-0082-4294-9785-33c71623897b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:06.476302 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-afcd88e2-0082-4294-9785-33c71623897b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:06.518083 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-afcd88e2-0082-4294-9785-33c71623897b admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=70957fd49ad14244802adc0a28def650&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1614347 Sep 18 08:43:06.520605 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 34534) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:43:06.526496 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-afcd88e2-0082-4294-9785-33c71623897b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fb3bc3ee-64c1-4401-be1b-dea8c87f4328,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:43:06.633422 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-61d65374-095b-4964-b62e-10e9b9b1bee3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:06.654783 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-61d65374-095b-4964-b62e-10e9b9b1bee3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:06.728617 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-61d65374-095b-4964-b62e-10e9b9b1bee3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:06.731238 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-61d65374-095b-4964-b62e-10e9b9b1bee3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:06.733229 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-61d65374-095b-4964-b62e-10e9b9b1bee3 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/fb3bc3ee-64c1-4401-be1b-dea8c87f4328 HTTP/1.1" status: 204 len: 168 time: 0.2111955 Sep 18 08:43:06.744375 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61d65374-095b-4964-b62e-10e9b9b1bee3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fb3bc3ee-64c1-4401-be1b-dea8c87f4328,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:43:06.805942 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a67cfd5-0f82-4179-aa19-980ca67d5cfa req-7cecf67a-df1e-429f-98c9-bb631b754e7e tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:06.807927 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7a67cfd5-0f82-4179-aa19-980ca67d5cfa req-7cecf67a-df1e-429f-98c9-bb631b754e7e tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 945 time: 0.0609126 Sep 18 08:43:06.863550 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7a67cfd5-0f82-4179-aa19-980ca67d5cfa req-fb0e3db6-67e9-4ac3-9775-c1b53ffe18df tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0483644 Sep 18 08:43:07.075280 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d04415f7-44de-43d2-9f74-86607327961b req-bc66cb65-55ce-4e61-8352-4ed1633054e3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:07.077745 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d04415f7-44de-43d2-9f74-86607327961b req-bc66cb65-55ce-4e61-8352-4ed1633054e3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0807815 Sep 18 08:43:07.125100 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d04415f7-44de-43d2-9f74-86607327961b req-7199af7f-5bb9-4dc2-8176-f6a784d985dc tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415215 Sep 18 08:43:08.270623 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aec8efc-6fac-4082-9102-d32b895bf073 req-d0d60e5c-7d09-4134-97e1-263d9dd81a7a tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:08.282330 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6aec8efc-6fac-4082-9102-d32b895bf073 req-d0d60e5c-7d09-4134-97e1-263d9dd81a7a tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 945 time: 0.3381717 Sep 18 08:43:08.364479 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6aec8efc-6fac-4082-9102-d32b895bf073 req-6215767e-d046-48b6-ae1e-c728acd0bfe2 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0809853 Sep 18 08:43:08.395133 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d15f5860-9ffa-490e-beac-5477b7d5950d req-d08846a3-c1f9-441a-b223-1c5e8485688d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:08.396675 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d15f5860-9ffa-490e-beac-5477b7d5950d req-d08846a3-c1f9-441a-b223-1c5e8485688d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0922823 Sep 18 08:43:08.489132 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d15f5860-9ffa-490e-beac-5477b7d5950d req-5d1a90ee-bf73-48ed-b7ff-b877ad18ea70 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0828030 Sep 18 08:43:09.485917 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11434096-2102-495b-ab38-6ffe76416e70 req-9a42d841-8cbd-42cd-a358-506054507958 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:09.487422 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-11434096-2102-495b-ab38-6ffe76416e70 req-9a42d841-8cbd-42cd-a358-506054507958 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 945 time: 0.0536604 Sep 18 08:43:09.524816 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-11434096-2102-495b-ab38-6ffe76416e70 req-9dd7b0e3-7b65-444d-8e0d-843723f28759 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0314269 Sep 18 08:43:09.636312 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4805dbe1-f49d-4082-92f3-4e222aeae429 req-9b363fa6-9562-4e01-9ede-1004a3956c8f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:09.638040 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4805dbe1-f49d-4082-92f3-4e222aeae429 req-9b363fa6-9562-4e01-9ede-1004a3956c8f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0544875 Sep 18 08:43:09.679500 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4805dbe1-f49d-4082-92f3-4e222aeae429 req-08e374da-7fab-4120-9450-385f25209260 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0336926 Sep 18 08:43:10.640975 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-685800aa-1eae-43ea-8aec-e7db8dddbd94 req-b56fd851-f576-4c2c-ae95-4703bc26183a tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:10.642533 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-685800aa-1eae-43ea-8aec-e7db8dddbd94 req-b56fd851-f576-4c2c-ae95-4703bc26183a tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 945 time: 0.0498798 Sep 18 08:43:10.680960 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-685800aa-1eae-43ea-8aec-e7db8dddbd94 req-33f9982c-4eb1-4e4b-821b-3df0b9066a6b tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0320275 Sep 18 08:43:10.802663 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-053b3904-fd00-4be9-b132-5d3585f56503 req-40745223-4c0a-4baa-9d3a-c6ffcc530e95 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:10.804181 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-053b3904-fd00-4be9-b132-5d3585f56503 req-40745223-4c0a-4baa-9d3a-c6ffcc530e95 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0522640 Sep 18 08:43:10.846869 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-053b3904-fd00-4be9-b132-5d3585f56503 req-c0b9ae36-f4b5-446d-8d0f-fa1f8471b998 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0367448 Sep 18 08:43:11.314197 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 34666) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:43:11.431680 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-bcdd4df5-f4c7-4e69-8e2e-f69f275772d6 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:11.539613 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-bcdd4df5-f4c7-4e69-8e2e-f69f275772d6 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:11.546620 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-bcdd4df5-f4c7-4e69-8e2e-f69f275772d6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:11.587692 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-bcdd4df5-f4c7-4e69-8e2e-f69f275772d6 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=f29357a740bf45f0a4b42e18b34fac7a&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2721374 Sep 18 08:43:11.588685 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcdd4df5-f4c7-4e69-8e2e-f69f275772d6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6e028f99-e682-461d-9fc6-51979750c48f,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:43:11.589410 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 34686) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:43:11.651106 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-98e5e970-daf7-4e35-a45f-00227a2fa83e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:11.674117 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-98e5e970-daf7-4e35-a45f-00227a2fa83e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:11.779061 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-98e5e970-daf7-4e35-a45f-00227a2fa83e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:11.782299 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-98e5e970-daf7-4e35-a45f-00227a2fa83e admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:11.786412 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-98e5e970-daf7-4e35-a45f-00227a2fa83e admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/6e028f99-e682-461d-9fc6-51979750c48f HTTP/1.1" status: 204 len: 168 time: 0.1950636 Sep 18 08:43:11.811139 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98e5e970-daf7-4e35-a45f-00227a2fa83e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6e028f99-e682-461d-9fc6-51979750c48f,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:43:11.863297 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72b6a942-2074-4d08-b499-c5589610428b req-5ca8def3-e496-4c5c-bce2-f07013b66326 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:11.864822 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-72b6a942-2074-4d08-b499-c5589610428b req-5ca8def3-e496-4c5c-bce2-f07013b66326 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 945 time: 0.0886478 Sep 18 08:43:11.983716 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-72b6a942-2074-4d08-b499-c5589610428b req-1290efe3-972c-4526-a72c-f05c468f642c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1050763 Sep 18 08:43:12.055684 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf69b102-f495-477f-9477-5e58f6fa8fca req-ae450cc5-9e97-4629-bf60-de83dfdeebde tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:12.057712 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bf69b102-f495-477f-9477-5e58f6fa8fca req-ae450cc5-9e97-4629-bf60-de83dfdeebde tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.1075554 Sep 18 08:43:12.109912 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bf69b102-f495-477f-9477-5e58f6fa8fca req-24dfe57b-0f75-41a1-a476-fa2a2013b242 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0460937 Sep 18 08:43:12.228763 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 34720) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:43:12.245151 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-affced6c-96bd-44a3-a032-bf2f459e9669 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:12.356189 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-affced6c-96bd-44a3-a032-bf2f459e9669 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:12.361095 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-affced6c-96bd-44a3-a032-bf2f459e9669 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:12.397767 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-affced6c-96bd-44a3-a032-bf2f459e9669 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=aa0835b5-ea53-4c4d-b366-1a4ef51dfd44,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:43:12.403030 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-affced6c-96bd-44a3-a032-bf2f459e9669 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=4349064b3c944896a21b5197726dbfe5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1728714 Sep 18 08:43:12.406453 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 34726) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:43:12.456050 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0ccd414e-5cb9-4cfc-b836-8fd64ae235c3 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:12.479956 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0ccd414e-5cb9-4cfc-b836-8fd64ae235c3 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:12.526722 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0ccd414e-5cb9-4cfc-b836-8fd64ae235c3 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:12.530021 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0ccd414e-5cb9-4cfc-b836-8fd64ae235c3 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:12.531187 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-0ccd414e-5cb9-4cfc-b836-8fd64ae235c3 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/aa0835b5-ea53-4c4d-b366-1a4ef51dfd44 HTTP/1.1" status: 204 len: 168 time: 0.1238270 Sep 18 08:43:12.541312 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ccd414e-5cb9-4cfc-b836-8fd64ae235c3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=aa0835b5-ea53-4c4d-b366-1a4ef51dfd44,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:43:12.890475 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 34732) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:43:12.903738 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-7b5df44d-8959-4867-b609-e181a5c900dd admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:13.012816 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-7b5df44d-8959-4867-b609-e181a5c900dd admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:13.017440 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-7b5df44d-8959-4867-b609-e181a5c900dd admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:13.055027 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-7b5df44d-8959-4867-b609-e181a5c900dd admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=ff5e58c786a3493dbf98276cfb1356a9&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1628220 Sep 18 08:43:13.055763 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b5df44d-8959-4867-b609-e181a5c900dd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=60057e51-ba62-4cd3-8774-58bdd57e5493,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:43:13.059013 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 34738) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:43:13.116429 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fcc3901-dae3-48d5-a28a-098998779706 req-3ea893c8-33fc-47b7-b5d7-5060b7b74909 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:13.118000 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8fcc3901-dae3-48d5-a28a-098998779706 req-3ea893c8-33fc-47b7-b5d7-5060b7b74909 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 945 time: 0.0641680 Sep 18 08:43:13.121748 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-11c92c40-671a-4fc7-9723-829d40b4b8e6 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:13.146265 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-11c92c40-671a-4fc7-9723-829d40b4b8e6 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:13.164364 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8fcc3901-dae3-48d5-a28a-098998779706 req-96ccad85-2069-40ad-8f0a-e880d2cec698 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0397725 Sep 18 08:43:13.214706 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-11c92c40-671a-4fc7-9723-829d40b4b8e6 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:13.217661 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-11c92c40-671a-4fc7-9723-829d40b4b8e6 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:13.221679 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-11c92c40-671a-4fc7-9723-829d40b4b8e6 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/60057e51-ba62-4cd3-8774-58bdd57e5493 HTTP/1.1" status: 204 len: 168 time: 0.1615520 Sep 18 08:43:13.230332 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11c92c40-671a-4fc7-9723-829d40b4b8e6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=60057e51-ba62-4cd3-8774-58bdd57e5493,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:43:13.260617 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ba016d0-c6a4-44c6-b4f7-7585ce4de892 req-0e9030ba-f40b-4b6d-8f26-51bfa8d663f9 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:13.262420 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5ba016d0-c6a4-44c6-b4f7-7585ce4de892 req-0e9030ba-f40b-4b6d-8f26-51bfa8d663f9 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0574512 Sep 18 08:43:13.306564 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5ba016d0-c6a4-44c6-b4f7-7585ce4de892 req-259743a2-8a21-4ccb-a869-ea18c397884b tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0357444 Sep 18 08:43:13.766777 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 34770) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:43:13.881874 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3da6d11e-6e73-437e-9e72-50c3f9890bbb admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:14.024768 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3da6d11e-6e73-437e-9e72-50c3f9890bbb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:14.030849 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3da6d11e-6e73-437e-9e72-50c3f9890bbb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:14.070250 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-3da6d11e-6e73-437e-9e72-50c3f9890bbb admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=c465309498834d88aa60d4862a2153de&name=default HTTP/1.1" status: 200 len: 2979 time: 0.3020451 Sep 18 08:43:14.071225 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3da6d11e-6e73-437e-9e72-50c3f9890bbb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7ba11187-9880-4b52-8d1f-fef6b3837a8b,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:43:14.072775 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 34782) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:43:14.139844 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3c65fd49-e0ff-41b4-97d9-4b02d1a491ad admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:14.161945 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3c65fd49-e0ff-41b4-97d9-4b02d1a491ad admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:14.218531 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3c65fd49-e0ff-41b4-97d9-4b02d1a491ad admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:14.221572 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3c65fd49-e0ff-41b4-97d9-4b02d1a491ad admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:14.222999 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-3c65fd49-e0ff-41b4-97d9-4b02d1a491ad admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/7ba11187-9880-4b52-8d1f-fef6b3837a8b HTTP/1.1" status: 204 len: 168 time: 0.1473579 Sep 18 08:43:14.234711 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c65fd49-e0ff-41b4-97d9-4b02d1a491ad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7ba11187-9880-4b52-8d1f-fef6b3837a8b,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:43:14.315335 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2acafb1-04cd-41e8-a281-c67ebe061c05 req-dd1b902b-3feb-4560-a808-c01534a185b6 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:14.316967 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b2acafb1-04cd-41e8-a281-c67ebe061c05 req-dd1b902b-3feb-4560-a808-c01534a185b6 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 945 time: 0.0519867 Sep 18 08:43:14.382797 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b2acafb1-04cd-41e8-a281-c67ebe061c05 req-c93f279f-d691-4e25-ab02-d70516f407ad tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0593195 Sep 18 08:43:14.636433 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 34804) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:43:14.650079 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a040966f-e4f9-4b60-93b8-849c4c5fc567 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:14.738093 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a83e9cc-c3b7-455f-bb80-ab494a4d78d6 req-a989e561-4250-4a8a-a34b-81fccdae80e9 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:14.739577 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7a83e9cc-c3b7-455f-bb80-ab494a4d78d6 req-a989e561-4250-4a8a-a34b-81fccdae80e9 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0694690 Sep 18 08:43:14.795617 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7a83e9cc-c3b7-455f-bb80-ab494a4d78d6 req-3e6ab131-27c8-484b-a00a-80102c236853 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0495753 Sep 18 08:43:14.807827 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a040966f-e4f9-4b60-93b8-849c4c5fc567 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:14.813753 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a040966f-e4f9-4b60-93b8-849c4c5fc567 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:14.851162 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-a040966f-e4f9-4b60-93b8-849c4c5fc567 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=0e4144cfd75f4d39901d2671401eeae5&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2134268 Sep 18 08:43:14.852975 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a040966f-e4f9-4b60-93b8-849c4c5fc567 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4c632315-dffb-4866-9f8e-89805e124c06,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:43:14.853839 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 34808) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:43:14.901407 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-7ca88712-d734-44b0-ae55-967f2e8865e4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:14.922339 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-7ca88712-d734-44b0-ae55-967f2e8865e4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:14.969327 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-7ca88712-d734-44b0-ae55-967f2e8865e4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:14.972358 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-7ca88712-d734-44b0-ae55-967f2e8865e4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:14.973508 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-7ca88712-d734-44b0-ae55-967f2e8865e4 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/4c632315-dffb-4866-9f8e-89805e124c06 HTTP/1.1" status: 204 len: 168 time: 0.1186297 Sep 18 08:43:14.980644 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ca88712-d734-44b0-ae55-967f2e8865e4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4c632315-dffb-4866-9f8e-89805e124c06,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:43:15.515649 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9be15f08-e5aa-4144-9f59-d8d614860fdb req-c6a9d56d-f982-4ea0-b6ad-1094d1097661 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:15.517308 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9be15f08-e5aa-4144-9f59-d8d614860fdb req-c6a9d56d-f982-4ea0-b6ad-1094d1097661 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 945 time: 0.0627937 Sep 18 08:43:15.558698 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9be15f08-e5aa-4144-9f59-d8d614860fdb req-934c5db5-1b98-41ea-9318-5d385465f546 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0353508 Sep 18 08:43:15.916126 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8c00c56-ec45-4555-84c0-a1b428369082 req-5a3d91e3-7249-425e-8be7-ff19fa0a3751 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:15.917688 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8c00c56-ec45-4555-84c0-a1b428369082 req-5a3d91e3-7249-425e-8be7-ff19fa0a3751 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0493455 Sep 18 08:43:15.956297 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8c00c56-ec45-4555-84c0-a1b428369082 req-08502dd6-d123-4203-94af-cb6eac33bbea tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0318296 Sep 18 08:43:16.690352 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9fbca87-872d-495d-94ee-d71a01e76fdc req-fc72dc87-f26b-4fca-94d8-07ff5c2edea9 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:16.691849 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b9fbca87-872d-495d-94ee-d71a01e76fdc req-fc72dc87-f26b-4fca-94d8-07ff5c2edea9 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 945 time: 0.0495842 Sep 18 08:43:16.730659 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b9fbca87-872d-495d-94ee-d71a01e76fdc req-c514b9d8-54dc-42cd-b272-6e7d98ef4183 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0329881 Sep 18 08:43:17.092871 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0efdcda-b299-40a4-bfa5-f77a987fe42a req-2080d7d2-dc56-483a-ba29-052525206060 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:17.094475 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c0efdcda-b299-40a4-bfa5-f77a987fe42a req-2080d7d2-dc56-483a-ba29-052525206060 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 1098 time: 0.0680952 Sep 18 08:43:17.134234 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35f1390d-f643-4a9e-aa02-71897ec2ea0a req-06c28d49-3466-4290-a87a-24bf6244a19c tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:17.135787 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-35f1390d-f643-4a9e-aa02-71897ec2ea0a req-06c28d49-3466-4290-a87a-24bf6244a19c tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0817485 Sep 18 08:43:17.159095 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c0efdcda-b299-40a4-bfa5-f77a987fe42a req-9c2c13a3-f96b-406e-ae17-e9a1f22bf0ef service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0565588 Sep 18 08:43:17.194462 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-35f1390d-f643-4a9e-aa02-71897ec2ea0a req-b62fb8af-af34-4fb9-9150-7aa53e8f3df2 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0492759 Sep 18 08:43:17.844443 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-311fe2d0-a849-49a0-84f8-eccd300afe8f req-a1ece3ec-db3c-4e73-a033-97084b3914a2 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:17.846209 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-311fe2d0-a849-49a0-84f8-eccd300afe8f req-a1ece3ec-db3c-4e73-a033-97084b3914a2 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 945 time: 0.0483720 Sep 18 08:43:17.882995 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-311fe2d0-a849-49a0-84f8-eccd300afe8f req-9cf4affd-0ebe-4651-bc3c-6ed893cdc3a2 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0309153 Sep 18 08:43:18.319685 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eda6c1e6-07df-4926-a1c7-7b7800ab1339 req-64c1aa9c-da6d-401f-82ad-6dbf0a1824fe tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:18.321184 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-eda6c1e6-07df-4926-a1c7-7b7800ab1339 req-64c1aa9c-da6d-401f-82ad-6dbf0a1824fe tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0552466 Sep 18 08:43:18.365979 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-eda6c1e6-07df-4926-a1c7-7b7800ab1339 req-439a295a-6aa4-4c74-934e-6bea179bd327 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0385988 Sep 18 08:43:19.002750 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b51d2977-b710-47e4-a735-666d32907461 req-748ccc75-48fd-4956-82c2-d396902fecc8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:19.005192 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b51d2977-b710-47e4-a735-666d32907461 req-748ccc75-48fd-4956-82c2-d396902fecc8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 945 time: 0.0512576 Sep 18 08:43:19.046891 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b51d2977-b710-47e4-a735-666d32907461 req-04e2c0f1-95a9-4a35-8d70-1c27b1810df5 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0320201 Sep 18 08:43:19.486510 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ba11793-67c3-4808-8f9b-8e6a591431b8 req-9bb44d64-121e-48db-9d82-96f2df16831f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:19.488090 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9ba11793-67c3-4808-8f9b-8e6a591431b8 req-9bb44d64-121e-48db-9d82-96f2df16831f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0487385 Sep 18 08:43:19.528925 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9ba11793-67c3-4808-8f9b-8e6a591431b8 req-5309f30f-7025-4bf9-9209-21cc9e7d2812 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0345333 Sep 18 08:43:19.605539 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-1570bd98-1b96-4ecf-b917-178a0f931470 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:19.950817 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:20.163624 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abaf2b08-ff8a-4a34-81d8-6dad286ceec4 req-ccd277ca-1e88-4ea5-b810-46eae014ca6f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:20.165008 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-abaf2b08-ff8a-4a34-81d8-6dad286ceec4 req-ccd277ca-1e88-4ea5-b810-46eae014ca6f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 945 time: 0.0503566 Sep 18 08:43:20.202905 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-abaf2b08-ff8a-4a34-81d8-6dad286ceec4 req-ef5c0cb9-9840-47d6-a6ab-325c063a6e29 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0312464 Sep 18 08:43:20.313853 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3c3be67-9e2f-4474-aa91-c3657d577a2c req-2c5dff58-dc53-4479-a60f-fc0610ca2014 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:20.315330 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d3c3be67-9e2f-4474-aa91-c3657d577a2c req-2c5dff58-dc53-4479-a60f-fc0610ca2014 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 945 time: 0.0479136 Sep 18 08:43:20.352679 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d3c3be67-9e2f-4474-aa91-c3657d577a2c req-e5bf1823-c1f3-4e3a-b6b6-7eb3a0c4871d tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0315242 Sep 18 08:43:20.376368 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 34950) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:43:20.560669 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f82c5652-9065-4ad2-929b-96d9ee88e587 tempest-TestVolumeBootPattern-848168784 tempest-TestVolumeBootPattern-848168784-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:20.565127 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-f82c5652-9065-4ad2-929b-96d9ee88e587 tempest-TestVolumeBootPattern-848168784 tempest-TestVolumeBootPattern-848168784-project-admin] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 1093 time: 0.1845348 Sep 18 08:43:20.565127 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 34960) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:43:20.569333 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-0733cc9f-d600-468d-8d81-d2b87ef530ec tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Request body: {'floatingip': {'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'port_id': '3f56fe96-8f0e-4410-8e3c-da651c794d50', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'fixed_ip_address': '172.20.0.5'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:43:20.600328 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0733cc9f-d600-468d-8d81-d2b87ef530ec tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for floatingip, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:20.658042 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67dd6542-b2b5-4a96-8a9c-f6daa6b7ba61 req-7d810fdf-81a8-4ac8-85b5-4be4926bcd43 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:20.659539 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-67dd6542-b2b5-4a96-8a9c-f6daa6b7ba61 req-7d810fdf-81a8-4ac8-85b5-4be4926bcd43 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0499392 Sep 18 08:43:20.703050 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-67dd6542-b2b5-4a96-8a9c-f6daa6b7ba61 req-25bbf547-7a1f-47c1-a122-581d20d3ed7a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0375400 Sep 18 08:43:20.703497 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0733cc9f-d600-468d-8d81-d2b87ef530ec tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:20.826517 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_common [None req-0733cc9f-d600-468d-8d81-d2b87ef530ec tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Allocated IP 172.27.1.145 (2e3b3f85-63e4-4380-917a-8c90c80b3e38/cd525bb9-7f93-490c-a5d6-a08911817e54/1fc79279-be7c-4418-b2a3-5afb8e38c589) {{(pid=94346) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:43:20.924880 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0733cc9f-d600-468d-8d81-d2b87ef530ec tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for port, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:20.957382 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0733cc9f-d600-468d-8d81-d2b87ef530ec tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:20.994568 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0733cc9f-d600-468d-8d81-d2b87ef530ec tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:43:20.997259 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-0733cc9f-d600-468d-8d81-d2b87ef530ec tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:43:21.001687 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0733cc9f-d600-468d-8d81-d2b87ef530ec tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Received port after_create {{(pid=94346) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:43:21.028291 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0733cc9f-d600-468d-8d81-d2b87ef530ec tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Pushing event updated for resources: {'Port': ['ID=1fc79279-be7c-4418-b2a3-5afb8e38c589,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:43:21.349114 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0733cc9f-d600-468d-8d81-d2b87ef530ec tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for floatingip, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:21.419564 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0733cc9f-d600-468d-8d81-d2b87ef530ec tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:21.565880 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0733cc9f-d600-468d-8d81-d2b87ef530ec tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for port, precommit_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:21.570550 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0733cc9f-d600-468d-8d81-d2b87ef530ec tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14290155'] for port, after_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:21.640026 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0733cc9f-d600-468d-8d81-d2b87ef530ec tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Pushing event updated for resources: {'Port': ['ID=1fc79279-be7c-4418-b2a3-5afb8e38c589,revision_number=2']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:43:21.647680 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0733cc9f-d600-468d-8d81-d2b87ef530ec tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-784908'] for floatingip, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:21.745007 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.db.l3_db [None req-0733cc9f-d600-468d-8d81-d2b87ef530ec tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Floating IP 4fbfe49e-e2af-4355-b7c5-c404ed6af093 associated. External IP: 172.27.1.145, port: 3f56fe96-8f0e-4410-8e3c-da651c794d50. Sep 18 08:43:21.826863 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5842e13c-bc6a-45f0-be22-13fc6b4672ca req-9344281d-51e1-49e0-a741-86a46560d586 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:21.829064 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5842e13c-bc6a-45f0-be22-13fc6b4672ca req-9344281d-51e1-49e0-a741-86a46560d586 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0519292 Sep 18 08:43:21.871934 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5842e13c-bc6a-45f0-be22-13fc6b4672ca req-21ced22d-c438-4943-ac46-9f882a97fc77 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0367956 Sep 18 08:43:21.963066 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0733cc9f-d600-468d-8d81-d2b87ef530ec tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Router 4922fc58-f2eb-480a-878f-2bc3f212b4da has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94346) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:43:22.290638 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0733cc9f-d600-468d-8d81-d2b87ef530ec tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94346) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:43:22.302081 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-544e0ed3-5716-41cf-a594-b17b2a351bf4 None None] Sync routers for ids ['4922fc58-f2eb-480a-878f-2bc3f212b4da'] in dv-cinder-804470-6-iscsi {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:43:22.307475 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0733cc9f-d600-468d-8d81-d2b87ef530ec tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for floatingip, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:22.313692 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-544e0ed3-5716-41cf-a594-b17b2a351bf4 None None] Routers {'4922fc58-f2eb-480a-878f-2bc3f212b4da'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:43:22.314311 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-544e0ed3-5716-41cf-a594-b17b2a351bf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:42:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['4922fc58-f2eb-480a-878f-2bc3f212b4da'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:43:22.333675 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-0733cc9f-d600-468d-8d81-d2b87ef530ec tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.7676067 Sep 18 08:43:22.334251 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5c332939-c954-4f64-97d5-07d5b2cb727d', 'tag': '3f56fe96-8f0e-4410-8e3c-da651c794d50'}] {{(pid=94346) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:43:22.336507 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9c65146fa140f7f105fbfe1cfc0ed8a4aa4ddea85af05f4a70363726e3aa059" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e06aef15-f866-4764-9def-2c2103a2b371" -d '{"events": [{"name": "network-changed", "server_uuid": "5c332939-c954-4f64-97d5-07d5b2cb727d", "tag": "3f56fe96-8f0e-4410-8e3c-da651c794d50"}]}' {{(pid=94346) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:43:22.374812 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:43:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4661b4d0-bd65-437e-9421-de9b9e997f75 x-openstack-request-id: req-4661b4d0-bd65-437e-9421-de9b9e997f75 {{(pid=94346) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:43:22.375107 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5c332939-c954-4f64-97d5-07d5b2cb727d", "tag": "3f56fe96-8f0e-4410-8e3c-da651c794d50", "status": "completed", "code": 200}]} {{(pid=94346) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:43:22.375359 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-4661b4d0-bd65-437e-9421-de9b9e997f75 {{(pid=94346) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:43:22.375751 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5c332939-c954-4f64-97d5-07d5b2cb727d', 'tag': '3f56fe96-8f0e-4410-8e3c-da651c794d50', 'status': 'completed', 'code': 200} Sep 18 08:43:22.421462 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-b5c664c9-5db6-4cc2-a383-ebec0efcddd8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:22.431394 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-544e0ed3-5716-41cf-a594-b17b2a351bf4 None None] Set router 4922fc58-f2eb-480a-878f-2bc3f212b4da gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:43:22.517442 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e06aef15-f866-4764-9def-2c2103a2b371 req-d9b44d5f-3425-4a0a-8a15-a42b31a20eec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:22.518988 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e06aef15-f866-4764-9def-2c2103a2b371 req-d9b44d5f-3425-4a0a-8a15-a42b31a20eec service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0c7c58787ad549afa94b716f4c2f187b&device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 1098 time: 0.0402253 Sep 18 08:43:22.614648 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e06aef15-f866-4764-9def-2c2103a2b371 req-6061626f-e97c-42c8-bb4e-782b927e4ce2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:22.616267 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e06aef15-f866-4764-9def-2c2103a2b371 req-6061626f-e97c-42c8-bb4e-782b927e4ce2 service neutron] 10.222.0.13 "GET /v2.0/networks?id=000f3583-b7de-458d-9146-0010cd28b00d HTTP/1.1" status: 200 len: 913 time: 0.0890713 Sep 18 08:43:22.660666 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-544e0ed3-5716-41cf-a594-b17b2a351bf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 4, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port': {'id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ad:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 474, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:54Z', 'updated_at': '2021-09-18T08:41:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': '4fbfe49e-e2af-4355-b7c5-c404ed6af093', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'floating_ip_address': '172.27.1.145', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'port_id': '3f56fe96-8f0e-4410-8e3c-da651c794d50', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 590, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'mac_address': 'fa:16:3e:44:d5:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c332939-c954-4f64-97d5-07d5b2cb727d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:43:21Z', 'updated_at': '2021-09-18T08:43:21Z', 'revision_number': 0, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4eb6aada-4647-4cc0-b357-a3113e1607e9', 'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'mac_address': 'fa:16:3e:49:34:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_interface', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:56Z', 'updated_at': '2021-09-18T08:42:01Z', 'revision_number': 5, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'subnets': [{'id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:43:22.681389 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e06aef15-f866-4764-9def-2c2103a2b371 req-3a48cec3-bd44-4eab-a1e4-4f906f7b5f36 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=3f56fe96-8f0e-4410-8e3c-da651c794d50 HTTP/1.1" status: 200 len: 999 time: 0.0574019 Sep 18 08:43:22.690634 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-544e0ed3-5716-41cf-a594-b17b2a351bf4 None None] Checking router: 4922fc58-f2eb-480a-878f-2bc3f212b4da for host: dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:43:22.698943 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-544e0ed3-5716-41cf-a594-b17b2a351bf4 None None] Routers {'4922fc58-f2eb-480a-878f-2bc3f212b4da'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:43:22.699595 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-544e0ed3-5716-41cf-a594-b17b2a351bf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:43:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['4922fc58-f2eb-480a-878f-2bc3f212b4da'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:43:22.731168 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e06aef15-f866-4764-9def-2c2103a2b371 req-f799e5a1-99b4-4d6d-a0cd-3fd7e1714c0d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:22.732701 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e06aef15-f866-4764-9def-2c2103a2b371 req-f799e5a1-99b4-4d6d-a0cd-3fd7e1714c0d service neutron] 10.222.0.13 "GET /v2.0/subnets?id=a4c047cf-cba6-4b94-8339-59469f96c92a HTTP/1.1" status: 200 len: 851 time: 0.0441494 Sep 18 08:43:22.781841 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e06aef15-f866-4764-9def-2c2103a2b371 req-dae775af-3d4f-4b5e-b484-e49cc282767e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:22.783328 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e06aef15-f866-4764-9def-2c2103a2b371 req-dae775af-3d4f-4b5e-b484-e49cc282767e service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=000f3583-b7de-458d-9146-0010cd28b00d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0427539 Sep 18 08:43:22.804584 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-544e0ed3-5716-41cf-a594-b17b2a351bf4 None None] Set router 4922fc58-f2eb-480a-878f-2bc3f212b4da gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:43:22.876292 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e06aef15-f866-4764-9def-2c2103a2b371 req-05fde109-5405-4063-9fd6-d785c1bbef7c service neutron] 10.222.0.13 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0845866 Sep 18 08:43:23.010220 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e06aef15-f866-4764-9def-2c2103a2b371 req-25c9f596-c8d9-43ec-88cc-0e7e8970ab97 service neutron] 10.222.0.13 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1246812 Sep 18 08:43:23.019180 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abb4584e-6a2f-4e97-a57d-060b2ddbc23f req-4ae4bd4e-6490-438f-a58a-bc1c14e9ec23 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:23.020622 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-abb4584e-6a2f-4e97-a57d-060b2ddbc23f req-4ae4bd4e-6490-438f-a58a-bc1c14e9ec23 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0650923 Sep 18 08:43:23.059428 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-abb4584e-6a2f-4e97-a57d-060b2ddbc23f req-a4efd13e-03c0-40c8-9f59-3d52116b7f4b tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0320299 Sep 18 08:43:23.158924 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-544e0ed3-5716-41cf-a594-b17b2a351bf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 4, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port': {'id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ad:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 474, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:54Z', 'updated_at': '2021-09-18T08:41:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': '4fbfe49e-e2af-4355-b7c5-c404ed6af093', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'floating_ip_address': '172.27.1.145', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'port_id': '3f56fe96-8f0e-4410-8e3c-da651c794d50', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 590, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'mac_address': 'fa:16:3e:44:d5:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c332939-c954-4f64-97d5-07d5b2cb727d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:43:21Z', 'updated_at': '2021-09-18T08:43:21Z', 'revision_number': 0, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4eb6aada-4647-4cc0-b357-a3113e1607e9', 'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'mac_address': 'fa:16:3e:49:34:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_interface', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:56Z', 'updated_at': '2021-09-18T08:42:01Z', 'revision_number': 5, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'subnets': [{'id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:43:23.195878 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-544e0ed3-5716-41cf-a594-b17b2a351bf4 None None] The sync data for ids ['4922fc58-f2eb-480a-878f-2bc3f212b4da'] in dv-cinder-804470-6-iscsi is: [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 4, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port': {'id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ad:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 474, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:54Z', 'updated_at': '2021-09-18T08:41:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': '4fbfe49e-e2af-4355-b7c5-c404ed6af093', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'floating_ip_address': '172.27.1.145', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'port_id': '3f56fe96-8f0e-4410-8e3c-da651c794d50', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 590, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'mac_address': 'fa:16:3e:44:d5:01', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5c332939-c954-4f64-97d5-07d5b2cb727d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:43:21Z', 'updated_at': '2021-09-18T08:43:21Z', 'revision_number': 0, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4eb6aada-4647-4cc0-b357-a3113e1607e9', 'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'mac_address': 'fa:16:3e:49:34:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_interface', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:56Z', 'updated_at': '2021-09-18T08:42:01Z', 'revision_number': 5, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'subnets': [{'id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:43:23.211004 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:23.343357 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:23.388950 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d63bdf38-b0a1-4061-af05-481aa6a09a30 None None] New status for floating IP 4fbfe49e-e2af-4355-b7c5-c404ed6af093: ACTIVE {{(pid=94349) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 18 08:43:24.177621 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bd5171e-b3b2-43b3-bff9-daae6ab119d0 req-13399c86-f538-4bd0-bd45-0c00f84072c3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:24.179080 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4bd5171e-b3b2-43b3-bff9-daae6ab119d0 req-13399c86-f538-4bd0-bd45-0c00f84072c3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0470662 Sep 18 08:43:24.214949 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4bd5171e-b3b2-43b3-bff9-daae6ab119d0 req-61efbbcf-1f70-4541-b0ec-d5dca7da3aeb tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0301325 Sep 18 08:43:24.868023 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:25.336048 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30f6e720-55b3-40f9-ab6d-e2d16b9304f9 req-6933ef5f-9ac3-4ddf-b964-ea8a47ca1a27 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:25.337574 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-30f6e720-55b3-40f9-ab6d-e2d16b9304f9 req-6933ef5f-9ac3-4ddf-b964-ea8a47ca1a27 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0517347 Sep 18 08:43:25.375413 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-30f6e720-55b3-40f9-ab6d-e2d16b9304f9 req-6425949e-31df-408b-a692-eb7c57d4605b tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0315118 Sep 18 08:43:26.496552 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7cd41d4-9225-4dbf-b441-7195479bab65 req-fac09068-db82-4518-b46c-287bfe5e6014 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:26.498075 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e7cd41d4-9225-4dbf-b441-7195479bab65 req-fac09068-db82-4518-b46c-287bfe5e6014 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0483017 Sep 18 08:43:26.535211 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e7cd41d4-9225-4dbf-b441-7195479bab65 req-646b737a-589b-4d63-ad1b-25cc7808ff94 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0312631 Sep 18 08:43:27.656008 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a67fa035-db8f-466c-93c7-fc5eecebf65f req-884f3a3b-c7e8-449f-ace0-5c714152afe0 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:27.657433 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a67fa035-db8f-466c-93c7-fc5eecebf65f req-884f3a3b-c7e8-449f-ace0-5c714152afe0 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0482388 Sep 18 08:43:27.694794 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a67fa035-db8f-466c-93c7-fc5eecebf65f req-ae78347d-bf66-4b54-a206-226acb100a36 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0313318 Sep 18 08:43:28.815954 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-409a6501-15bd-4470-bcd8-4b72a064f7d1 req-68e4769a-c2fc-4d3a-884b-0fe1856fd5af tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:28.817446 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-409a6501-15bd-4470-bcd8-4b72a064f7d1 req-68e4769a-c2fc-4d3a-884b-0fe1856fd5af tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0504944 Sep 18 08:43:28.853096 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-409a6501-15bd-4470-bcd8-4b72a064f7d1 req-2d4f3d00-4d7e-4823-bab7-9986519f049f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0296566 Sep 18 08:43:29.972689 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03ee702c-5040-4015-a097-917c901050f9 req-98975a88-1c3f-42e6-b6a1-4ff947a949d2 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:29.974197 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-03ee702c-5040-4015-a097-917c901050f9 req-98975a88-1c3f-42e6-b6a1-4ff947a949d2 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0484383 Sep 18 08:43:30.012071 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-03ee702c-5040-4015-a097-917c901050f9 req-f6a5a557-7d3d-4dc2-8c2b-4b47033c5891 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0317793 Sep 18 08:43:31.143897 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cdb4366-21d2-4776-9ebd-c7609eafe7fb req-2ee420d2-9b6a-4314-95fa-6db49abb2d77 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:31.145448 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3cdb4366-21d2-4776-9ebd-c7609eafe7fb req-2ee420d2-9b6a-4314-95fa-6db49abb2d77 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 944 time: 0.0505984 Sep 18 08:43:31.182183 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3cdb4366-21d2-4776-9ebd-c7609eafe7fb req-533a5b75-ba47-4c05-be6f-9c17312981dc tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0308132 Sep 18 08:43:31.970813 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 details requested by agent hyperv_hv-cinder-80447 with host hv-cinder-80447 {{(pid=94348) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 18 08:43:32.065102 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:43:32.075725 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Returning: {'device': '2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'port_id': '2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1', 'mac_address': 'fa:16:3e:de:30:b5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 214, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94348) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 18 08:43:32.117859 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:32.133407 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 {{(pid=94348) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:43:32.150243 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:43:32.155491 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:32.207029 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1,revision_number=9']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:43:32.214644 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:43:32.214772 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:43:32.215042 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:43:32.215385 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:43:32.215725 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:43:32.216580 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:43:32.216923 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:43:32.217277 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:43:32.217635 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:43:32.217975 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:43:32.218304 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:43:32.218632 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:43:32.311918 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d57d3677-2a2b-4d01-adf3-997bceca2126 req-64034edc-54a5-417c-a4fb-dbc2958aae2c tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:32.313514 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d57d3677-2a2b-4d01-adf3-997bceca2126 req-64034edc-54a5-417c-a4fb-dbc2958aae2c tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 945 time: 0.0530503 Sep 18 08:43:32.351105 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d57d3677-2a2b-4d01-adf3-997bceca2126 req-cdbff37d-db09-4a34-9ecc-963dd7a071e9 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0314989 Sep 18 08:43:32.615997 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:43:33.473286 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fc3ab4b-545b-41b5-97af-416e6d4a4429 req-ff13ea80-4bad-4fd8-be5b-4c5aa06eb172 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:33.474770 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0fc3ab4b-545b-41b5-97af-416e6d4a4429 req-ff13ea80-4bad-4fd8-be5b-4c5aa06eb172 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 945 time: 0.0508356 Sep 18 08:43:33.511651 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0fc3ab4b-545b-41b5-97af-416e6d4a4429 req-28911431-7db2-48ff-b39c-998d3ed5dd82 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0308037 Sep 18 08:43:33.972975 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 up at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:43:34.019332 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning complete for port 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:43:34.019710 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:34.094234 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:34.116046 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4248ac92-ce7b-4560-9f83-de05a7069a99', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:43:34.118197 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a08ed265-d635-48f1-8575-d42b1e179e45" -d '{"events": [{"server_uuid": "4248ac92-ce7b-4560-9f83-de05a7069a99", "name": "network-vif-plugged", "status": "completed", "tag": "2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:43:34.129871 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:43:34.134103 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:34.160126 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:43:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f3fab613-ba49-40e0-b798-8af255c30b8a x-openstack-request-id: req-f3fab613-ba49-40e0-b798-8af255c30b8a {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:43:34.160410 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4248ac92-ce7b-4560-9f83-de05a7069a99", "name": "network-vif-plugged", "status": "completed", "tag": "2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:43:34.160658 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-f3fab613-ba49-40e0-b798-8af255c30b8a {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:43:34.161042 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4248ac92-ce7b-4560-9f83-de05a7069a99', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1', 'code': 200} Sep 18 08:43:34.187297 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1,revision_number=10']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:43:34.640053 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0520adce-70b7-4551-88fd-2f121a525831 req-12cfad23-8c43-4ae8-a21a-5364da6f0139 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:34.641706 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0520adce-70b7-4551-88fd-2f121a525831 req-12cfad23-8c43-4ae8-a21a-5364da6f0139 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 947 time: 0.0524740 Sep 18 08:43:34.683073 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0520adce-70b7-4551-88fd-2f121a525831 req-e7819e7d-9089-4faa-b2c6-57c6c0d76ed1 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0340593 Sep 18 08:43:34.770160 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09244c88-2b46-4344-9afe-adb21647c740 req-272e67a2-425c-4263-98ab-19fcc1cdf4cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:34.772104 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-09244c88-2b46-4344-9afe-adb21647c740 req-272e67a2-425c-4263-98ab-19fcc1cdf4cc service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 1100 time: 0.0455930 Sep 18 08:43:34.812965 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-09244c88-2b46-4344-9afe-adb21647c740 req-5df654ac-e17a-4d2c-9057-9a594e3fa267 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0317688 Sep 18 08:43:35.802019 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b18585bc-511c-4f11-b80a-7015b56a162b req-96641dc2-829e-47ea-a305-560aa5aade92 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:35.803681 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b18585bc-511c-4f11-b80a-7015b56a162b req-96641dc2-829e-47ea-a305-560aa5aade92 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 947 time: 0.0474706 Sep 18 08:43:35.844010 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b18585bc-511c-4f11-b80a-7015b56a162b req-08901726-1169-4bf8-8349-da4caa742031 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0325410 Sep 18 08:43:36.966964 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0b8d1ef-76a2-41c4-a8b7-b3a918d560fb req-c8abdf98-975c-40db-8dc5-0e457f3f57e5 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:36.968466 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f0b8d1ef-76a2-41c4-a8b7-b3a918d560fb req-c8abdf98-975c-40db-8dc5-0e457f3f57e5 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 947 time: 0.0494692 Sep 18 08:43:37.008031 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f0b8d1ef-76a2-41c4-a8b7-b3a918d560fb req-3589ae31-ab89-4143-9efb-dbf38a445a44 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0332525 Sep 18 08:43:38.127476 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-142d9eda-0606-4446-b205-bb51f9aeebf8 req-0126cbc6-0063-4142-9dca-d4dbe66600fe tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:43:38.128978 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-142d9eda-0606-4446-b205-bb51f9aeebf8 req-0126cbc6-0063-4142-9dca-d4dbe66600fe tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 947 time: 0.0511034 Sep 18 08:43:38.165555 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-142d9eda-0606-4446-b205-bb51f9aeebf8 req-caa5bc95-4db3-4fee-a935-fa51303faaf6 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0305781 Sep 18 08:43:38.711550 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:43:49.605547 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-da615b65-a31a-4b23-a57b-e62f7dbde513 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:49.979915 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:52.401121 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-adc63224-c61c-4bc2-b6ed-6be13ef2a8dd None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:53.205160 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:53.344625 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:43:54.870197 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:12.297568 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 35424) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:44:12.398245 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d353d46f-2dae-4573-aa1d-65cbcf066f3a admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:12.483255 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d353d46f-2dae-4573-aa1d-65cbcf066f3a admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:12.486945 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d353d46f-2dae-4573-aa1d-65cbcf066f3a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:12.523571 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-d353d46f-2dae-4573-aa1d-65cbcf066f3a admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=bb3f8b291923428a86c8f148ec5bea48&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2249832 Sep 18 08:44:12.524400 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d353d46f-2dae-4573-aa1d-65cbcf066f3a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a5cf97de-84d6-4120-974c-2e6f8f94d6df,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:44:12.526313 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 35428) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:44:12.531328 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d353d46f-2dae-4573-aa1d-65cbcf066f3a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:12.531684 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d353d46f-2dae-4573-aa1d-65cbcf066f3a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:12.532037 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d353d46f-2dae-4573-aa1d-65cbcf066f3a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:12.532377 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d353d46f-2dae-4573-aa1d-65cbcf066f3a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:12.532715 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d353d46f-2dae-4573-aa1d-65cbcf066f3a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:12.533054 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d353d46f-2dae-4573-aa1d-65cbcf066f3a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:12.533411 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d353d46f-2dae-4573-aa1d-65cbcf066f3a admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:12.533741 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d353d46f-2dae-4573-aa1d-65cbcf066f3a admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:12.534071 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d353d46f-2dae-4573-aa1d-65cbcf066f3a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:12.534915 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d353d46f-2dae-4573-aa1d-65cbcf066f3a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:12.535243 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d353d46f-2dae-4573-aa1d-65cbcf066f3a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:12.535565 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d353d46f-2dae-4573-aa1d-65cbcf066f3a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:12.575262 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ff997387-cb21-4b5e-9837-31b433b162ef admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:12.595894 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ff997387-cb21-4b5e-9837-31b433b162ef admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:12.641339 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ff997387-cb21-4b5e-9837-31b433b162ef admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:12.643805 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ff997387-cb21-4b5e-9837-31b433b162ef admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:12.644976 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-ff997387-cb21-4b5e-9837-31b433b162ef admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/a5cf97de-84d6-4120-974c-2e6f8f94d6df HTTP/1.1" status: 204 len: 168 time: 0.1175969 Sep 18 08:44:12.652959 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff997387-cb21-4b5e-9837-31b433b162ef admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a5cf97de-84d6-4120-974c-2e6f8f94d6df,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:44:12.660496 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff997387-cb21-4b5e-9837-31b433b162ef admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:12.660855 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff997387-cb21-4b5e-9837-31b433b162ef admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:12.661225 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff997387-cb21-4b5e-9837-31b433b162ef admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:12.661586 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff997387-cb21-4b5e-9837-31b433b162ef admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:12.661928 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff997387-cb21-4b5e-9837-31b433b162ef admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:12.662266 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff997387-cb21-4b5e-9837-31b433b162ef admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:12.662604 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff997387-cb21-4b5e-9837-31b433b162ef admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:12.663021 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff997387-cb21-4b5e-9837-31b433b162ef admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:12.663274 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff997387-cb21-4b5e-9837-31b433b162ef admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:12.663608 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff997387-cb21-4b5e-9837-31b433b162ef admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:12.663935 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff997387-cb21-4b5e-9837-31b433b162ef admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:12.664259 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ff997387-cb21-4b5e-9837-31b433b162ef admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:13.243435 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 35456) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:44:13.345525 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-ba6f2d12-d7d2-4402-98c7-c41547228d54 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-1247078398-network', 'tenant_id': 'e54453321aba48dc881baeadd2c69473'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:44:13.365943 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ba6f2d12-d7d2-4402-98c7-c41547228d54 admin admin] Made reservation on behalf of e54453321aba48dc881baeadd2c69473 for: {'network': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:44:13.368277 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ba6f2d12-d7d2-4402-98c7-c41547228d54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for network, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:13.379143 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ba6f2d12-d7d2-4402-98c7-c41547228d54 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:13.464304 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ba6f2d12-d7d2-4402-98c7-c41547228d54 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:13.467907 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ba6f2d12-d7d2-4402-98c7-c41547228d54 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:13.488221 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ba6f2d12-d7d2-4402-98c7-c41547228d54 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 204} {{(pid=94346) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 18 08:44:13.502830 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba6f2d12-d7d2-4402-98c7-c41547228d54 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ac0c31fa-f384-4228-91ba-eb44fe1b2a70,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:44:13.506613 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ba6f2d12-d7d2-4402-98c7-c41547228d54 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:13.506958 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.db.segments_db [None req-ba6f2d12-d7d2-4402-98c7-c41547228d54 admin admin] Added segment 020db71b-b4f2-4e88-b835-5db154c945b2 of type vlan for network 344dbdfa-9f7e-4311-9160-286f3356d748 Sep 18 08:44:13.546143 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ba6f2d12-d7d2-4402-98c7-c41547228d54 admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732885226527'] for network, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:13.571712 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ba6f2d12-d7d2-4402-98c7-c41547228d54 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for network, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:13.572680 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ba6f2d12-d7d2-4402-98c7-c41547228d54 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:13.573304 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ba6f2d12-d7d2-4402-98c7-c41547228d54 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:13.604177 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-ba6f2d12-d7d2-4402-98c7-c41547228d54 admin admin] 10.222.0.35 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.3595469 Sep 18 08:44:13.607127 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 35464) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:44:13.612119 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-8dd9ce90-191f-405f-ad4e-cacffb62e6af admin admin] Request body: {'subnet': {'network_id': '344dbdfa-9f7e-4311-9160-286f3356d748', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-1247078398-subnet', 'tenant_id': 'e54453321aba48dc881baeadd2c69473', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:44:13.633767 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8dd9ce90-191f-405f-ad4e-cacffb62e6af admin admin] Made reservation on behalf of e54453321aba48dc881baeadd2c69473 for: {'subnet': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:44:13.636126 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8dd9ce90-191f-405f-ad4e-cacffb62e6af admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-13996252'] for subnet, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:13.636438 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba6f2d12-d7d2-4402-98c7-c41547228d54 admin admin] Pushing event updated for resources: {'Network': ['ID=344dbdfa-9f7e-4311-9160-286f3356d748,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:44:13.646887 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Network 344dbdfa-9f7e-4311-9160-286f3356d748 details requested by agent ovs-agent-dv-cinder-804470-6-iscsi with host dv-cinder-804470-6-iscsi {{(pid=94348) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 18 08:44:13.798986 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8dd9ce90-191f-405f-ad4e-cacffb62e6af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-15069167', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-13996274'] for subnet, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:13.850062 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8dd9ce90-191f-405f-ad4e-cacffb62e6af admin admin] Pushing event updated for resources: {'Subnet': ['ID=46d0ba5d-1c6d-4148-a267-3aba2885e5ce,revision_number=0']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:44:13.860998 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8dd9ce90-191f-405f-ad4e-cacffb62e6af admin admin] Checking segment: {'id': '020db71b-b4f2-4e88-b835-5db154c945b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 204, 'network_id': '344dbdfa-9f7e-4311-9160-286f3356d748'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94347) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:44:13.861391 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8dd9ce90-191f-405f-ad4e-cacffb62e6af admin admin] Network hostable DHCP agents. Network: 344dbdfa-9f7e-4311-9160-286f3356d748, hostable agents: ['6aaa6222-6d04-44a7-b807-bfc2cbd3e99f'], hosted agents: [] {{(pid=94347) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 18 08:44:13.877580 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8dd9ce90-191f-405f-ad4e-cacffb62e6af admin admin] Network 344dbdfa-9f7e-4311-9160-286f3356d748 is scheduled to be hosted by DHCP agent 6aaa6222-6d04-44a7-b807-bfc2cbd3e99f with binding_index 1 {{(pid=94347) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 18 08:44:13.886321 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [None req-8dd9ce90-191f-405f-ad4e-cacffb62e6af admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804470-6-iscsi, 344dbdfa-9f7e-4311-9160-286f3356d748) {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:44:13.890830 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8dd9ce90-191f-405f-ad4e-cacffb62e6af admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:13.891923 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8dd9ce90-191f-405f-ad4e-cacffb62e6af admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for subnet, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:13.895146 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3476696b-dd92-406d-bc33-bb94d8c1aadf None None] Network 344dbdfa-9f7e-4311-9160-286f3356d748 requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:44:13.905439 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-8dd9ce90-191f-405f-ad4e-cacffb62e6af admin admin] 10.222.0.35 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.2970715 Sep 18 08:44:14.017844 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-632bb187-cb08-40ee-a2ee-b27dc05eb895 None None] Network 344dbdfa-9f7e-4311-9160-286f3356d748 requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:44:15.638306 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-c576458f-8bb6-4dc6-a812-8d47640e717e tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:15.639706 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-c576458f-8bb6-4dc6-a812-8d47640e717e tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/networks?id=344dbdfa-9f7e-4311-9160-286f3356d748 HTTP/1.1" status: 200 len: 814 time: 0.1028974 Sep 18 08:44:15.654070 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-0969b545-341e-4702-a003-6e86eb8ecd8c tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/quotas/e54453321aba48dc881baeadd2c69473 HTTP/1.1" status: 200 len: 375 time: 0.0087211 Sep 18 08:44:15.683815 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-8f08772b-9998-4ecf-9b3c-be232299bedb tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?tenant_id=e54453321aba48dc881baeadd2c69473&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0247138 Sep 18 08:44:15.709668 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:44:15.820901 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-37587399-483d-4c69-aaff-5e54f2c06c7a service neutron] 10.222.0.35 "GET /v2.0/networks/344dbdfa-9f7e-4311-9160-286f3356d748?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1304429 Sep 18 08:44:15.908457 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-c6ac6cf3-e057-47e2-916e-cd90a01ca7be service neutron] 10.222.0.35 "GET /v2.0/networks/344dbdfa-9f7e-4311-9160-286f3356d748?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0811129 Sep 18 08:44:16.067187 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-488f3b5d-e940-498b-b4f6-149c62fb94ea req-f4a89fcc-bb18-48fd-a7ab-b1df06d84a3b tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 210 time: 0.0300765 Sep 18 08:44:16.792967 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 35526) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:44:16.896948 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-910a9535-fbcd-4ef9-89a4-fa458b9bc06b admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:16.985655 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-910a9535-fbcd-4ef9-89a4-fa458b9bc06b admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:16.989128 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-910a9535-fbcd-4ef9-89a4-fa458b9bc06b admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:17.028745 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-910a9535-fbcd-4ef9-89a4-fa458b9bc06b admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=c1c4af9d02e44b05a10657b57520a85b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2346506 Sep 18 08:44:17.029641 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-910a9535-fbcd-4ef9-89a4-fa458b9bc06b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=67793661-4a41-41b2-9a03-fb04ffc938b6,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:44:17.031329 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 35530) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:44:17.079445 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c07e229d-bc8e-460e-a11f-5610101c9d61 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:17.101020 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c07e229d-bc8e-460e-a11f-5610101c9d61 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:17.152118 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c07e229d-bc8e-460e-a11f-5610101c9d61 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:17.155332 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c07e229d-bc8e-460e-a11f-5610101c9d61 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:17.156583 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-c07e229d-bc8e-460e-a11f-5610101c9d61 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/67793661-4a41-41b2-9a03-fb04ffc938b6 HTTP/1.1" status: 204 len: 168 time: 0.1236575 Sep 18 08:44:17.164433 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c07e229d-bc8e-460e-a11f-5610101c9d61 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=67793661-4a41-41b2-9a03-fb04ffc938b6,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:44:17.204861 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e29e715b-0368-459c-842d-9dc4e2e9bf40 req-fc7323fe-7531-4a0a-b68f-865f34652dba tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 210 time: 0.0645833 Sep 18 08:44:17.291069 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-764fa0b8-2706-4bc2-a40f-63d560c0dfce tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:17.292554 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-764fa0b8-2706-4bc2-a40f-63d560c0dfce tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.13 "GET /v2.0/networks?id=344dbdfa-9f7e-4311-9160-286f3356d748 HTTP/1.1" status: 200 len: 814 time: 0.1412101 Sep 18 08:44:17.329306 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-f23ed747-137e-4d49-9079-98ec22184950 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Request body: {'port': {'device_id': '0b1a02ec-9f35-47ec-b701-8399f64c5c3d', 'network_id': '344dbdfa-9f7e-4311-9160-286f3356d748', 'admin_state_up': True, 'tenant_id': 'e54453321aba48dc881baeadd2c69473'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:44:17.437876 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-f23ed747-137e-4d49-9079-98ec22184950 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Made reservation on behalf of e54453321aba48dc881baeadd2c69473 for: {'port': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:44:17.442107 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-f23ed747-137e-4d49-9079-98ec22184950 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:17.573456 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_common [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-f23ed747-137e-4d49-9079-98ec22184950 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Allocated IP 172.20.0.6 (344dbdfa-9f7e-4311-9160-286f3356d748/46d0ba5d-1c6d-4148-a267-3aba2885e5ce/f09ac5bc-34a1-471b-8363-5a65f804d570) {{(pid=94347) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:44:17.722605 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-f23ed747-137e-4d49-9079-98ec22184950 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Notify callbacks [] for port, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:17.758012 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-f23ed747-137e-4d49-9079-98ec22184950 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:17.797707 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-f23ed747-137e-4d49-9079-98ec22184950 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Network 344dbdfa-9f7e-4311-9160-286f3356d748 is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:44:17.800622 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-f23ed747-137e-4d49-9079-98ec22184950 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:44:17.803197 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-f23ed747-137e-4d49-9079-98ec22184950 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Received port after_create {{(pid=94347) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:44:17.835024 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f23ed747-137e-4d49-9079-98ec22184950 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Pushing event updated for resources: {'Port': ['ID=f09ac5bc-34a1-471b-8363-5a65f804d570,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:44:17.862459 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-f23ed747-137e-4d49-9079-98ec22184950 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:17.863085 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-f23ed747-137e-4d49-9079-98ec22184950 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:17.877397 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-f23ed747-137e-4d49-9079-98ec22184950 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5522037 Sep 18 08:44:17.991701 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-399027bb-6acb-4966-8b9c-ef08f2c3de44 service neutron] Request body: {'port': {'device_id': '0b1a02ec-9f35-47ec-b701-8399f64c5c3d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80447'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:44:18.047233 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-399027bb-6acb-4966-8b9c-ef08f2c3de44 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:18.201784 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 35568) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:44:18.305307 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-95ea4713-359e-4eea-8a7e-f53fc0b1dd60 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:18.338887 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-399027bb-6acb-4966-8b9c-ef08f2c3de44 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f09ac5bc-34a1-471b-8363-5a65f804d570 {{(pid=94347) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:44:18.349665 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-399027bb-6acb-4966-8b9c-ef08f2c3de44 service neutron] Notify callbacks [] for port, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:18.373369 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc24d9fb-b53f-432f-8e98-9d2dac5e9e87 req-a29a1eb4-18b7-4afd-96d8-3a79744258ee tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:18.374855 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dc24d9fb-b53f-432f-8e98-9d2dac5e9e87 req-a29a1eb4-18b7-4afd-96d8-3a79744258ee tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 931 time: 0.0758598 Sep 18 08:44:18.375774 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.provisioning_blocks [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-399027bb-6acb-4966-8b9c-ef08f2c3de44 service neutron] Transition to ACTIVE for port object f09ac5bc-34a1-471b-8363-5a65f804d570 will not be triggered until provisioned by entity L2. {{(pid=94347) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 18 08:44:18.379737 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-399027bb-6acb-4966-8b9c-ef08f2c3de44 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:18.395229 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-95ea4713-359e-4eea-8a7e-f53fc0b1dd60 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:18.398988 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-95ea4713-359e-4eea-8a7e-f53fc0b1dd60 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:18.439418 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-95ea4713-359e-4eea-8a7e-f53fc0b1dd60 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=0a2451acfc2940bcab8e4b0baa1aadec&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2342706 Sep 18 08:44:18.439418 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95ea4713-359e-4eea-8a7e-f53fc0b1dd60 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f1d16e8f-04f1-4edc-b9af-ba28c6b9be92,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:44:18.440262 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 35574) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:44:18.459023 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dc24d9fb-b53f-432f-8e98-9d2dac5e9e87 req-4eb6fe34-0368-4bc8-be6f-d1c235782804 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0721512 Sep 18 08:44:18.482416 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-399027bb-6acb-4966-8b9c-ef08f2c3de44 service neutron] Pushing event updated for resources: {'Port': ['ID=f09ac5bc-34a1-471b-8363-5a65f804d570,revision_number=2']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:44:18.492040 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-2bcd7cc0-e5dc-453f-a3ae-6f534e2253da admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:18.512140 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-2bcd7cc0-e5dc-453f-a3ae-6f534e2253da admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:18.521763 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-399027bb-6acb-4966-8b9c-ef08f2c3de44 service neutron] Attempting to bind port f09ac5bc-34a1-471b-8363-5a65f804d570 on host hv-cinder-80447 for vnic_type normal with profile {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:44:18.522099 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-399027bb-6acb-4966-8b9c-ef08f2c3de44 service neutron] Attempting to bind port f09ac5bc-34a1-471b-8363-5a65f804d570 by drivers openvswitch,hyperv on host hv-cinder-80447 at level 0 using segments [{'id': '020db71b-b4f2-4e88-b835-5db154c945b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 204, 'network_id': '344dbdfa-9f7e-4311-9160-286f3356d748'}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:44:18.522426 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-399027bb-6acb-4966-8b9c-ef08f2c3de44 service neutron] Attempting to bind port f09ac5bc-34a1-471b-8363-5a65f804d570 on network 344dbdfa-9f7e-4311-9160-286f3356d748 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:44:18.526576 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-399027bb-6acb-4966-8b9c-ef08f2c3de44 service neutron] Port f09ac5bc-34a1-471b-8363-5a65f804d570 on network 344dbdfa-9f7e-4311-9160-286f3356d748 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80447 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 18 08:44:18.526899 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-399027bb-6acb-4966-8b9c-ef08f2c3de44 service neutron] Attempting to bind port f09ac5bc-34a1-471b-8363-5a65f804d570 on network 344dbdfa-9f7e-4311-9160-286f3356d748 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:44:18.531574 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-399027bb-6acb-4966-8b9c-ef08f2c3de44 service neutron] Checking agent: {'id': '8d51fdc4-974b-4200-9c3f-5dddea60a869', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80447', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'started_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 43, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:44:18.531910 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-399027bb-6acb-4966-8b9c-ef08f2c3de44 service neutron] Checking segment: {'id': '020db71b-b4f2-4e88-b835-5db154c945b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 204, 'network_id': '344dbdfa-9f7e-4311-9160-286f3356d748'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94347) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:44:18.532287 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-399027bb-6acb-4966-8b9c-ef08f2c3de44 service neutron] Bound using segment: {'id': '020db71b-b4f2-4e88-b835-5db154c945b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 204, 'network_id': '344dbdfa-9f7e-4311-9160-286f3356d748'} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:44:18.532704 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-399027bb-6acb-4966-8b9c-ef08f2c3de44 service neutron] Bound port: f09ac5bc-34a1-471b-8363-5a65f804d570, host: hv-cinder-80447, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '020db71b-b4f2-4e88-b835-5db154c945b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 204, 'network_id': '344dbdfa-9f7e-4311-9160-286f3356d748'}}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:44:18.533055 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-399027bb-6acb-4966-8b9c-ef08f2c3de44 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:18.557467 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-2bcd7cc0-e5dc-453f-a3ae-6f534e2253da admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:18.560051 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-2bcd7cc0-e5dc-453f-a3ae-6f534e2253da admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:18.561196 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-2bcd7cc0-e5dc-453f-a3ae-6f534e2253da admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/f1d16e8f-04f1-4edc-b9af-ba28c6b9be92 HTTP/1.1" status: 204 len: 168 time: 0.1200261 Sep 18 08:44:18.568916 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bcd7cc0-e5dc-453f-a3ae-6f534e2253da admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f1d16e8f-04f1-4edc-b9af-ba28c6b9be92,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:44:18.602199 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-399027bb-6acb-4966-8b9c-ef08f2c3de44 service neutron] For port f09ac5bc-34a1-471b-8363-5a65f804d570, host hv-cinder-80447, cleared binding levels {{(pid=94347) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:44:18.605373 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-399027bb-6acb-4966-8b9c-ef08f2c3de44 service neutron] For port f09ac5bc-34a1-471b-8363-5a65f804d570, host hv-cinder-80447, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=f09ac5bc-34a1-471b-8363-5a65f804d570,segment=NetworkSegment(020db71b-b4f2-4e88-b835-5db154c945b2),segment_id=020db71b-b4f2-4e88-b835-5db154c945b2)] {{(pid=94347) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:44:18.610261 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-399027bb-6acb-4966-8b9c-ef08f2c3de44 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:18.641928 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-399027bb-6acb-4966-8b9c-ef08f2c3de44 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:18.642536 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-399027bb-6acb-4966-8b9c-ef08f2c3de44 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:18.644213 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-399027bb-6acb-4966-8b9c-ef08f2c3de44 service neutron] 10.222.0.13 "PUT /v2.0/ports/f09ac5bc-34a1-471b-8363-5a65f804d570 HTTP/1.1" status: 200 len: 1093 time: 0.7479570 Sep 18 08:44:18.646402 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0b1a02ec-9f35-47ec-b701-8399f64c5c3d', 'tag': 'f09ac5bc-34a1-471b-8363-5a65f804d570'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:44:18.648621 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1c94c507-7b30-4694-b6e7-2ee6a4602dbc" -d '{"events": [{"name": "network-changed", "server_uuid": "0b1a02ec-9f35-47ec-b701-8399f64c5c3d", "tag": "f09ac5bc-34a1-471b-8363-5a65f804d570"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:44:18.677565 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-399027bb-6acb-4966-8b9c-ef08f2c3de44 service neutron] Pushing event updated for resources: {'Port': ['ID=f09ac5bc-34a1-471b-8363-5a65f804d570,revision_number=3']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:44:18.746143 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-4fd52963-272c-4181-a554-b9dfb4380df9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:18.747674 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-4fd52963-272c-4181-a554-b9dfb4380df9 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=e54453321aba48dc881baeadd2c69473&device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 1096 time: 0.0405171 Sep 18 08:44:18.801416 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-f10b302b-26ac-4a00-a64c-7cca29c80898 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=f09ac5bc-34a1-471b-8363-5a65f804d570 HTTP/1.1" status: 200 len: 217 time: 0.0379944 Sep 18 08:44:18.854607 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-32894699-ed61-45bc-b59d-a05b8c4bb29a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:18.856468 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-32894699-ed61-45bc-b59d-a05b8c4bb29a service neutron] 10.222.0.13 "GET /v2.0/subnets?id=46d0ba5d-1c6d-4148-a267-3aba2885e5ce HTTP/1.1" status: 200 len: 854 time: 0.0474744 Sep 18 08:44:18.888419 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:44:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-362a3457-9d81-4b3b-88a9-0e3b8a61995e x-openstack-request-id: req-362a3457-9d81-4b3b-88a9-0e3b8a61995e {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:44:18.888771 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0b1a02ec-9f35-47ec-b701-8399f64c5c3d", "tag": "f09ac5bc-34a1-471b-8363-5a65f804d570", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:44:18.889103 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-362a3457-9d81-4b3b-88a9-0e3b8a61995e {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:44:18.889517 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0b1a02ec-9f35-47ec-b701-8399f64c5c3d', 'tag': 'f09ac5bc-34a1-471b-8363-5a65f804d570', 'status': 'completed', 'code': 200} Sep 18 08:44:18.891677 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-b7424e48-da53-4863-b4a5-2641760d5f9f service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=344dbdfa-9f7e-4311-9160-286f3356d748&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0273161 Sep 18 08:44:19.239744 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-44f2728b-eca3-4bfa-a21d-74c90f5bcdeb service neutron] 10.222.0.13 "GET /v2.0/networks/344dbdfa-9f7e-4311-9160-286f3356d748?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3314359 Sep 18 08:44:19.327372 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-72f02edf-8333-45e1-bbb7-ed7786fc29f9 req-4476c21f-60f7-4d73-bb85-63cafb025f78 service neutron] 10.222.0.13 "GET /v2.0/networks/344dbdfa-9f7e-4311-9160-286f3356d748?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0802708 Sep 18 08:44:19.461170 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c94c507-7b30-4694-b6e7-2ee6a4602dbc req-5041f3c4-04ef-45a2-ba25-8e3a5c82c462 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:19.462818 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1c94c507-7b30-4694-b6e7-2ee6a4602dbc req-5041f3c4-04ef-45a2-ba25-8e3a5c82c462 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=e54453321aba48dc881baeadd2c69473&device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 1096 time: 0.0407743 Sep 18 08:44:19.594137 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c94c507-7b30-4694-b6e7-2ee6a4602dbc req-d0418116-bc7c-4a90-94e2-2348f787a537 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:19.595894 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1c94c507-7b30-4694-b6e7-2ee6a4602dbc req-d0418116-bc7c-4a90-94e2-2348f787a537 service neutron] 10.222.0.13 "GET /v2.0/networks?id=344dbdfa-9f7e-4311-9160-286f3356d748 HTTP/1.1" status: 200 len: 915 time: 0.1242065 Sep 18 08:44:19.605013 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35262b7a-1cb1-4050-b903-e1a4e4fa5f7f req-aa4f6450-c722-4163-b75b-485bf4b0ed7a tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:19.606562 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-35262b7a-1cb1-4050-b903-e1a4e4fa5f7f req-aa4f6450-c722-4163-b75b-485bf4b0ed7a tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 943 time: 0.0710974 Sep 18 08:44:19.616727 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-8674c568-1195-43c9-a1a2-17f4d1b4568d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:19.651241 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1c94c507-7b30-4694-b6e7-2ee6a4602dbc req-9c324d93-b7da-4ac0-99aa-28e8fde0a7d9 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=f09ac5bc-34a1-471b-8363-5a65f804d570 HTTP/1.1" status: 200 len: 217 time: 0.0437222 Sep 18 08:44:19.705783 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-35262b7a-1cb1-4050-b903-e1a4e4fa5f7f req-a160db57-190b-4212-a297-3cc85edee4e2 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0911355 Sep 18 08:44:19.716542 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c94c507-7b30-4694-b6e7-2ee6a4602dbc req-e96abe76-5f15-4427-a797-e02413cbc112 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:19.718010 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1c94c507-7b30-4694-b6e7-2ee6a4602dbc req-e96abe76-5f15-4427-a797-e02413cbc112 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=46d0ba5d-1c6d-4148-a267-3aba2885e5ce HTTP/1.1" status: 200 len: 854 time: 0.0586984 Sep 18 08:44:19.779033 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1c94c507-7b30-4694-b6e7-2ee6a4602dbc req-fadca565-e254-4024-b02a-847cc7c29cca service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=344dbdfa-9f7e-4311-9160-286f3356d748&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0316961 Sep 18 08:44:19.861139 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4bff22db-ce1b-4ef2-b982-ecfead02a121 req-cf60543a-d955-42ad-aad4-84c955787615 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1059227 Sep 18 08:44:19.887157 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1c94c507-7b30-4694-b6e7-2ee6a4602dbc req-d212c7d3-6913-470d-94b2-fdd80c6e0935 service neutron] 10.222.0.13 "GET /v2.0/networks/344dbdfa-9f7e-4311-9160-286f3356d748?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0906434 Sep 18 08:44:19.988938 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:20.008256 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bff22db-ce1b-4ef2-b982-ecfead02a121 req-3f59b4d6-251d-436e-b832-5a15b50d2665 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:20.009802 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4bff22db-ce1b-4ef2-b982-ecfead02a121 req-3f59b4d6-251d-436e-b832-5a15b50d2665 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0700a96e9b3f48e8b6bcdd75b820b813&device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 1100 time: 0.0860801 Sep 18 08:44:20.011629 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1c94c507-7b30-4694-b6e7-2ee6a4602dbc req-88529936-abe5-4228-be39-059fb44d0c85 service neutron] 10.222.0.13 "GET /v2.0/networks/344dbdfa-9f7e-4311-9160-286f3356d748?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1167324 Sep 18 08:44:20.124515 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bff22db-ce1b-4ef2-b982-ecfead02a121 req-f6a7012b-a980-44df-a4dd-9fa03ff734aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:20.126025 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4bff22db-ce1b-4ef2-b982-ecfead02a121 req-f6a7012b-a980-44df-a4dd-9fa03ff734aa service neutron] 10.222.0.13 "GET /v2.0/networks?id=f430397d-03a8-4da2-bd1d-25890a3a0727 HTTP/1.1" status: 200 len: 917 time: 0.0875874 Sep 18 08:44:20.190811 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4bff22db-ce1b-4ef2-b982-ecfead02a121 req-3c3b9268-abad-4cc5-8689-d4fd272b9f6c service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 HTTP/1.1" status: 200 len: 1002 time: 0.0549355 Sep 18 08:44:20.239872 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bff22db-ce1b-4ef2-b982-ecfead02a121 req-6f8b8f47-195a-476f-a900-fe393a06b824 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:20.241276 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4bff22db-ce1b-4ef2-b982-ecfead02a121 req-6f8b8f47-195a-476f-a900-fe393a06b824 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=acdeb8a1-5de9-425f-ae0a-890d310246e9 HTTP/1.1" status: 200 len: 855 time: 0.0417619 Sep 18 08:44:20.289372 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bff22db-ce1b-4ef2-b982-ecfead02a121 req-1ff4659a-1908-4b33-b44e-6be2f2e4d161 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:20.290798 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4bff22db-ce1b-4ef2-b982-ecfead02a121 req-1ff4659a-1908-4b33-b44e-6be2f2e4d161 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=f430397d-03a8-4da2-bd1d-25890a3a0727&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0407999 Sep 18 08:44:20.379297 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4bff22db-ce1b-4ef2-b982-ecfead02a121 req-a148eab0-afb4-4cf9-9430-60ec18ac8fb6 service neutron] 10.222.0.13 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0799055 Sep 18 08:44:20.473280 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4bff22db-ce1b-4ef2-b982-ecfead02a121 req-3eb2b1fb-cf5b-47ee-a015-99415723fd6d service neutron] 10.222.0.13 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0860312 Sep 18 08:44:20.826480 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-411cf91f-4955-4aac-bc10-e670a4e34ef3 req-f6b783d8-dd62-4aca-a99b-74ed45d41b5a tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:20.828279 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-411cf91f-4955-4aac-bc10-e670a4e34ef3 req-f6b783d8-dd62-4aca-a99b-74ed45d41b5a tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 943 time: 0.0505023 Sep 18 08:44:20.871556 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-411cf91f-4955-4aac-bc10-e670a4e34ef3 req-5e6484c3-c998-477f-af80-fb6c567ad002 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0358624 Sep 18 08:44:21.984000 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7fc0e42-e141-493a-a6aa-1a11e564cbb2 req-44d1b3ed-66b3-4d2c-a4da-96bb5b1d5f09 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:21.985521 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a7fc0e42-e141-493a-a6aa-1a11e564cbb2 req-44d1b3ed-66b3-4d2c-a4da-96bb5b1d5f09 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 943 time: 0.0474060 Sep 18 08:44:22.022020 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a7fc0e42-e141-493a-a6aa-1a11e564cbb2 req-556b7ed8-039c-4805-8c0e-728755b9780f tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0306516 Sep 18 08:44:22.401147 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-5a5d23fd-1a0e-4b16-a223-452a5b147f0f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:23.135868 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-142e010a-653a-4a25-9be6-2c88f33b8665 req-793ff489-2ccc-4f27-b479-25cfdf2f7e30 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:23.137333 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-142e010a-653a-4a25-9be6-2c88f33b8665 req-793ff489-2ccc-4f27-b479-25cfdf2f7e30 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 943 time: 0.0502293 Sep 18 08:44:23.172916 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-142e010a-653a-4a25-9be6-2c88f33b8665 req-c9669527-e9dc-42b0-b539-d1aa78f87954 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0298047 Sep 18 08:44:23.206152 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:23.347490 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:24.282431 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fe204ee-b582-4538-a270-d8107cc31d42 req-d1abc899-c6bb-4394-a53c-5db1ea3a42a6 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:24.283881 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6fe204ee-b582-4538-a270-d8107cc31d42 req-d1abc899-c6bb-4394-a53c-5db1ea3a42a6 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 943 time: 0.0465951 Sep 18 08:44:24.320229 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6fe204ee-b582-4538-a270-d8107cc31d42 req-6fabb609-ced7-427d-af98-24a9cef254a5 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0300541 Sep 18 08:44:24.873736 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:24.933950 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device f09ac5bc-34a1-471b-8363-5a65f804d570 details requested by agent hyperv_hv-cinder-80447 with host hv-cinder-80447 {{(pid=94348) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 18 08:44:25.025407 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port f09ac5bc-34a1-471b-8363-5a65f804d570, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=f09ac5bc-34a1-471b-8363-5a65f804d570,segment=NetworkSegment(020db71b-b4f2-4e88-b835-5db154c945b2),segment_id=020db71b-b4f2-4e88-b835-5db154c945b2)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:44:25.036377 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Returning: {'device': 'f09ac5bc-34a1-471b-8363-5a65f804d570', 'network_id': '344dbdfa-9f7e-4311-9160-286f3356d748', 'port_id': 'f09ac5bc-34a1-471b-8363-5a65f804d570', 'mac_address': 'fa:16:3e:f1:b8:a5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 204, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '46d0ba5d-1c6d-4148-a267-3aba2885e5ce', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94348) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 18 08:44:25.078047 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:25.090245 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f09ac5bc-34a1-471b-8363-5a65f804d570 {{(pid=94348) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:44:25.108701 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port f09ac5bc-34a1-471b-8363-5a65f804d570, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=f09ac5bc-34a1-471b-8363-5a65f804d570,segment=NetworkSegment(020db71b-b4f2-4e88-b835-5db154c945b2),segment_id=020db71b-b4f2-4e88-b835-5db154c945b2)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:44:25.112879 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:25.157477 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=f09ac5bc-34a1-471b-8363-5a65f804d570,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:44:25.442422 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19173143-b95a-4aee-9d59-9def862fbe4c req-40b2d200-8d0d-4993-bf20-5dd0308db455 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:25.443918 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-19173143-b95a-4aee-9d59-9def862fbe4c req-40b2d200-8d0d-4993-bf20-5dd0308db455 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 944 time: 0.0477431 Sep 18 08:44:25.481629 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-19173143-b95a-4aee-9d59-9def862fbe4c req-9df4510f-4b0a-46e8-a0e6-25b58212ea65 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0318098 Sep 18 08:44:25.680197 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['f09ac5bc-34a1-471b-8363-5a65f804d570'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:44:26.598627 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77d7bd91-a20b-451d-bdf3-716f0fd09798 req-d804eb5f-218a-4b76-b8e6-4d2bfaae92e6 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:26.600104 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-77d7bd91-a20b-451d-bdf3-716f0fd09798 req-d804eb5f-218a-4b76-b8e6-4d2bfaae92e6 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 944 time: 0.0514784 Sep 18 08:44:26.637820 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-77d7bd91-a20b-451d-bdf3-716f0fd09798 req-779d48c8-77f5-4358-a845-8478b25d4b96 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0317791 Sep 18 08:44:27.746149 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-036e1dfc-f234-4efc-8d5d-db22a2a98fc4 req-e863b491-6236-4855-b44d-38c7cbf0372a tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:27.747527 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-036e1dfc-f234-4efc-8d5d-db22a2a98fc4 req-e863b491-6236-4855-b44d-38c7cbf0372a tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 944 time: 0.0474312 Sep 18 08:44:27.784840 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-036e1dfc-f234-4efc-8d5d-db22a2a98fc4 req-cfdf9116-ff57-4c28-92e0-96775134ef0b tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0309777 Sep 18 08:44:27.957944 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7eb98aed-20f2-41d3-8406-43d89776a1d1 req-a4e09d2d-9454-41f8-9385-26e9dcbac9cf tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:27.959445 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7eb98aed-20f2-41d3-8406-43d89776a1d1 req-a4e09d2d-9454-41f8-9385-26e9dcbac9cf tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 985 time: 0.0479977 Sep 18 08:44:27.999102 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7eb98aed-20f2-41d3-8406-43d89776a1d1 req-e7c2be12-6e8a-4258-83f5-d4485ea82720 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&id=a1773be7-b5fe-42cf-af53-72ae4a128df3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0334978 Sep 18 08:44:28.900908 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b8c25cf-d2b3-4485-bc60-b92a53ca593a req-2ab1243d-ecd1-485d-9d5e-880ab288976e tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:28.902396 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1b8c25cf-d2b3-4485-bc60-b92a53ca593a req-2ab1243d-ecd1-485d-9d5e-880ab288976e tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 944 time: 0.0510998 Sep 18 08:44:28.938691 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1b8c25cf-d2b3-4485-bc60-b92a53ca593a req-a3989afb-95fe-4809-9988-666b9c5eb3dd tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0305555 Sep 18 08:44:29.111348 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb032e43-1115-45cc-a994-22909f32aea1 req-748ec0bc-67ff-4348-9e57-e43503254590 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:29.112775 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-eb032e43-1115-45cc-a994-22909f32aea1 req-748ec0bc-67ff-4348-9e57-e43503254590 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 985 time: 0.0481539 Sep 18 08:44:29.151935 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-eb032e43-1115-45cc-a994-22909f32aea1 req-e4b7a1a7-10f9-4a07-bdb6-2b83e9d92f26 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&id=a1773be7-b5fe-42cf-af53-72ae4a128df3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0332277 Sep 18 08:44:30.049529 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99ace45e-1155-4fda-932a-972e7cae0538 req-1914c081-177f-4f6b-982a-2be41a0596b2 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:30.051058 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-99ace45e-1155-4fda-932a-972e7cae0538 req-1914c081-177f-4f6b-982a-2be41a0596b2 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 944 time: 0.0474365 Sep 18 08:44:30.087338 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-99ace45e-1155-4fda-932a-972e7cae0538 req-b3a4ad6f-c67e-49f1-a7c3-e39317e3a996 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0306101 Sep 18 08:44:30.305791 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88795c54-a2f1-4451-ae10-cd1bfa52be89 req-1238c9ca-63e6-4428-a889-63c0e7c02ee0 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:30.307258 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-88795c54-a2f1-4451-ae10-cd1bfa52be89 req-1238c9ca-63e6-4428-a889-63c0e7c02ee0 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 985 time: 0.0907993 Sep 18 08:44:30.313148 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb086885-ad23-48a5-9bb4-28e0cefc8573 req-56666293-7c48-4efa-9090-d0fbe89c1e8f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:30.314539 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fb086885-ad23-48a5-9bb4-28e0cefc8573 req-56666293-7c48-4efa-9090-d0fbe89c1e8f service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=62a8d3b5ed4d4fe085db724f264e25c4&device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 1138 time: 0.0557830 Sep 18 08:44:30.363676 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-88795c54-a2f1-4451-ae10-cd1bfa52be89 req-bcebd40d-3e2a-4cdf-b1a1-c36bce15419b tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&id=a1773be7-b5fe-42cf-af53-72ae4a128df3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0481865 Sep 18 08:44:30.432267 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb086885-ad23-48a5-9bb4-28e0cefc8573 req-6897220f-cac8-4828-943e-e3c8d5b5eb0c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:30.433739 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fb086885-ad23-48a5-9bb4-28e0cefc8573 req-6897220f-cac8-4828-943e-e3c8d5b5eb0c service neutron] 10.222.0.13 "GET /v2.0/networks?id=48bd9423-5b85-4344-9434-17e10e227731 HTTP/1.1" status: 200 len: 916 time: 0.0942650 Sep 18 08:44:30.498182 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fb086885-ad23-48a5-9bb4-28e0cefc8573 req-286421bc-79a7-45a4-92aa-959213ab6f01 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a16828fd-b0f1-4ba0-a92a-61614fabe668 HTTP/1.1" status: 200 len: 1002 time: 0.0560849 Sep 18 08:44:30.551357 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb086885-ad23-48a5-9bb4-28e0cefc8573 req-ba79c398-482b-45e5-aa64-b05235b53c54 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:30.552828 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fb086885-ad23-48a5-9bb4-28e0cefc8573 req-ba79c398-482b-45e5-aa64-b05235b53c54 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=95fb2797-9ac9-40f9-9ea9-56d2c5a16291 HTTP/1.1" status: 200 len: 854 time: 0.0477390 Sep 18 08:44:30.601457 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb086885-ad23-48a5-9bb4-28e0cefc8573 req-55de19ad-1516-4df0-9c1a-806f72ba806c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:30.602974 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fb086885-ad23-48a5-9bb4-28e0cefc8573 req-55de19ad-1516-4df0-9c1a-806f72ba806c service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=48bd9423-5b85-4344-9434-17e10e227731&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0430067 Sep 18 08:44:30.690869 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fb086885-ad23-48a5-9bb4-28e0cefc8573 req-8eb1db11-f18d-4f04-a2bf-b70b6c8edcd9 service neutron] 10.222.0.13 "GET /v2.0/networks/48bd9423-5b85-4344-9434-17e10e227731?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0801456 Sep 18 08:44:30.782572 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fb086885-ad23-48a5-9bb4-28e0cefc8573 req-b2a14b1c-f20b-4520-bf3b-a41085101fdd service neutron] 10.222.0.13 "GET /v2.0/networks/48bd9423-5b85-4344-9434-17e10e227731?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0833759 Sep 18 08:44:31.198002 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1b2b42a-4e67-4c26-86d1-e7153ea7a8b1 req-9850f997-3d76-4349-a5b4-26e5695f4682 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:31.199463 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d1b2b42a-4e67-4c26-86d1-e7153ea7a8b1 req-9850f997-3d76-4349-a5b4-26e5695f4682 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 944 time: 0.0474260 Sep 18 08:44:31.236134 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d1b2b42a-4e67-4c26-86d1-e7153ea7a8b1 req-23e9bd5a-fc61-4afa-93d8-9ec90d7fec59 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0308285 Sep 18 08:44:31.475591 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f98435d-53f1-4d28-864a-6ec626b7d57f req-9a7598e9-b8c5-4ef8-ade4-f1d2cb90fd4c tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:31.477050 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6f98435d-53f1-4d28-864a-6ec626b7d57f req-9a7598e9-b8c5-4ef8-ade4-f1d2cb90fd4c tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 985 time: 0.0467193 Sep 18 08:44:31.515418 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6f98435d-53f1-4d28-864a-6ec626b7d57f req-e979dfad-c0a4-4a28-a038-5422c98d932d tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&id=a1773be7-b5fe-42cf-af53-72ae4a128df3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0323114 Sep 18 08:44:31.637517 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device f09ac5bc-34a1-471b-8363-5a65f804d570 up at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:44:31.684447 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning for port f09ac5bc-34a1-471b-8363-5a65f804d570 completed by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 18 08:44:31.688294 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning complete for port f09ac5bc-34a1-471b-8363-5a65f804d570 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:44:31.688745 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:31.761192 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:31.783172 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0b1a02ec-9f35-47ec-b701-8399f64c5c3d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f09ac5bc-34a1-471b-8363-5a65f804d570'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:44:31.786004 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-80084e11-bed0-4560-8d06-624d375b6ff6" -d '{"events": [{"server_uuid": "0b1a02ec-9f35-47ec-b701-8399f64c5c3d", "name": "network-vif-plugged", "status": "completed", "tag": "f09ac5bc-34a1-471b-8363-5a65f804d570"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:44:31.800705 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port f09ac5bc-34a1-471b-8363-5a65f804d570, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=f09ac5bc-34a1-471b-8363-5a65f804d570,segment=NetworkSegment(020db71b-b4f2-4e88-b835-5db154c945b2),segment_id=020db71b-b4f2-4e88-b835-5db154c945b2)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:44:31.805020 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:31.851762 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=f09ac5bc-34a1-471b-8363-5a65f804d570,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:44:31.951297 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:44:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-952005a3-337e-4ab7-990e-7b6679745e1c x-openstack-request-id: req-952005a3-337e-4ab7-990e-7b6679745e1c {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:44:31.951590 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0b1a02ec-9f35-47ec-b701-8399f64c5c3d", "name": "network-vif-plugged", "status": "completed", "tag": "f09ac5bc-34a1-471b-8363-5a65f804d570", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:44:31.951845 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-952005a3-337e-4ab7-990e-7b6679745e1c {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:44:31.952236 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0b1a02ec-9f35-47ec-b701-8399f64c5c3d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f09ac5bc-34a1-471b-8363-5a65f804d570', 'code': 200} Sep 18 08:44:32.351121 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7f9d339-0ec9-4faa-b12d-dae183dbb52b req-fad86994-a55d-4345-a0e0-9fb8e0eff868 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:32.352564 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b7f9d339-0ec9-4faa-b12d-dae183dbb52b req-fad86994-a55d-4345-a0e0-9fb8e0eff868 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 945 time: 0.0503318 Sep 18 08:44:32.388993 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b7f9d339-0ec9-4faa-b12d-dae183dbb52b req-13e9122d-6ef2-4164-a78c-6a86354198c9 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0306401 Sep 18 08:44:32.630537 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a272147b-96fb-425e-a2e2-4fdb88e5b2ca req-162a1913-aa69-4cc4-bc95-ea09a371a1c2 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:32.632008 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a272147b-96fb-425e-a2e2-4fdb88e5b2ca req-162a1913-aa69-4cc4-bc95-ea09a371a1c2 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 985 time: 0.0478079 Sep 18 08:44:32.671253 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a272147b-96fb-425e-a2e2-4fdb88e5b2ca req-5ba7b0d8-72b4-4deb-bb52-c62749df1840 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&id=a1773be7-b5fe-42cf-af53-72ae4a128df3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0333016 Sep 18 08:44:33.503809 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8064edda-abfc-4669-a954-817e8ddb16ba req-e1671657-626f-4265-820b-bf00f49970e1 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:33.505286 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8064edda-abfc-4669-a954-817e8ddb16ba req-e1671657-626f-4265-820b-bf00f49970e1 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 945 time: 0.0506330 Sep 18 08:44:33.541387 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8064edda-abfc-4669-a954-817e8ddb16ba req-d46f4c3e-8649-4ac1-b753-31819920eeec tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0302413 Sep 18 08:44:33.785573 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dbbea23-8400-465f-8c8f-b0d07512abbb req-5e6ec474-4a10-426b-b8d7-19a510164292 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:33.787020 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9dbbea23-8400-465f-8c8f-b0d07512abbb req-5e6ec474-4a10-426b-b8d7-19a510164292 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 985 time: 0.0507271 Sep 18 08:44:33.825680 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9dbbea23-8400-465f-8c8f-b0d07512abbb req-327287a1-246c-401e-b744-3ec3870e7c56 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&id=a1773be7-b5fe-42cf-af53-72ae4a128df3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0327477 Sep 18 08:44:34.650677 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c6c4f9a-ef09-4cc4-af5a-918f18c94fb2 req-508b6c01-2531-46b7-8934-2cfe8b92fe1a tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:34.652163 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7c6c4f9a-ef09-4cc4-af5a-918f18c94fb2 req-508b6c01-2531-46b7-8934-2cfe8b92fe1a tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 945 time: 0.0463500 Sep 18 08:44:34.692009 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7c6c4f9a-ef09-4cc4-af5a-918f18c94fb2 req-49827a68-0a74-4d0e-aa66-1b5f6761010f tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0341253 Sep 18 08:44:34.936755 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a51cef00-219b-4632-bd06-9975b87866d8 req-8e0c1ed3-af1d-4b4c-b30f-840d89b4c87c tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:34.938258 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a51cef00-219b-4632-bd06-9975b87866d8 req-8e0c1ed3-af1d-4b4c-b30f-840d89b4c87c tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 985 time: 0.0494435 Sep 18 08:44:34.977795 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a51cef00-219b-4632-bd06-9975b87866d8 req-7550e1e3-7d36-48b9-ad64-a7aed8f078ea tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&id=a1773be7-b5fe-42cf-af53-72ae4a128df3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0330949 Sep 18 08:44:35.680234 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56f9a582-48fe-4c44-b03f-b6ad0af765cc req-63923483-ba1c-44f9-8e52-86cd07789c8a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:35.681710 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-56f9a582-48fe-4c44-b03f-b6ad0af765cc req-63923483-ba1c-44f9-8e52-86cd07789c8a service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 1098 time: 0.0416951 Sep 18 08:44:35.715845 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-56f9a582-48fe-4c44-b03f-b6ad0af765cc req-6e39746a-0392-4d82-810a-a48306ec3e77 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0266495 Sep 18 08:44:35.801797 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29c20a47-cc1d-4852-9d47-77f26bca4b26 req-bbc60e58-2a2b-4d8b-b9ff-730ce1a5b747 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:35.803287 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-29c20a47-cc1d-4852-9d47-77f26bca4b26 req-bbc60e58-2a2b-4d8b-b9ff-730ce1a5b747 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 945 time: 0.0472686 Sep 18 08:44:35.840501 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-29c20a47-cc1d-4852-9d47-77f26bca4b26 req-0fa72a57-84ab-4c69-b449-a85517060e3f tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313818 Sep 18 08:44:36.090297 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fc28825-5375-440c-82d7-9376556cfec6 req-83a097db-4478-4e25-9b4d-c85485c3520b tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:36.091819 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2fc28825-5375-440c-82d7-9376556cfec6 req-83a097db-4478-4e25-9b4d-c85485c3520b tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 985 time: 0.0482461 Sep 18 08:44:36.131330 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2fc28825-5375-440c-82d7-9376556cfec6 req-f9264513-9b6d-425d-be94-7f30d4e6876e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&id=a1773be7-b5fe-42cf-af53-72ae4a128df3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0331721 Sep 18 08:44:36.957066 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2c9d454-587d-4521-9b80-7b1ad39c4428 req-53badf1e-195c-4e0c-a11d-804a95bcb89f tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:36.959357 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b2c9d454-587d-4521-9b80-7b1ad39c4428 req-53badf1e-195c-4e0c-a11d-804a95bcb89f tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 945 time: 0.0542722 Sep 18 08:44:37.001011 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b2c9d454-587d-4521-9b80-7b1ad39c4428 req-69529ed4-9fb4-41e5-887c-418df0b66b10 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0326033 Sep 18 08:44:37.242171 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48c27783-a5f3-42da-9d9b-5fd9b44391ac req-a5f85624-931a-4cac-83c5-68edf9dd8dbc tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:37.243638 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-48c27783-a5f3-42da-9d9b-5fd9b44391ac req-a5f85624-931a-4cac-83c5-68edf9dd8dbc tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 985 time: 0.0482752 Sep 18 08:44:37.282168 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-48c27783-a5f3-42da-9d9b-5fd9b44391ac req-ba9d89fa-4120-4807-93a5-93ba988b920a tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&id=a1773be7-b5fe-42cf-af53-72ae4a128df3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0326469 Sep 18 08:44:38.111025 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5dd9b76e-f28f-4fa7-bc5a-f388f0f93d33 req-5092f3f5-27b4-4fd9-a843-5c9ec4ae49bd tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:38.112553 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5dd9b76e-f28f-4fa7-bc5a-f388f0f93d33 req-5092f3f5-27b4-4fd9-a843-5c9ec4ae49bd tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 945 time: 0.0488656 Sep 18 08:44:38.177995 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5dd9b76e-f28f-4fa7-bc5a-f388f0f93d33 req-81b95629-2c13-4288-a2a1-8da4fa774a71 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0566823 Sep 18 08:44:38.190352 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c090c81-e3a3-4641-bc51-c4cd90173aa6 req-7f7c8144-94de-459b-b28e-0dffb38ffbff tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:38.192129 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3c090c81-e3a3-4641-bc51-c4cd90173aa6 req-7f7c8144-94de-459b-b28e-0dffb38ffbff tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 945 time: 0.0787072 Sep 18 08:44:38.234869 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3c090c81-e3a3-4641-bc51-c4cd90173aa6 req-454f0c24-8455-4300-bc4c-e815acdc62a6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0338006 Sep 18 08:44:38.402639 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec3d44c3-eb95-4910-8023-6e4098cabc48 req-f28e8b08-0f9f-4921-8138-14409b743365 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:38.404364 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ec3d44c3-eb95-4910-8023-6e4098cabc48 req-f28e8b08-0f9f-4921-8138-14409b743365 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 985 time: 0.0504432 Sep 18 08:44:38.446049 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ec3d44c3-eb95-4910-8023-6e4098cabc48 req-2b357748-42ac-4c86-8c86-e7d5279ce589 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&id=a1773be7-b5fe-42cf-af53-72ae4a128df3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0350199 Sep 18 08:44:39.307523 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e606115e-b5ac-4d6b-904a-f0e503684581 req-11b52c1f-39da-43c2-813d-568a0bbc2a32 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:39.309086 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e606115e-b5ac-4d6b-904a-f0e503684581 req-11b52c1f-39da-43c2-813d-568a0bbc2a32 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 945 time: 0.0540886 Sep 18 08:44:39.378607 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e606115e-b5ac-4d6b-904a-f0e503684581 req-076fcb85-d083-46f8-b0eb-08f97d02138b tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0629325 Sep 18 08:44:39.394544 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4c0ec0a-5855-4aad-a483-c59f0230cdb8 req-6044b263-7fd9-4be0-a83e-21e1a5ba503e tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:39.396006 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b4c0ec0a-5855-4aad-a483-c59f0230cdb8 req-6044b263-7fd9-4be0-a83e-21e1a5ba503e tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 945 time: 0.0793238 Sep 18 08:44:39.439433 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b4c0ec0a-5855-4aad-a483-c59f0230cdb8 req-dba6a4eb-efb5-485b-86bb-afd1448d9d3b tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0372763 Sep 18 08:44:39.571082 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90d5a881-1e6e-4dc2-a04d-1c8fdf55ef25 req-6f883919-1b69-4468-9bc5-295979fd6714 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:39.572645 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-90d5a881-1e6e-4dc2-a04d-1c8fdf55ef25 req-6f883919-1b69-4468-9bc5-295979fd6714 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 985 time: 0.0503993 Sep 18 08:44:39.613455 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-90d5a881-1e6e-4dc2-a04d-1c8fdf55ef25 req-ca30736e-a0d4-4fd5-9c0c-b99be6d9c253 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&id=a1773be7-b5fe-42cf-af53-72ae4a128df3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0347612 Sep 18 08:44:40.560977 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dcd7be6-670b-4062-8a1c-6691e4596463 req-387dc2eb-fe6b-4849-8068-851af547004d tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:40.562479 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4dcd7be6-670b-4062-8a1c-6691e4596463 req-387dc2eb-fe6b-4849-8068-851af547004d tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 945 time: 0.0480611 Sep 18 08:44:40.604141 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4dcd7be6-670b-4062-8a1c-6691e4596463 req-5182c0c9-9646-49e0-ad54-6d7247fd6070 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0357437 Sep 18 08:44:40.726702 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a87a95b4-50ae-4f82-ac42-d370e50b8388 req-c44cb8ff-9a8e-4e54-a3a1-587f71084afd tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:40.728190 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a87a95b4-50ae-4f82-ac42-d370e50b8388 req-c44cb8ff-9a8e-4e54-a3a1-587f71084afd tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 985 time: 0.0494459 Sep 18 08:44:40.768062 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a87a95b4-50ae-4f82-ac42-d370e50b8388 req-8bf606bc-e7a6-4bb4-b8ac-d4b6ff7bd0cb tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&id=a1773be7-b5fe-42cf-af53-72ae4a128df3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0338023 Sep 18 08:44:41.719514 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea0f55db-2df1-43f0-802a-c1a6927a6233 req-4d37dbce-33eb-42a2-a036-0660cb13acf3 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:41.721191 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ea0f55db-2df1-43f0-802a-c1a6927a6233 req-4d37dbce-33eb-42a2-a036-0660cb13acf3 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 945 time: 0.0509870 Sep 18 08:44:41.736158 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 35874) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:44:41.758745 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ea0f55db-2df1-43f0-802a-c1a6927a6233 req-71559199-c55f-4a58-8bc3-b712702f3b4e tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0312684 Sep 18 08:44:41.838582 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-eba0fb23-f2f4-4a75-a8b7-aa4232ba5711 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:41.886231 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d6f5b3b-4167-4068-935f-dc568d12d849 req-6f66c1a4-1cbd-432b-8c08-2925aa3cf287 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:41.888023 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5d6f5b3b-4167-4068-935f-dc568d12d849 req-6f66c1a4-1cbd-432b-8c08-2925aa3cf287 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 985 time: 0.0500214 Sep 18 08:44:41.937932 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5d6f5b3b-4167-4068-935f-dc568d12d849 req-6731fc4f-f074-4c64-9c71-6ef0d5045050 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&id=a1773be7-b5fe-42cf-af53-72ae4a128df3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0410001 Sep 18 08:44:41.941686 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-eba0fb23-f2f4-4a75-a8b7-aa4232ba5711 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:41.945325 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-eba0fb23-f2f4-4a75-a8b7-aa4232ba5711 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:41.982696 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-eba0fb23-f2f4-4a75-a8b7-aa4232ba5711 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=02d9746ccf6d4e58bd1416139147f380&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2453024 Sep 18 08:44:41.983726 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eba0fb23-f2f4-4a75-a8b7-aa4232ba5711 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=928f9f0e-4caa-424f-bf0f-bb4fb0493e10,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:44:41.985312 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 35882) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:44:42.033030 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a8198521-9bdf-4b4a-b111-c975ba78fc6e admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:42.053305 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a8198521-9bdf-4b4a-b111-c975ba78fc6e admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:42.102669 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a8198521-9bdf-4b4a-b111-c975ba78fc6e admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:42.105376 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a8198521-9bdf-4b4a-b111-c975ba78fc6e admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:42.106575 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-a8198521-9bdf-4b4a-b111-c975ba78fc6e admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/928f9f0e-4caa-424f-bf0f-bb4fb0493e10 HTTP/1.1" status: 204 len: 168 time: 0.1202135 Sep 18 08:44:42.114312 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8198521-9bdf-4b4a-b111-c975ba78fc6e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=928f9f0e-4caa-424f-bf0f-bb4fb0493e10,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:44:42.871641 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4173d7f8-82d1-488e-86a8-d9a0326ea45b req-24376f4d-aaa9-4251-89f8-3bcbe4223f9f tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:42.873135 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4173d7f8-82d1-488e-86a8-d9a0326ea45b req-24376f4d-aaa9-4251-89f8-3bcbe4223f9f tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 945 time: 0.0493672 Sep 18 08:44:42.909583 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4173d7f8-82d1-488e-86a8-d9a0326ea45b req-8d9cc6e3-209a-49d2-9c66-a76af9864ae6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0299869 Sep 18 08:44:43.055785 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1389279-b26d-44e6-9e46-13103502eae7 req-10535c97-731d-4fca-afd4-dcd56ebf99da tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:43.057280 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b1389279-b26d-44e6-9e46-13103502eae7 req-10535c97-731d-4fca-afd4-dcd56ebf99da tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 985 time: 0.0504735 Sep 18 08:44:43.100042 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b1389279-b26d-44e6-9e46-13103502eae7 req-4167ca82-749f-4ca5-aaaf-4814a4562dc1 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&id=a1773be7-b5fe-42cf-af53-72ae4a128df3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0358341 Sep 18 08:44:44.022439 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06a0d516-c36f-4807-990c-7eb2c9d01b92 req-4ae50b6f-00cf-45ea-a776-adcfb1d189a6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:44.023960 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-06a0d516-c36f-4807-990c-7eb2c9d01b92 req-4ae50b6f-00cf-45ea-a776-adcfb1d189a6 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 945 time: 0.0482686 Sep 18 08:44:44.060170 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-06a0d516-c36f-4807-990c-7eb2c9d01b92 req-14a756b7-5d29-4adb-af9f-7c76d2938bdf tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0303824 Sep 18 08:44:44.213720 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d92cb47-0a6d-40ad-b539-6fbaa1018021 req-3dd8024d-00c9-47db-91bf-17ff271a07de tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:44.215096 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5d92cb47-0a6d-40ad-b539-6fbaa1018021 req-3dd8024d-00c9-47db-91bf-17ff271a07de tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 985 time: 0.0472572 Sep 18 08:44:44.253507 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5d92cb47-0a6d-40ad-b539-6fbaa1018021 req-f1d58c4b-ff7c-4077-9751-e4bd2056fc77 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&id=a1773be7-b5fe-42cf-af53-72ae4a128df3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0318964 Sep 18 08:44:45.172992 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5ac821a-55ed-4914-b552-84848e0bb57a req-1518f63a-d488-4fb3-9fd3-74a33bef6e39 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:45.174459 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b5ac821a-55ed-4914-b552-84848e0bb57a req-1518f63a-d488-4fb3-9fd3-74a33bef6e39 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 945 time: 0.0496747 Sep 18 08:44:45.210291 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b5ac821a-55ed-4914-b552-84848e0bb57a req-5286124b-b20d-48fb-899c-ed69b3ac2d57 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0301702 Sep 18 08:44:45.364284 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5001d6e-3e74-497d-8554-d85f479a6f2c req-3d6b5913-28bd-4253-aded-65992204b6a0 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:45.365734 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d5001d6e-3e74-497d-8554-d85f479a6f2c req-3d6b5913-28bd-4253-aded-65992204b6a0 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 985 time: 0.0471356 Sep 18 08:44:45.404917 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d5001d6e-3e74-497d-8554-d85f479a6f2c req-015dbe9e-a6c0-425c-90c9-11fa53013f59 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&id=a1773be7-b5fe-42cf-af53-72ae4a128df3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0333152 Sep 18 08:44:46.320738 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9400b17-c016-423f-bb6f-ee67eaa2ed5f req-60647c47-eac7-479f-b842-d1404aa3cc9a tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:46.322235 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b9400b17-c016-423f-bb6f-ee67eaa2ed5f req-60647c47-eac7-479f-b842-d1404aa3cc9a tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 945 time: 0.0470388 Sep 18 08:44:46.358438 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b9400b17-c016-423f-bb6f-ee67eaa2ed5f req-1fc48668-4b96-44d2-889f-5a6499322170 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0304821 Sep 18 08:44:46.521237 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7333f5b4-2cda-41a8-8c57-6fe11c5cdb64 req-88c4003d-1f22-41d5-acd2-81985a75e182 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:46.522684 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7333f5b4-2cda-41a8-8c57-6fe11c5cdb64 req-88c4003d-1f22-41d5-acd2-81985a75e182 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 985 time: 0.0509424 Sep 18 08:44:46.561509 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7333f5b4-2cda-41a8-8c57-6fe11c5cdb64 req-92200015-e547-4229-ab10-add6bca110b3 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&id=a1773be7-b5fe-42cf-af53-72ae4a128df3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0328379 Sep 18 08:44:47.468484 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-415b8700-d662-4150-a46a-0c475dc028a9 req-ad2ebefc-f15b-4877-8fde-3e77fd61a056 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:47.470000 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-415b8700-d662-4150-a46a-0c475dc028a9 req-ad2ebefc-f15b-4877-8fde-3e77fd61a056 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 945 time: 0.0476978 Sep 18 08:44:47.507316 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-415b8700-d662-4150-a46a-0c475dc028a9 req-ec6cf4e0-bbb2-4721-80de-eba64888622c tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0312247 Sep 18 08:44:47.673055 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c471601e-5eaf-407d-b053-ae37d1e657d5 req-bdd1be05-4971-47c8-9df8-90a35e7567e4 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:47.674478 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c471601e-5eaf-407d-b053-ae37d1e657d5 req-bdd1be05-4971-47c8-9df8-90a35e7567e4 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 985 time: 0.0475044 Sep 18 08:44:47.712557 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c471601e-5eaf-407d-b053-ae37d1e657d5 req-4e041cb6-95a4-479c-9bf8-7a092922cee4 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&id=a1773be7-b5fe-42cf-af53-72ae4a128df3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0314617 Sep 18 08:44:48.588237 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b74f2e5-5222-4252-b8ac-3df74f521a4b req-77e68f31-158f-4340-9494-9b09ede57c21 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:48.589687 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9b74f2e5-5222-4252-b8ac-3df74f521a4b req-77e68f31-158f-4340-9494-9b09ede57c21 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=467aba0ce03e40a6927a5c05223dd512&device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 1098 time: 0.0521705 Sep 18 08:44:48.676186 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b47de4e-d893-4dcb-bc75-5b2ed981b933 req-1d38a908-bebf-417c-a505-b5fe7f7c6118 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:48.677709 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3b47de4e-d893-4dcb-bc75-5b2ed981b933 req-1d38a908-bebf-417c-a505-b5fe7f7c6118 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 945 time: 0.0998125 Sep 18 08:44:48.738013 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3b47de4e-d893-4dcb-bc75-5b2ed981b933 req-34fb5840-04b0-4384-9d72-d910cd2c52cd tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0535100 Sep 18 08:44:48.739211 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b74f2e5-5222-4252-b8ac-3df74f521a4b req-98b48590-2bcc-4989-99c2-8e92b0ebf6ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:48.741086 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9b74f2e5-5222-4252-b8ac-3df74f521a4b req-98b48590-2bcc-4989-99c2-8e92b0ebf6ec service neutron] 10.222.0.13 "GET /v2.0/networks?id=c81b2232-3aba-4f15-b8f1-a71826c8c1ca HTTP/1.1" status: 200 len: 909 time: 0.1346745 Sep 18 08:44:48.833197 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9b74f2e5-5222-4252-b8ac-3df74f521a4b req-00dc87dc-a3a5-4e33-a459-f2568e45796c service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=2f2f886e-b6d3-4d02-92de-a193d7d276f7 HTTP/1.1" status: 200 len: 1000 time: 0.0844557 Sep 18 08:44:48.845694 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83e81837-e95b-4d8a-a8fe-b24a37076deb req-8e623fef-60e5-452d-81e9-b9fb30fb19c8 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:48.847861 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-83e81837-e95b-4d8a-a8fe-b24a37076deb req-8e623fef-60e5-452d-81e9-b9fb30fb19c8 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 985 time: 0.0647016 Sep 18 08:44:48.919596 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b74f2e5-5222-4252-b8ac-3df74f521a4b req-0445e14a-f20a-410c-acdd-307ae8e004f5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:48.921064 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9b74f2e5-5222-4252-b8ac-3df74f521a4b req-0445e14a-f20a-410c-acdd-307ae8e004f5 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=58e9d53a-333d-4a2f-a575-92c9de3fb737 HTTP/1.1" status: 200 len: 847 time: 0.0723121 Sep 18 08:44:48.925326 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-83e81837-e95b-4d8a-a8fe-b24a37076deb req-8c1ebb34-11f9-4968-839e-f3d937702de4 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&id=a1773be7-b5fe-42cf-af53-72ae4a128df3&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0691752 Sep 18 08:44:48.966165 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b74f2e5-5222-4252-b8ac-3df74f521a4b req-34569231-8c81-4c2d-9ebd-51fd7b68d472 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:48.967639 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9b74f2e5-5222-4252-b8ac-3df74f521a4b req-34569231-8c81-4c2d-9ebd-51fd7b68d472 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=c81b2232-3aba-4f15-b8f1-a71826c8c1ca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0383680 Sep 18 08:44:49.061280 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9b74f2e5-5222-4252-b8ac-3df74f521a4b req-67826b2b-e4df-41a0-81c4-8e306640a776 service neutron] 10.222.0.13 "GET /v2.0/networks/c81b2232-3aba-4f15-b8f1-a71826c8c1ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0847332 Sep 18 08:44:49.152633 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9b74f2e5-5222-4252-b8ac-3df74f521a4b req-cc3531a1-c89d-4f62-8ddb-c590735e596d service neutron] 10.222.0.13 "GET /v2.0/networks/c81b2232-3aba-4f15-b8f1-a71826c8c1ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0819578 Sep 18 08:44:49.609224 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-00849828-b07b-426d-b2c9-cf5b817be95c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:49.852301 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b2bc41d-afd6-425d-9b41-a69fce0dc358 req-6aa32689-f17a-4438-9d76-1aa45d6c6218 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:49.853846 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7b2bc41d-afd6-425d-9b41-a69fce0dc358 req-6aa32689-f17a-4438-9d76-1aa45d6c6218 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 945 time: 0.0489120 Sep 18 08:44:49.895177 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7b2bc41d-afd6-425d-9b41-a69fce0dc358 req-b6eec6c7-4fc9-4e0b-b752-89d63f138f16 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0355253 Sep 18 08:44:50.002579 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:51.005496 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e75da11-22a6-4acd-96ee-fd3ff5e60599 req-40420d4b-1c92-4b43-9ecc-ab47f108a0a3 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:51.006972 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1e75da11-22a6-4acd-96ee-fd3ff5e60599 req-40420d4b-1c92-4b43-9ecc-ab47f108a0a3 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 945 time: 0.0470243 Sep 18 08:44:51.044333 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1e75da11-22a6-4acd-96ee-fd3ff5e60599 req-ec8b1472-7734-47a5-9dd1-6f9414ad2ce3 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0314922 Sep 18 08:44:52.160373 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e7e2ce5-f655-41b8-b85b-57c9df68e130 req-2e740e85-3daf-43db-a7ac-c0f412e1c56b tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:52.162004 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0e7e2ce5-f655-41b8-b85b-57c9df68e130 req-2e740e85-3daf-43db-a7ac-c0f412e1c56b tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 945 time: 0.0501559 Sep 18 08:44:52.201324 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0e7e2ce5-f655-41b8-b85b-57c9df68e130 req-c046dc62-e320-4aa3-8356-2cd79b190ffb tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0332725 Sep 18 08:44:52.375036 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-9bb5c295-b74d-471c-b07f-c5670b1a4ab7 req-117ae0f8-eead-429b-ae9b-d6a01c71776c service neutron] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0415435 Sep 18 08:44:52.402879 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-c84797e8-e32a-4f12-96d8-4bf900ef0c10 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:52.407484 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f88af445-2a89-40de-b001-2ad5ed211aae req-84625638-7882-4378-8030-73cfde3075fd tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:52.409008 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f88af445-2a89-40de-b001-2ad5ed211aae req-84625638-7882-4378-8030-73cfde3075fd tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 945 time: 0.0532551 Sep 18 08:44:52.451161 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f88af445-2a89-40de-b001-2ad5ed211aae req-31276fd3-cb2c-4409-9810-d4b417690067 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0357001 Sep 18 08:44:52.708751 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:44:53.206846 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:53.350359 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:53.565523 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a43b37ee-0e32-4b44-b683-656f9da39864 req-5cd81cbb-f225-4187-a922-762b605e5e3f tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:53.567566 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a43b37ee-0e32-4b44-b683-656f9da39864 req-5cd81cbb-f225-4187-a922-762b605e5e3f tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 945 time: 0.0483127 Sep 18 08:44:53.604078 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a43b37ee-0e32-4b44-b683-656f9da39864 req-75ed139d-4b2d-40c7-8d49-cfa3c81d7eaf tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0307779 Sep 18 08:44:54.715891 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a340ed5-3199-49dc-aa68-24c16ef9ca7c req-83cb66c9-67be-4ca5-b8e5-60766ef03128 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:54.717396 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2a340ed5-3199-49dc-aa68-24c16ef9ca7c req-83cb66c9-67be-4ca5-b8e5-60766ef03128 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 945 time: 0.0481348 Sep 18 08:44:54.756070 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2a340ed5-3199-49dc-aa68-24c16ef9ca7c req-0c08a82e-7081-4357-b596-6066d1951f8d tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0326283 Sep 18 08:44:54.876493 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:55.535758 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bb5c295-b74d-471c-b07f-c5670b1a4ab7 req-f21773bf-d517-4c36-a304-2e1eb61c5085 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:55.537175 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9bb5c295-b74d-471c-b07f-c5670b1a4ab7 req-f21773bf-d517-4c36-a304-2e1eb61c5085 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924&tenant_id=467aba0ce03e40a6927a5c05223dd512 HTTP/1.1" status: 200 len: 1098 time: 0.0387814 Sep 18 08:44:55.630655 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bb5c295-b74d-471c-b07f-c5670b1a4ab7 req-19e187fc-95d7-4aac-8ec0-29c735caeaf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:55.632119 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9bb5c295-b74d-471c-b07f-c5670b1a4ab7 req-19e187fc-95d7-4aac-8ec0-29c735caeaf3 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=467aba0ce03e40a6927a5c05223dd512&device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 1098 time: 0.0420666 Sep 18 08:44:55.719534 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bb5c295-b74d-471c-b07f-c5670b1a4ab7 req-98ed74aa-fb93-4fd6-9e4d-991adca9d6a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:55.721140 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9bb5c295-b74d-471c-b07f-c5670b1a4ab7 req-98ed74aa-fb93-4fd6-9e4d-991adca9d6a5 service neutron] 10.222.0.13 "GET /v2.0/networks?id=c81b2232-3aba-4f15-b8f1-a71826c8c1ca HTTP/1.1" status: 200 len: 909 time: 0.0809073 Sep 18 08:44:56.058372 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9bb5c295-b74d-471c-b07f-c5670b1a4ab7 req-78247f11-fb1b-455d-9c80-89d09e6f2cac service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=2f2f886e-b6d3-4d02-92de-a193d7d276f7 HTTP/1.1" status: 200 len: 1000 time: 0.3268995 Sep 18 08:44:56.070624 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ecebe3c-747a-45c3-b5b9-b781eb6d5151 req-92eef103-b1fc-4f99-a668-feb60de162d2 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:56.072008 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3ecebe3c-747a-45c3-b5b9-b781eb6d5151 req-92eef103-b1fc-4f99-a668-feb60de162d2 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 945 time: 0.0618505 Sep 18 08:44:56.138693 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bb5c295-b74d-471c-b07f-c5670b1a4ab7 req-a1e4de5d-b9cf-472a-a1e4-693ef8a626f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:56.140094 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9bb5c295-b74d-471c-b07f-c5670b1a4ab7 req-a1e4de5d-b9cf-472a-a1e4-693ef8a626f0 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=58e9d53a-333d-4a2f-a575-92c9de3fb737 HTTP/1.1" status: 200 len: 847 time: 0.0672688 Sep 18 08:44:56.143062 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3ecebe3c-747a-45c3-b5b9-b781eb6d5151 req-d6c0e1dd-6f8e-42ae-a367-e86b83e4fe23 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0632255 Sep 18 08:44:56.184652 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bb5c295-b74d-471c-b07f-c5670b1a4ab7 req-5901cf8e-0ba1-4132-bad8-46ae9f5bd2d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:56.186151 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9bb5c295-b74d-471c-b07f-c5670b1a4ab7 req-5901cf8e-0ba1-4132-bad8-46ae9f5bd2d9 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=c81b2232-3aba-4f15-b8f1-a71826c8c1ca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0373013 Sep 18 08:44:56.271067 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 2f2f886e-b6d3-4d02-92de-a193d7d276f7 no longer exists at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:44:56.275267 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9bb5c295-b74d-471c-b07f-c5670b1a4ab7 req-9ea86f9d-24eb-438b-a902-920fdb695969 service neutron] 10.222.0.13 "GET /v2.0/networks/c81b2232-3aba-4f15-b8f1-a71826c8c1ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0798252 Sep 18 08:44:56.345624 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:56.367274 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b6c407a6-4b6a-4479-911e-1c4620f28924', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '2f2f886e-b6d3-4d02-92de-a193d7d276f7'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:44:56.369522 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b2d44c4e-43b9-45eb-bd0c-19c0f613b320" -d '{"events": [{"server_uuid": "b6c407a6-4b6a-4479-911e-1c4620f28924", "name": "network-vif-unplugged", "status": "completed", "tag": "2f2f886e-b6d3-4d02-92de-a193d7d276f7"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:44:56.376731 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9bb5c295-b74d-471c-b07f-c5670b1a4ab7 req-debc51f0-3959-44ff-9111-fe10551459bd service neutron] 10.222.0.13 "GET /v2.0/networks/c81b2232-3aba-4f15-b8f1-a71826c8c1ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0843983 Sep 18 08:44:56.382631 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 2f2f886e-b6d3-4d02-92de-a193d7d276f7, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=2f2f886e-b6d3-4d02-92de-a193d7d276f7,segment=NetworkSegment(6dfc82da-1689-40bb-a749-6245f29bfd89),segment_id=6dfc82da-1689-40bb-a749-6245f29bfd89)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:44:56.386456 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:44:56.417943 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Sat, 18 Sep 2021 08:44:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f80f4c0c-87ea-4753-a9a6-b8230be70a3e x-openstack-request-id: req-f80f4c0c-87ea-4753-a9a6-b8230be70a3e {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:44:56.418256 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b6c407a6-4b6a-4479-911e-1c4620f28924", "name": "network-vif-unplugged", "status": "completed", "tag": "2f2f886e-b6d3-4d02-92de-a193d7d276f7", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:44:56.418510 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-f80f4c0c-87ea-4753-a9a6-b8230be70a3e {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:44:56.418892 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b6c407a6-4b6a-4479-911e-1c4620f28924', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '2f2f886e-b6d3-4d02-92de-a193d7d276f7', 'code': 200} Sep 18 08:44:56.434507 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=2f2f886e-b6d3-4d02-92de-a193d7d276f7,revision_number=6']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:44:56.441251 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:56.442197 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:56.442538 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:56.442872 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:56.443200 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:56.443529 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:56.443951 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:56.444176 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:56.444518 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:56.445070 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:56.445196 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:56.445676 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:44:57.254064 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b43622af-bb65-4958-a757-b98783dae072 req-81f7baa0-4c38-407e-8fe3-d63c4399eb7b tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:57.255508 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b43622af-bb65-4958-a757-b98783dae072 req-81f7baa0-4c38-407e-8fe3-d63c4399eb7b tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 943 time: 0.0476210 Sep 18 08:44:57.291980 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b43622af-bb65-4958-a757-b98783dae072 req-8f1cffe2-56b7-4084-8805-6ef8adc7470b tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0306365 Sep 18 08:44:58.405323 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e987c54-e02f-4cb7-be68-fa84e6e14a8b req-5d41de4b-c63e-41ee-b1cb-ce90465a0a07 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:58.406766 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7e987c54-e02f-4cb7-be68-fa84e6e14a8b req-5d41de4b-c63e-41ee-b1cb-ce90465a0a07 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 943 time: 0.0498266 Sep 18 08:44:58.443188 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7e987c54-e02f-4cb7-be68-fa84e6e14a8b req-b732f242-e829-42cd-8731-e02e89a8eef5 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0301075 Sep 18 08:44:59.552865 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d96381e-5616-445b-b22e-703901fa9b67 req-13c2c2b8-f3ed-4f0f-a66d-51f0cc4530cc tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:44:59.554346 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6d96381e-5616-445b-b22e-703901fa9b67 req-13c2c2b8-f3ed-4f0f-a66d-51f0cc4530cc tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 943 time: 0.0463176 Sep 18 08:44:59.590667 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6d96381e-5616-445b-b22e-703901fa9b67 req-7cfde82c-da28-4b77-a48a-e4ff06665e64 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0305469 Sep 18 08:45:00.699788 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01087dc1-99a2-4afe-897c-e37961440b50 req-2c2d48be-2769-471e-a29e-14c853b122f5 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:00.701292 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-01087dc1-99a2-4afe-897c-e37961440b50 req-2c2d48be-2769-471e-a29e-14c853b122f5 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 943 time: 0.0469208 Sep 18 08:45:00.738001 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-01087dc1-99a2-4afe-897c-e37961440b50 req-2dc064da-0e0c-4307-b37e-ad00cee11719 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0308912 Sep 18 08:45:02.064502 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7de016b0-a354-4f82-8079-554cd4b19814 req-63ddf9c1-761b-40d0-bbf1-2ca48b7fc500 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:02.065999 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7de016b0-a354-4f82-8079-554cd4b19814 req-63ddf9c1-761b-40d0-bbf1-2ca48b7fc500 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 943 time: 0.0508814 Sep 18 08:45:02.102830 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7de016b0-a354-4f82-8079-554cd4b19814 req-da166f43-c150-4f9f-a8db-61419de3f1c5 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0307004 Sep 18 08:45:03.215515 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e5a6019-7ae2-442b-a0d5-8ef332f7cc59 req-09d18c79-ce71-4e8a-8aab-3ec011ace408 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:03.216929 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6e5a6019-7ae2-442b-a0d5-8ef332f7cc59 req-09d18c79-ce71-4e8a-8aab-3ec011ace408 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 943 time: 0.0474195 Sep 18 08:45:03.254580 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6e5a6019-7ae2-442b-a0d5-8ef332f7cc59 req-d5c02250-1ff3-49e9-a6c6-12ac883c849e tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0309923 Sep 18 08:45:04.364846 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cec1b63-f802-4b4d-9e5c-eb516e1ce880 req-0a534761-3ea9-40ac-a760-aa39a5fdf768 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:04.366393 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6cec1b63-f802-4b4d-9e5c-eb516e1ce880 req-0a534761-3ea9-40ac-a760-aa39a5fdf768 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 943 time: 0.0472088 Sep 18 08:45:04.403299 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6cec1b63-f802-4b4d-9e5c-eb516e1ce880 req-078a5d74-8826-4dba-8372-39e5d08c5df7 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0311432 Sep 18 08:45:04.532704 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d793f8bc-54cf-4198-9186-c3320e70fe50 req-72e4a4f9-ed4a-4479-8b87-28fc6b0464d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:04.534112 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d793f8bc-54cf-4198-9186-c3320e70fe50 req-72e4a4f9-ed4a-4479-8b87-28fc6b0464d1 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 1096 time: 0.0415826 Sep 18 08:45:04.567809 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d793f8bc-54cf-4198-9186-c3320e70fe50 req-463b7a58-4b4c-4bcd-a452-e47f7a35aee3 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0259655 Sep 18 08:45:05.520858 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab8d2504-ae14-4295-8661-bf686821cf84 req-72248b74-fc9b-4187-bbb1-c32c4dbceb0c tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:05.522554 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ab8d2504-ae14-4295-8661-bf686821cf84 req-72248b74-fc9b-4187-bbb1-c32c4dbceb0c tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 943 time: 0.0501122 Sep 18 08:45:05.563548 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ab8d2504-ae14-4295-8661-bf686821cf84 req-2f796b00-2eba-43ea-a6e9-31f0d6dd34be tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0351872 Sep 18 08:45:06.314612 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 2f2f886e-b6d3-4d02-92de-a193d7d276f7 details requested by agent hyperv_hv-cinder-80447 with host hv-cinder-80447 {{(pid=94348) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 18 08:45:06.412205 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 2f2f886e-b6d3-4d02-92de-a193d7d276f7, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=2f2f886e-b6d3-4d02-92de-a193d7d276f7,segment=NetworkSegment(6dfc82da-1689-40bb-a749-6245f29bfd89),segment_id=6dfc82da-1689-40bb-a749-6245f29bfd89)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:45:06.423035 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Returning: {'device': '2f2f886e-b6d3-4d02-92de-a193d7d276f7', 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca', 'port_id': '2f2f886e-b6d3-4d02-92de-a193d7d276f7', 'mac_address': 'fa:16:3e:a6:2f:3c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 244, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '58e9d53a-333d-4a2f-a575-92c9de3fb737', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94348) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 18 08:45:06.459218 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:06.471648 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2f2f886e-b6d3-4d02-92de-a193d7d276f7 {{(pid=94348) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:45:06.490305 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 2f2f886e-b6d3-4d02-92de-a193d7d276f7, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=2f2f886e-b6d3-4d02-92de-a193d7d276f7,segment=NetworkSegment(6dfc82da-1689-40bb-a749-6245f29bfd89),segment_id=6dfc82da-1689-40bb-a749-6245f29bfd89)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:45:06.493825 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:06.540593 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=2f2f886e-b6d3-4d02-92de-a193d7d276f7,revision_number=7']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:45:06.683729 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2edda47b-6477-4514-95fd-4eae0c405796 req-71ba3efd-e4e7-4b7a-b325-3c7e2d844b9c tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:06.685256 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2edda47b-6477-4514-95fd-4eae0c405796 req-71ba3efd-e4e7-4b7a-b325-3c7e2d844b9c tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 944 time: 0.0529513 Sep 18 08:45:06.722572 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2edda47b-6477-4514-95fd-4eae0c405796 req-ab9deefd-9f62-475f-96f1-76b420bc53e3 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0313978 Sep 18 08:45:07.004708 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['2f2f886e-b6d3-4d02-92de-a193d7d276f7'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:45:08.326246 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 2f2f886e-b6d3-4d02-92de-a193d7d276f7 up at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:45:08.372382 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning complete for port 2f2f886e-b6d3-4d02-92de-a193d7d276f7 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:45:08.372757 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:08.446678 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:08.468173 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b6c407a6-4b6a-4479-911e-1c4620f28924', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2f2f886e-b6d3-4d02-92de-a193d7d276f7'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:45:08.470651 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1bc39738-f418-4e56-9892-f7a2925d394e" -d '{"events": [{"server_uuid": "b6c407a6-4b6a-4479-911e-1c4620f28924", "name": "network-vif-plugged", "status": "completed", "tag": "2f2f886e-b6d3-4d02-92de-a193d7d276f7"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:45:08.483370 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 2f2f886e-b6d3-4d02-92de-a193d7d276f7, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=2f2f886e-b6d3-4d02-92de-a193d7d276f7,segment=NetworkSegment(6dfc82da-1689-40bb-a749-6245f29bfd89),segment_id=6dfc82da-1689-40bb-a749-6245f29bfd89)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:45:08.487542 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:08.512073 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:45:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7e6d51eb-e541-442c-97e5-e3133c842419 x-openstack-request-id: req-7e6d51eb-e541-442c-97e5-e3133c842419 {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:45:08.512720 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b6c407a6-4b6a-4479-911e-1c4620f28924", "name": "network-vif-plugged", "status": "completed", "tag": "2f2f886e-b6d3-4d02-92de-a193d7d276f7", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:45:08.512720 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-7e6d51eb-e541-442c-97e5-e3133c842419 {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:45:08.513032 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b6c407a6-4b6a-4479-911e-1c4620f28924', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2f2f886e-b6d3-4d02-92de-a193d7d276f7', 'code': 200} Sep 18 08:45:08.538234 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=2f2f886e-b6d3-4d02-92de-a193d7d276f7,revision_number=8']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:45:18.521352 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5541480-dbaa-467d-98ed-641279bb29f8 req-8c2418f9-05f6-4f21-bdb2-6874b43da860 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:18.522836 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d5541480-dbaa-467d-98ed-641279bb29f8 req-8c2418f9-05f6-4f21-bdb2-6874b43da860 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 947 time: 0.0512316 Sep 18 08:45:18.560111 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d5541480-dbaa-467d-98ed-641279bb29f8 req-32df3756-22d3-4477-ba95-0c73b735cede tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0313768 Sep 18 08:45:19.610827 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-b893d7d2-2724-41ce-8f9f-940b0f15de64 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:19.679039 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efaa5586-93d2-4c68-9cae-4e28c0409214 req-2d83ca77-be1b-4f52-9f29-45fbd2a7d119 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:19.680522 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-efaa5586-93d2-4c68-9cae-4e28c0409214 req-2d83ca77-be1b-4f52-9f29-45fbd2a7d119 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 947 time: 0.0469332 Sep 18 08:45:19.716095 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-efaa5586-93d2-4c68-9cae-4e28c0409214 req-9f7e304e-e581-4942-abd4-7695a8983a86 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0297415 Sep 18 08:45:20.004042 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:20.832735 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-524b3c05-178e-4e12-99ae-25cd97a8e7aa req-a6154ab8-c5b2-4405-a2cb-a4ccdf67f895 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:20.834242 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-524b3c05-178e-4e12-99ae-25cd97a8e7aa req-a6154ab8-c5b2-4405-a2cb-a4ccdf67f895 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 947 time: 0.0479746 Sep 18 08:45:20.870310 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-524b3c05-178e-4e12-99ae-25cd97a8e7aa req-4f686c12-d3a4-4a77-b507-4e48d535e7b0 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0302947 Sep 18 08:45:21.990991 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b66c7ec-cbda-43ce-b9f0-8e43e033fa6d req-1f2a2c77-8cb2-48fc-820f-7e8a3d7f94de tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:21.992485 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3b66c7ec-cbda-43ce-b9f0-8e43e033fa6d req-1f2a2c77-8cb2-48fc-820f-7e8a3d7f94de tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 947 time: 0.0522466 Sep 18 08:45:22.029794 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3b66c7ec-cbda-43ce-b9f0-8e43e033fa6d req-ce0b009c-3e28-456d-a254-50321ba5b24d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0313849 Sep 18 08:45:22.407400 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-d50d7a33-26e4-4d29-83a5-b6331cdb07b4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:23.145193 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06d7f621-0054-44ce-920a-a8c1a53384af req-8f88be00-d601-46ea-a031-794d3b0a3d9c tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:23.146820 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-06d7f621-0054-44ce-920a-a8c1a53384af req-8f88be00-d601-46ea-a031-794d3b0a3d9c tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 947 time: 0.0474393 Sep 18 08:45:23.183440 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-06d7f621-0054-44ce-920a-a8c1a53384af req-41637eba-7c51-4a07-bd91-c1d533fb0fd2 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0308356 Sep 18 08:45:23.209086 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:23.355511 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:24.301200 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28458925-9f89-4419-bd04-ac7176ddf2d5 req-55df1aca-7ef9-438d-9c1e-0ed3ab73bd1b tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:24.302629 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-28458925-9f89-4419-bd04-ac7176ddf2d5 req-55df1aca-7ef9-438d-9c1e-0ed3ab73bd1b tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 947 time: 0.0468841 Sep 18 08:45:24.339344 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-28458925-9f89-4419-bd04-ac7176ddf2d5 req-618cc882-7fcc-4190-b521-00b9f74e94e6 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=45b78aa4-0988-48f2-8caf-b16f679dcdf8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0310390 Sep 18 08:45:24.599185 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-151bc654-cb44-431a-8471-945e046cc72d req-2de3efbd-ac17-406a-9432-85d1863a59a2 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:24.600660 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-151bc654-cb44-431a-8471-945e046cc72d req-2de3efbd-ac17-406a-9432-85d1863a59a2 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.13 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 947 time: 0.0506866 Sep 18 08:45:24.690352 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-151bc654-cb44-431a-8471-945e046cc72d req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Deleting port 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:45:24.690698 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-151bc654-cb44-431a-8471-945e046cc72d req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:24.779727 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-151bc654-cb44-431a-8471-945e046cc72d req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] For port 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:45:24.780084 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-151bc654-cb44-431a-8471-945e046cc72d req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:24.878562 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:24.991697 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-151bc654-cb44-431a-8471-945e046cc72d req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for floatingip, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:24.992056 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-151bc654-cb44-431a-8471-945e046cc72d req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-784908'] for floatingip, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:24.992373 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.db.l3_db [req-151bc654-cb44-431a-8471-945e046cc72d req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Floating IP d21371af-2110-4dca-8eb3-a92d09971467 disassociated. External IP: 172.27.1.138, port: 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1. Sep 18 08:45:24.992711 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-151bc654-cb44-431a-8471-945e046cc72d req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Calling delete_port for 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 owned by compute:nova {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:45:25.129311 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-151bc654-cb44-431a-8471-945e046cc72d req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:25.158356 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Pushing event deleted for resources: {'Port': ['ID=2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:45:25.167947 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:25.168301 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:25.168638 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:25.169007 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:25.169350 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:25.169688 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:25.170494 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:25.170494 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:25.170682 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:25.170970 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:25.171295 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:25.171617 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:25.280370 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.l3_agent_scheduler [req-151bc654-cb44-431a-8471-945e046cc72d req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Router 73ec8685-1119-4d34-a85d-af65c74d9e25 has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94347) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:45:25.385149 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-151bc654-cb44-431a-8471-945e046cc72d req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94347) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:45:25.394970 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-068520e3-efdb-4be9-a773-09fdc0120ea7 None None] Sync routers for ids ['73ec8685-1119-4d34-a85d-af65c74d9e25'] in dv-cinder-804470-6-iscsi {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:45:25.404286 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-068520e3-efdb-4be9-a773-09fdc0120ea7 None None] Routers {'73ec8685-1119-4d34-a85d-af65c74d9e25'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:45:25.404897 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-068520e3-efdb-4be9-a773-09fdc0120ea7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:45:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['73ec8685-1119-4d34-a85d-af65c74d9e25'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:45:25.427907 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-151bc654-cb44-431a-8471-945e046cc72d req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] No DVR routers for this DVR port 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 on host hv-cinder-80447 {{(pid=94347) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:45:25.436316 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-151bc654-cb44-431a-8471-945e046cc72d req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:25.438233 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-151bc654-cb44-431a-8471-945e046cc72d req-943b7cf8-9c93-4af1-bc41-5376eeb434dd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.13 "DELETE /v2.0/ports/2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 HTTP/1.1" status: 204 len: 173 time: 0.8299477 Sep 18 08:45:25.438668 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4248ac92-ce7b-4560-9f83-de05a7069a99', 'name': 'network-vif-deleted', 'tag': '2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:45:25.440867 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-78dc27a0-4c62-4c5a-9fde-7c3c482e678e" -d '{"events": [{"server_uuid": "4248ac92-ce7b-4560-9f83-de05a7069a99", "name": "network-vif-deleted", "tag": "2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:45:25.461564 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-81dfa158-0fce-4e94-a9aa-57cfbaef94cc req-c0b8cd5b-f1d7-49ea-b49a-02466e99887d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0360191 Sep 18 08:45:25.494030 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:45:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f110068c-a695-4ea9-9e55-3d7a700b57c2 x-openstack-request-id: req-f110068c-a695-4ea9-9e55-3d7a700b57c2 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:45:25.494326 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4248ac92-ce7b-4560-9f83-de05a7069a99", "name": "network-vif-deleted", "tag": "2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:45:25.494581 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-f110068c-a695-4ea9-9e55-3d7a700b57c2 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:45:25.494983 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4248ac92-ce7b-4560-9f83-de05a7069a99', 'name': 'network-vif-deleted', 'tag': '2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1', 'status': 'completed', 'code': 200} Sep 18 08:45:25.632674 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-068520e3-efdb-4be9-a773-09fdc0120ea7 None None] Set router 73ec8685-1119-4d34-a85d-af65c74d9e25 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:45:25.821887 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-068520e3-efdb-4be9-a773-09fdc0120ea7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'name': 'tempest-AttachVolumeShelveTestJSON-230900396-router', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12'}], 'enable_snat': True}, 'gw_port_id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:04Z', 'updated_at': '2021-09-18T08:38:12Z', 'revision_number': 4, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'gw_port': {'id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:ed:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:05Z', 'updated_at': '2021-09-18T08:38:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '09652b84-a3b3-476f-815f-f0c78f8543ba', 'name': '', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'mac_address': 'fa:16:3e:20:cb:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:10Z', 'updated_at': '2021-09-18T08:38:18Z', 'revision_number': 5, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'subnets': [{'id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:45:25.846961 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-068520e3-efdb-4be9-a773-09fdc0120ea7 None None] Checking router: 73ec8685-1119-4d34-a85d-af65c74d9e25 for host: dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:45:25.855435 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-068520e3-efdb-4be9-a773-09fdc0120ea7 None None] Routers {'73ec8685-1119-4d34-a85d-af65c74d9e25'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:45:25.856028 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-068520e3-efdb-4be9-a773-09fdc0120ea7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:45:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['73ec8685-1119-4d34-a85d-af65c74d9e25'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:45:25.960077 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-068520e3-efdb-4be9-a773-09fdc0120ea7 None None] Set router 73ec8685-1119-4d34-a85d-af65c74d9e25 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:45:26.159099 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-068520e3-efdb-4be9-a773-09fdc0120ea7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'name': 'tempest-AttachVolumeShelveTestJSON-230900396-router', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12'}], 'enable_snat': True}, 'gw_port_id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:04Z', 'updated_at': '2021-09-18T08:38:12Z', 'revision_number': 4, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'gw_port': {'id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:ed:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:05Z', 'updated_at': '2021-09-18T08:38:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '09652b84-a3b3-476f-815f-f0c78f8543ba', 'name': '', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'mac_address': 'fa:16:3e:20:cb:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:10Z', 'updated_at': '2021-09-18T08:38:18Z', 'revision_number': 5, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'subnets': [{'id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:45:26.185598 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-068520e3-efdb-4be9-a773-09fdc0120ea7 None None] The sync data for ids ['73ec8685-1119-4d34-a85d-af65c74d9e25'] in dv-cinder-804470-6-iscsi is: [{'id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'name': 'tempest-AttachVolumeShelveTestJSON-230900396-router', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12'}], 'enable_snat': True}, 'gw_port_id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:04Z', 'updated_at': '2021-09-18T08:38:12Z', 'revision_number': 4, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'gw_port': {'id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:ed:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:05Z', 'updated_at': '2021-09-18T08:38:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '09652b84-a3b3-476f-815f-f0c78f8543ba', 'name': '', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'mac_address': 'fa:16:3e:20:cb:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:10Z', 'updated_at': '2021-09-18T08:38:18Z', 'revision_number': 5, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'subnets': [{'id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:45:26.390388 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f5246c15-5284-4470-885b-e6b249b4c957 None None] New status for floating IP d21371af-2110-4dca-8eb3-a92d09971467: DOWN {{(pid=94349) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 18 08:45:26.568095 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-796a45ef-8738-425a-a753-75d8b97a927e req-b6050e79-d8f0-4419-9e66-8b6216a12aea tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0292034 Sep 18 08:45:27.660677 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e1c0f0c3-b31a-43be-a729-dde5c0aaf149 req-a2d035f8-9282-460a-8ca5-2295a7ebb7ec tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0244133 Sep 18 08:45:28.753910 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-93881a3a-8d87-494f-bafb-fdede7d93e28 req-df2f0642-9afe-42cf-ae80-f80dd989c679 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0241632 Sep 18 08:45:29.486254 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3f9cfdfe-615b-47df-a9e1-a8cc70e80e9a req-008cd6c4-5d73-4b56-a020-3b9398820f20 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0406468 Sep 18 08:45:29.579892 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f9cfdfe-615b-47df-a9e1-a8cc70e80e9a req-d07f713a-c1e4-469a-be21-4bcda30a0b79 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:29.581392 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3f9cfdfe-615b-47df-a9e1-a8cc70e80e9a req-d07f713a-c1e4-469a-be21-4bcda30a0b79 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=467aba0ce03e40a6927a5c05223dd512&device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 1098 time: 0.0389178 Sep 18 08:45:29.707614 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:45:29.875778 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-47486e34-2a3a-4bd6-b767-6ee68060371d req-b8db2242-8153-4538-899a-ed3562c722ae tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=4248ac92-ce7b-4560-9f83-de05a7069a99 HTTP/1.1" status: 200 len: 210 time: 0.0407805 Sep 18 08:45:29.934505 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 no longer exists at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:45:29.941196 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f9cfdfe-615b-47df-a9e1-a8cc70e80e9a req-7fa478b8-0190-4030-a9d7-2b267c4c60b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:29.942778 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3f9cfdfe-615b-47df-a9e1-a8cc70e80e9a req-7fa478b8-0190-4030-a9d7-2b267c4c60b7 service neutron] 10.222.0.13 "GET /v2.0/networks?id=c81b2232-3aba-4f15-b8f1-a71826c8c1ca HTTP/1.1" status: 200 len: 909 time: 0.1059496 Sep 18 08:45:29.953834 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] No Port match for: 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:45:29.954185 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 2b03ecbc-6a29-41b6-a87d-d2ebe235a1c1 not bound to the agent host hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:45:30.009566 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3f9cfdfe-615b-47df-a9e1-a8cc70e80e9a req-16046a90-1ae1-46cc-8ace-d3cd6b716957 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=2f2f886e-b6d3-4d02-92de-a193d7d276f7 HTTP/1.1" status: 200 len: 1000 time: 0.0566471 Sep 18 08:45:30.061675 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f9cfdfe-615b-47df-a9e1-a8cc70e80e9a req-bb6efe58-69fb-4dbb-b2e6-d9d40dda61e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:30.063009 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3f9cfdfe-615b-47df-a9e1-a8cc70e80e9a req-bb6efe58-69fb-4dbb-b2e6-d9d40dda61e8 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=58e9d53a-333d-4a2f-a575-92c9de3fb737 HTTP/1.1" status: 200 len: 847 time: 0.0458157 Sep 18 08:45:30.115650 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f9cfdfe-615b-47df-a9e1-a8cc70e80e9a req-a5070d4c-4b1b-4611-ad71-f387ae931cd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:30.117118 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3f9cfdfe-615b-47df-a9e1-a8cc70e80e9a req-a5070d4c-4b1b-4611-ad71-f387ae931cd7 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=c81b2232-3aba-4f15-b8f1-a71826c8c1ca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0388639 Sep 18 08:45:30.227420 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3f9cfdfe-615b-47df-a9e1-a8cc70e80e9a req-d5ca3afb-907d-4ae9-b488-dc962c516865 service neutron] 10.222.0.13 "GET /v2.0/networks/c81b2232-3aba-4f15-b8f1-a71826c8c1ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0928319 Sep 18 08:45:30.325421 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3f9cfdfe-615b-47df-a9e1-a8cc70e80e9a req-00ba5617-a457-43bb-a6d4-1ccd422b4027 service neutron] 10.222.0.13 "GET /v2.0/networks/c81b2232-3aba-4f15-b8f1-a71826c8c1ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0863161 Sep 18 08:45:30.963901 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 36172) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:45:31.020051 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-55545021-bef0-4aa0-8576-0c17867c2043 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:31.044021 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-55545021-bef0-4aa0-8576-0c17867c2043 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:31.090957 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-55545021-bef0-4aa0-8576-0c17867c2043 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:31.093468 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-55545021-bef0-4aa0-8576-0c17867c2043 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:31.094620 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-55545021-bef0-4aa0-8576-0c17867c2043 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "DELETE /v2.0/security-groups/45b78aa4-0988-48f2-8caf-b16f679dcdf8 HTTP/1.1" status: 204 len: 168 time: 0.1296973 Sep 18 08:45:31.097701 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 36174) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:45:31.103933 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55545021-bef0-4aa0-8576-0c17867c2043 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=45b78aa4-0988-48f2-8caf-b16f679dcdf8,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:45:31.110849 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55545021-bef0-4aa0-8576-0c17867c2043 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:31.111156 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.api.v2.resource [None req-acf48ef2-b558-495b-98cf-d9964beb8aaa tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] show failed (client error): The resource could not be found. Sep 18 08:45:31.111280 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55545021-bef0-4aa0-8576-0c17867c2043 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:31.111548 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55545021-bef0-4aa0-8576-0c17867c2043 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:31.111897 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55545021-bef0-4aa0-8576-0c17867c2043 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:31.112126 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-acf48ef2-b558-495b-98cf-d9964beb8aaa tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups/45b78aa4-0988-48f2-8caf-b16f679dcdf8 HTTP/1.1" status: 404 len: 347 time: 0.0127575 Sep 18 08:45:31.112355 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55545021-bef0-4aa0-8576-0c17867c2043 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:31.112560 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55545021-bef0-4aa0-8576-0c17867c2043 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:31.112906 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55545021-bef0-4aa0-8576-0c17867c2043 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:31.113266 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55545021-bef0-4aa0-8576-0c17867c2043 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:31.113609 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55545021-bef0-4aa0-8576-0c17867c2043 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:31.114004 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55545021-bef0-4aa0-8576-0c17867c2043 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:31.114883 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55545021-bef0-4aa0-8576-0c17867c2043 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:31.115230 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-55545021-bef0-4aa0-8576-0c17867c2043 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:31.115358 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 36176) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:45:31.243041 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-df651bd1-6883-4a6b-a5c6-737be01bc0c6 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Deleting port 3ccf98ca-0f0c-4ff7-905d-66e17f9de63d {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:45:31.243303 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-df651bd1-6883-4a6b-a5c6-737be01bc0c6 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:31.318234 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-df651bd1-6883-4a6b-a5c6-737be01bc0c6 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:31.318563 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-df651bd1-6883-4a6b-a5c6-737be01bc0c6 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:31.329661 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-df651bd1-6883-4a6b-a5c6-737be01bc0c6 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Calling delete_port for 3ccf98ca-0f0c-4ff7-905d-66e17f9de63d owned by network:floatingip {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:45:31.459120 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-df651bd1-6883-4a6b-a5c6-737be01bc0c6 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:31.486686 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df651bd1-6883-4a6b-a5c6-737be01bc0c6 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Pushing event deleted for resources: {'Port': ['ID=3ccf98ca-0f0c-4ff7-905d-66e17f9de63d,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:45:31.548097 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-df651bd1-6883-4a6b-a5c6-737be01bc0c6 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for floatingip, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:31.550561 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-df651bd1-6883-4a6b-a5c6-737be01bc0c6 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for floatingip, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:31.551721 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-df651bd1-6883-4a6b-a5c6-737be01bc0c6 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "DELETE /v2.0/floatingips/d21371af-2110-4dca-8eb3-a92d09971467 HTTP/1.1" status: 204 len: 168 time: 0.4354987 Sep 18 08:45:31.773775 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 36182) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:45:31.778553 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-897df906-8cb3-4ebb-a2c9-dc830ede8ce0 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1121578208', 'description': 'tempest-description--1229566009'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:45:31.800253 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-897df906-8cb3-4ebb-a2c9-dc830ede8ce0 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:31.879225 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-897df906-8cb3-4ebb-a2c9-dc830ede8ce0 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:31.883661 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-897df906-8cb3-4ebb-a2c9-dc830ede8ce0 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:31.910639 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-897df906-8cb3-4ebb-a2c9-dc830ede8ce0 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:31.911840 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-897df906-8cb3-4ebb-a2c9-dc830ede8ce0 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1780 time: 0.1370091 Sep 18 08:45:31.913698 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-897df906-8cb3-4ebb-a2c9-dc830ede8ce0 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e7f06e93-d80d-42c8-881f-6fdba5709870,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:45:31.914798 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 36188) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:45:31.919536 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-9f8f8377-644c-464d-8f35-850db9b85194 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Request body: {'security_group_rule': {'security_group_id': 'e7f06e93-d80d-42c8-881f-6fdba5709870', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:45:31.947445 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9f8f8377-644c-464d-8f35-850db9b85194 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:32.002097 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9f8f8377-644c-464d-8f35-850db9b85194 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:32.006812 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9f8f8377-644c-464d-8f35-850db9b85194 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-561193'] for security_group_rule, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:32.025431 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f8f8377-644c-464d-8f35-850db9b85194 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4e212a5d-4189-4ec2-b9c5-3fa3fbc38dac,revision_number=0']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:45:32.031633 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9f8f8377-644c-464d-8f35-850db9b85194 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:32.032830 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-9f8f8377-644c-464d-8f35-850db9b85194 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1169667 Sep 18 08:45:32.035590 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 36190) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:45:32.041448 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-748e8111-c0f7-4732-8e87-35e98d6b9145 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Request body: {'security_group_rule': {'security_group_id': 'e7f06e93-d80d-42c8-881f-6fdba5709870', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:45:32.067793 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-748e8111-c0f7-4732-8e87-35e98d6b9145 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:32.124788 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-748e8111-c0f7-4732-8e87-35e98d6b9145 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:32.128064 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-748e8111-c0f7-4732-8e87-35e98d6b9145 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-561193'] for security_group_rule, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:32.144332 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-748e8111-c0f7-4732-8e87-35e98d6b9145 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9f2f23e7-d5c8-4ddb-9f55-6dba0c30f1f9,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:45:32.150778 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-748e8111-c0f7-4732-8e87-35e98d6b9145 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:32.152107 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-748e8111-c0f7-4732-8e87-35e98d6b9145 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1147959 Sep 18 08:45:32.155146 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 36192) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:45:32.159348 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-3b7a39db-0c7c-4130-ac24-f7bb60204f1f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Request body: {'floatingip': {'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:45:32.179864 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3b7a39db-0c7c-4130-ac24-f7bb60204f1f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for floatingip, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:32.271567 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3b7a39db-0c7c-4130-ac24-f7bb60204f1f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:32.373837 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_common [None req-3b7a39db-0c7c-4130-ac24-f7bb60204f1f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Allocated IP 172.27.1.181 (2e3b3f85-63e4-4380-917a-8c90c80b3e38/cd525bb9-7f93-490c-a5d6-a08911817e54/10b805c8-108c-465a-b611-eda31f7e98fc) {{(pid=94346) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:45:32.470867 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3b7a39db-0c7c-4130-ac24-f7bb60204f1f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for port, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:32.501530 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3b7a39db-0c7c-4130-ac24-f7bb60204f1f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:32.540814 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3b7a39db-0c7c-4130-ac24-f7bb60204f1f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:45:32.543483 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-3b7a39db-0c7c-4130-ac24-f7bb60204f1f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:45:32.548883 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3b7a39db-0c7c-4130-ac24-f7bb60204f1f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Received port after_create {{(pid=94346) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:45:32.554212 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b7a39db-0c7c-4130-ac24-f7bb60204f1f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Pushing event updated for resources: {'Port': ['ID=10b805c8-108c-465a-b611-eda31f7e98fc,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:45:32.630723 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3b7a39db-0c7c-4130-ac24-f7bb60204f1f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for floatingip, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:32.660950 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3b7a39db-0c7c-4130-ac24-f7bb60204f1f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:32.810822 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3b7a39db-0c7c-4130-ac24-f7bb60204f1f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for port, precommit_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:32.815066 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3b7a39db-0c7c-4130-ac24-f7bb60204f1f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14290155'] for port, after_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:32.888745 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b7a39db-0c7c-4130-ac24-f7bb60204f1f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Pushing event updated for resources: {'Port': ['ID=10b805c8-108c-465a-b611-eda31f7e98fc,revision_number=2']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:45:32.898984 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3b7a39db-0c7c-4130-ac24-f7bb60204f1f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-784908'] for floatingip, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:32.913039 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-3b7a39db-0c7c-4130-ac24-f7bb60204f1f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for floatingip, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:32.914468 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-3b7a39db-0c7c-4130-ac24-f7bb60204f1f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 0.7583883 Sep 18 08:45:33.095684 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-4a77b7ac-3d17-40e6-a39e-a46ad2e80d2b tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?name=tempest-securitygroup--1121578208&fields=id&tenant_id=0700a96e9b3f48e8b6bcdd75b820b813 HTTP/1.1" status: 200 len: 267 time: 0.0324264 Sep 18 08:45:33.200784 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-0ea8bfd4-470d-4fa7-a9a6-771961a093f3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:33.202290 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-0ea8bfd4-470d-4fa7-a9a6-771961a093f3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/networks?id=f430397d-03a8-4da2-bd1d-25890a3a0727 HTTP/1.1" status: 200 len: 816 time: 0.1001792 Sep 18 08:45:33.217074 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-abafbca1-4bcf-4aba-b887-1600a29a5f86 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/quotas/0700a96e9b3f48e8b6bcdd75b820b813 HTTP/1.1" status: 200 len: 375 time: 0.0091941 Sep 18 08:45:33.266615 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-b39addc9-06da-499a-8ab8-0cd3d1b56d26 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?tenant_id=0700a96e9b3f48e8b6bcdd75b820b813&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0441689 Sep 18 08:45:33.453030 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-160a8d20-6f45-45fe-9004-5917d0fd62da service neutron] 10.222.0.35 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1739335 Sep 18 08:45:33.545041 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-b8ceaa76-3bd3-4b42-bca2-a02a561d9ebf service neutron] 10.222.0.35 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0855527 Sep 18 08:45:33.698605 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-92268f48-8323-4ada-a88e-a58812293a20 req-610e1fe0-829a-4dc9-9127-763b7cc8018f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 210 time: 0.0258179 Sep 18 08:45:34.814189 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-24e4dc02-215b-4462-b381-92f4910c9787 req-6ad0db75-f69b-4549-b842-5baae5a210e7 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 210 time: 0.0374126 Sep 18 08:45:34.853191 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-e542566e-515f-45d2-9141-892176403724 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:34.854714 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-e542566e-515f-45d2-9141-892176403724 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.13 "GET /v2.0/networks?id=f430397d-03a8-4da2-bd1d-25890a3a0727 HTTP/1.1" status: 200 len: 816 time: 0.1498728 Sep 18 08:45:34.919446 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-24280d8f-2f25-4447-b896-b2c801fd4257 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.13 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=0700a96e9b3f48e8b6bcdd75b820b813 HTTP/1.1" status: 200 len: 380 time: 0.0346632 Sep 18 08:45:34.930439 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-8f3786ad-84e5-4f77-a8e1-09e00420ec94 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Request body: {'port': {'device_id': 'a40b16b8-10f1-416c-933c-1f01dd483851', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'admin_state_up': True, 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'security_groups': ['e7f06e93-d80d-42c8-881f-6fdba5709870']}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:45:35.034555 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-8f3786ad-84e5-4f77-a8e1-09e00420ec94 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Made reservation on behalf of 0700a96e9b3f48e8b6bcdd75b820b813 for: {'port': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:45:35.038356 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-8f3786ad-84e5-4f77-a8e1-09e00420ec94 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:35.167484 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_common [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-8f3786ad-84e5-4f77-a8e1-09e00420ec94 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Allocated IP 172.20.0.3 (f430397d-03a8-4da2-bd1d-25890a3a0727/acdeb8a1-5de9-425f-ae0a-890d310246e9/fb17b7f6-af82-4371-b33a-e2a9b265ea42) {{(pid=94347) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:45:35.576726 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-8f3786ad-84e5-4f77-a8e1-09e00420ec94 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for port, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:35.585518 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd3c1c69-77b0-438e-bbe7-ea02a442cb6c req-1d5b501b-98ab-41f7-bae2-e2eb14f6d6ec tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:35.587013 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bd3c1c69-77b0-438e-bbe7-ea02a442cb6c req-1d5b501b-98ab-41f7-bae2-e2eb14f6d6ec tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 945 time: 0.0737393 Sep 18 08:45:35.638279 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bd3c1c69-77b0-438e-bbe7-ea02a442cb6c req-36fa4e44-be1a-43b3-bfc4-5b68a0d2c04b tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453134 Sep 18 08:45:35.646963 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-8f3786ad-84e5-4f77-a8e1-09e00420ec94 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:35.689180 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-8f3786ad-84e5-4f77-a8e1-09e00420ec94 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Network f430397d-03a8-4da2-bd1d-25890a3a0727 is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:45:35.692143 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-8f3786ad-84e5-4f77-a8e1-09e00420ec94 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:45:35.698938 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-8f3786ad-84e5-4f77-a8e1-09e00420ec94 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Received port after_create {{(pid=94347) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:45:35.704943 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f3786ad-84e5-4f77-a8e1-09e00420ec94 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Pushing event updated for resources: {'Port': ['ID=fb17b7f6-af82-4371-b33a-e2a9b265ea42,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:45:35.752496 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-8f3786ad-84e5-4f77-a8e1-09e00420ec94 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:35.753122 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-8f3786ad-84e5-4f77-a8e1-09e00420ec94 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:35.769667 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-8f3786ad-84e5-4f77-a8e1-09e00420ec94 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8431420 Sep 18 08:45:35.791228 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-83594950-7fe3-4869-a400-4ed8c1ded80b service neutron] Request body: {'port': {'device_id': 'a40b16b8-10f1-416c-933c-1f01dd483851', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80447'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:45:35.844801 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-83594950-7fe3-4869-a400-4ed8c1ded80b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:35.879237 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-c0838872-4323-4667-94bb-d76cc73bb532 None None] Provisioning complete for port fb17b7f6-af82-4371-b33a-e2a9b265ea42 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:45:35.879772 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-c0838872-4323-4667-94bb-d76cc73bb532 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:35.915848 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-c0838872-4323-4667-94bb-d76cc73bb532 None None] Port fb17b7f6-af82-4371-b33a-e2a9b265ea42 cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:45:36.025826 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62e18604-9730-4fbd-a5ac-53a4e670cfde req-529815a0-663d-418e-a5d9-6871ea581f47 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:36.027362 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-62e18604-9730-4fbd-a5ac-53a4e670cfde req-529815a0-663d-418e-a5d9-6871ea581f47 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 931 time: 0.1255996 Sep 18 08:45:36.109490 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-62e18604-9730-4fbd-a5ac-53a4e670cfde req-f17642a5-142c-4c46-976f-5b2255accf66 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0533247 Sep 18 08:45:36.169574 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-83594950-7fe3-4869-a400-4ed8c1ded80b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fb17b7f6-af82-4371-b33a-e2a9b265ea42 {{(pid=94347) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:45:36.176890 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-83594950-7fe3-4869-a400-4ed8c1ded80b service neutron] Notify callbacks [] for port, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:36.188250 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.provisioning_blocks [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-83594950-7fe3-4869-a400-4ed8c1ded80b service neutron] Transition to ACTIVE for port object fb17b7f6-af82-4371-b33a-e2a9b265ea42 will not be triggered until provisioned by entity L2. {{(pid=94347) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 18 08:45:36.191928 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-83594950-7fe3-4869-a400-4ed8c1ded80b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:36.258557 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83594950-7fe3-4869-a400-4ed8c1ded80b service neutron] Pushing event updated for resources: {'Port': ['ID=fb17b7f6-af82-4371-b33a-e2a9b265ea42,revision_number=2']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:45:36.310964 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-83594950-7fe3-4869-a400-4ed8c1ded80b service neutron] Attempting to bind port fb17b7f6-af82-4371-b33a-e2a9b265ea42 on host hv-cinder-80447 for vnic_type normal with profile {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:45:36.311310 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-83594950-7fe3-4869-a400-4ed8c1ded80b service neutron] Attempting to bind port fb17b7f6-af82-4371-b33a-e2a9b265ea42 by drivers openvswitch,hyperv on host hv-cinder-80447 at level 0 using segments [{'id': '34c1fb08-1711-4a8c-a899-35eb41628d5a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 214, 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727'}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:45:36.311637 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-83594950-7fe3-4869-a400-4ed8c1ded80b service neutron] Attempting to bind port fb17b7f6-af82-4371-b33a-e2a9b265ea42 on network f430397d-03a8-4da2-bd1d-25890a3a0727 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:45:36.315983 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-83594950-7fe3-4869-a400-4ed8c1ded80b service neutron] Port fb17b7f6-af82-4371-b33a-e2a9b265ea42 on network f430397d-03a8-4da2-bd1d-25890a3a0727 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80447 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 18 08:45:36.316302 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-83594950-7fe3-4869-a400-4ed8c1ded80b service neutron] Attempting to bind port fb17b7f6-af82-4371-b33a-e2a9b265ea42 on network f430397d-03a8-4da2-bd1d-25890a3a0727 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:45:36.321923 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-83594950-7fe3-4869-a400-4ed8c1ded80b service neutron] Checking agent: {'id': '8d51fdc4-974b-4200-9c3f-5dddea60a869', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80447', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'started_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 45, 20), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:45:36.322264 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-83594950-7fe3-4869-a400-4ed8c1ded80b service neutron] Checking segment: {'id': '34c1fb08-1711-4a8c-a899-35eb41628d5a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 214, 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94347) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:45:36.322662 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-83594950-7fe3-4869-a400-4ed8c1ded80b service neutron] Bound using segment: {'id': '34c1fb08-1711-4a8c-a899-35eb41628d5a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 214, 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727'} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:45:36.323088 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-83594950-7fe3-4869-a400-4ed8c1ded80b service neutron] Bound port: fb17b7f6-af82-4371-b33a-e2a9b265ea42, host: hv-cinder-80447, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '34c1fb08-1711-4a8c-a899-35eb41628d5a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 214, 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727'}}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:45:36.323447 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-83594950-7fe3-4869-a400-4ed8c1ded80b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:36.388905 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-83594950-7fe3-4869-a400-4ed8c1ded80b service neutron] For port fb17b7f6-af82-4371-b33a-e2a9b265ea42, host hv-cinder-80447, cleared binding levels {{(pid=94347) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:45:36.391989 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-83594950-7fe3-4869-a400-4ed8c1ded80b service neutron] For port fb17b7f6-af82-4371-b33a-e2a9b265ea42, host hv-cinder-80447, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=fb17b7f6-af82-4371-b33a-e2a9b265ea42,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94347) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:45:36.396501 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-83594950-7fe3-4869-a400-4ed8c1ded80b service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:36.429718 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-83594950-7fe3-4869-a400-4ed8c1ded80b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:36.430502 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-83594950-7fe3-4869-a400-4ed8c1ded80b service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:36.431822 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-83594950-7fe3-4869-a400-4ed8c1ded80b service neutron] 10.222.0.13 "PUT /v2.0/ports/fb17b7f6-af82-4371-b33a-e2a9b265ea42 HTTP/1.1" status: 200 len: 1093 time: 0.6449137 Sep 18 08:45:36.432237 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a40b16b8-10f1-416c-933c-1f01dd483851', 'tag': 'fb17b7f6-af82-4371-b33a-e2a9b265ea42'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:45:36.434786 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-85a92fd8-2972-451f-b936-964fd707c389" -d '{"events": [{"name": "network-changed", "server_uuid": "a40b16b8-10f1-416c-933c-1f01dd483851", "tag": "fb17b7f6-af82-4371-b33a-e2a9b265ea42"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:45:36.461065 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83594950-7fe3-4869-a400-4ed8c1ded80b service neutron] Pushing event updated for resources: {'Port': ['ID=fb17b7f6-af82-4371-b33a-e2a9b265ea42,revision_number=3']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:45:36.482551 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:45:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-94bd3050-ba1b-47cd-b1ad-6ec5324a1034 x-openstack-request-id: req-94bd3050-ba1b-47cd-b1ad-6ec5324a1034 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:45:36.482852 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a40b16b8-10f1-416c-933c-1f01dd483851", "tag": "fb17b7f6-af82-4371-b33a-e2a9b265ea42", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:45:36.483106 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-94bd3050-ba1b-47cd-b1ad-6ec5324a1034 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:45:36.483515 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a40b16b8-10f1-416c-933c-1f01dd483851', 'tag': 'fb17b7f6-af82-4371-b33a-e2a9b265ea42', 'status': 'completed', 'code': 200} Sep 18 08:45:36.544899 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-f4736f01-e119-44ec-ae6f-c20f254030a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:36.546518 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-f4736f01-e119-44ec-ae6f-c20f254030a5 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0700a96e9b3f48e8b6bcdd75b820b813&device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 1096 time: 0.0417032 Sep 18 08:45:36.603103 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-6264d065-d5dc-458d-bebe-b36ab633e73f service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=fb17b7f6-af82-4371-b33a-e2a9b265ea42 HTTP/1.1" status: 200 len: 217 time: 0.0383234 Sep 18 08:45:36.652625 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-57a1e482-6809-44bb-bf9c-37e2bdf23c4e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:36.654078 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-57a1e482-6809-44bb-bf9c-37e2bdf23c4e service neutron] 10.222.0.13 "GET /v2.0/subnets?id=acdeb8a1-5de9-425f-ae0a-890d310246e9 HTTP/1.1" status: 200 len: 855 time: 0.0430586 Sep 18 08:45:36.701754 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-b21c1b0c-31e7-4f54-968f-98386b35dd3a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:36.703273 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-b21c1b0c-31e7-4f54-968f-98386b35dd3a service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=f430397d-03a8-4da2-bd1d-25890a3a0727&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0400836 Sep 18 08:45:36.810703 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d7ce139-0393-460e-ad15-2590d87fd4ee req-ebf9160f-212d-470f-b199-500315976027 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:36.812185 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7d7ce139-0393-460e-ad15-2590d87fd4ee req-ebf9160f-212d-470f-b199-500315976027 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 945 time: 0.1042237 Sep 18 08:45:36.844073 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-b55be21b-05b6-4f88-b607-b4bd4a375908 service neutron] 10.222.0.13 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1280007 Sep 18 08:45:36.868451 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7d7ce139-0393-460e-ad15-2590d87fd4ee req-e7653be2-b1aa-4f64-b606-f7016dbbacdd tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503857 Sep 18 08:45:36.946512 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-46104739-fa42-4677-bb40-c0aafc6e1c07 req-36d3976b-af87-4f59-a7b8-f4d85d39907a service neutron] 10.222.0.13 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0928750 Sep 18 08:45:37.079340 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a92fd8-2972-451f-b936-964fd707c389 req-44ee9f3b-a887-41cf-a29c-91f923bf0c40 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:37.080799 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-85a92fd8-2972-451f-b936-964fd707c389 req-44ee9f3b-a887-41cf-a29c-91f923bf0c40 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0700a96e9b3f48e8b6bcdd75b820b813&device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 1096 time: 0.0391901 Sep 18 08:45:37.174094 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a92fd8-2972-451f-b936-964fd707c389 req-1d577cd7-b6d7-428f-9fbe-2bf20d987598 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:37.175600 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-85a92fd8-2972-451f-b936-964fd707c389 req-1d577cd7-b6d7-428f-9fbe-2bf20d987598 service neutron] 10.222.0.13 "GET /v2.0/networks?id=f430397d-03a8-4da2-bd1d-25890a3a0727 HTTP/1.1" status: 200 len: 917 time: 0.0861940 Sep 18 08:45:37.237020 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-85a92fd8-2972-451f-b936-964fd707c389 req-a7abd12c-08da-40da-9439-448bd98a5305 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=fb17b7f6-af82-4371-b33a-e2a9b265ea42 HTTP/1.1" status: 200 len: 217 time: 0.0473020 Sep 18 08:45:37.288998 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-275ab000-aa5f-4555-a57b-69fcde12a021 req-85cae177-0fba-4f7b-ba13-50ee6e9a5985 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:37.290502 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-275ab000-aa5f-4555-a57b-69fcde12a021 req-85cae177-0fba-4f7b-ba13-50ee6e9a5985 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 943 time: 0.1103001 Sep 18 08:45:37.326273 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a92fd8-2972-451f-b936-964fd707c389 req-c9621bb2-b208-4758-9595-05a466d09eb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:37.327663 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-85a92fd8-2972-451f-b936-964fd707c389 req-c9621bb2-b208-4758-9595-05a466d09eb7 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=acdeb8a1-5de9-425f-ae0a-890d310246e9 HTTP/1.1" status: 200 len: 855 time: 0.0831532 Sep 18 08:45:37.346434 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-275ab000-aa5f-4555-a57b-69fcde12a021 req-2e0706b0-05f5-4ed5-ae75-5be8cf2571e7 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0484450 Sep 18 08:45:37.377676 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a92fd8-2972-451f-b936-964fd707c389 req-4eb17eb5-15b5-4441-98b6-b8a0947d4289 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:37.379184 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-85a92fd8-2972-451f-b936-964fd707c389 req-4eb17eb5-15b5-4441-98b6-b8a0947d4289 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=f430397d-03a8-4da2-bd1d-25890a3a0727&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0419936 Sep 18 08:45:37.468484 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-85a92fd8-2972-451f-b936-964fd707c389 req-0422515f-234a-4a7e-a9ac-21d85d999d50 service neutron] 10.222.0.13 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0811312 Sep 18 08:45:37.560221 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-85a92fd8-2972-451f-b936-964fd707c389 req-f254ad69-a1b7-4252-a044-31a28b6e147f service neutron] 10.222.0.13 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0839016 Sep 18 08:45:37.671593 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8a72bfd-a12f-43db-8afd-75575b03668c req-f4578ff7-7d0e-47b4-a47a-def93aa7c008 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:37.673008 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a8a72bfd-a12f-43db-8afd-75575b03668c req-f4578ff7-7d0e-47b4-a47a-def93aa7c008 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.13 "GET /v2.0/ports?device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 945 time: 0.0455079 Sep 18 08:45:37.766198 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-a8a72bfd-a12f-43db-8afd-75575b03668c req-2c42c758-e89d-474f-9b04-9ebdff5f70f1 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Deleting port f09ac5bc-34a1-471b-8363-5a65f804d570 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:45:37.766470 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a8a72bfd-a12f-43db-8afd-75575b03668c req-2c42c758-e89d-474f-9b04-9ebdff5f70f1 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:37.853162 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-a8a72bfd-a12f-43db-8afd-75575b03668c req-2c42c758-e89d-474f-9b04-9ebdff5f70f1 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] For port f09ac5bc-34a1-471b-8363-5a65f804d570, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=f09ac5bc-34a1-471b-8363-5a65f804d570,segment=NetworkSegment(020db71b-b4f2-4e88-b835-5db154c945b2),segment_id=020db71b-b4f2-4e88-b835-5db154c945b2)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:45:37.853545 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a8a72bfd-a12f-43db-8afd-75575b03668c req-2c42c758-e89d-474f-9b04-9ebdff5f70f1 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:37.865984 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-a8a72bfd-a12f-43db-8afd-75575b03668c req-2c42c758-e89d-474f-9b04-9ebdff5f70f1 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Calling delete_port for f09ac5bc-34a1-471b-8363-5a65f804d570 owned by compute:nova {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:45:38.011349 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8e36a7e-8504-4bfd-919f-01af05adf9ca req-fe30e3af-0bed-4525-aca7-6ea465d27647 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:38.012852 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e8e36a7e-8504-4bfd-919f-01af05adf9ca req-fe30e3af-0bed-4525-aca7-6ea465d27647 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=0b1a02ec-9f35-47ec-b701-8399f64c5c3d HTTP/1.1" status: 200 len: 945 time: 0.0748274 Sep 18 08:45:38.041055 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a8a72bfd-a12f-43db-8afd-75575b03668c req-2c42c758-e89d-474f-9b04-9ebdff5f70f1 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:38.080954 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['f09ac5bc-34a1-471b-8363-5a65f804d570'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:45:38.081766 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c42c758-e89d-474f-9b04-9ebdff5f70f1 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Pushing event deleted for resources: {'Port': ['ID=f09ac5bc-34a1-471b-8363-5a65f804d570,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:45:38.087771 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e8e36a7e-8504-4bfd-919f-01af05adf9ca req-cf3d9fb0-429f-4ee2-85ce-37e9cb062f36 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0675697 Sep 18 08:45:38.123899 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-a8a72bfd-a12f-43db-8afd-75575b03668c req-2c42c758-e89d-474f-9b04-9ebdff5f70f1 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] No DVR routers for this DVR port f09ac5bc-34a1-471b-8363-5a65f804d570 on host hv-cinder-80447 {{(pid=94347) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:45:38.126248 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a8a72bfd-a12f-43db-8afd-75575b03668c req-2c42c758-e89d-474f-9b04-9ebdff5f70f1 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:38.128195 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a8a72bfd-a12f-43db-8afd-75575b03668c req-2c42c758-e89d-474f-9b04-9ebdff5f70f1 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.13 "DELETE /v2.0/ports/f09ac5bc-34a1-471b-8363-5a65f804d570 HTTP/1.1" status: 204 len: 173 time: 0.4469872 Sep 18 08:45:38.461240 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a73af50-0092-4d31-ba12-ce8f7525522d req-acf7fe75-7424-4d91-ac53-4b12921c35fb tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:38.462705 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9a73af50-0092-4d31-ba12-ce8f7525522d req-acf7fe75-7424-4d91-ac53-4b12921c35fb tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 943 time: 0.0474529 Sep 18 08:45:38.486962 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0b1a02ec-9f35-47ec-b701-8399f64c5c3d', 'name': 'network-vif-deleted', 'tag': 'f09ac5bc-34a1-471b-8363-5a65f804d570'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:45:38.489098 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4b27f861-6d5e-40ee-892e-d287046202ea" -d '{"events": [{"server_uuid": "0b1a02ec-9f35-47ec-b701-8399f64c5c3d", "name": "network-vif-deleted", "tag": "f09ac5bc-34a1-471b-8363-5a65f804d570"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:45:38.504323 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9a73af50-0092-4d31-ba12-ce8f7525522d req-2d9ea90e-51d1-4396-8928-1611e1b01b88 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0359313 Sep 18 08:45:38.534123 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:45:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4b779510-ff84-4c7a-b779-fc482fc2969d x-openstack-request-id: req-4b779510-ff84-4c7a-b779-fc482fc2969d {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:45:38.534424 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0b1a02ec-9f35-47ec-b701-8399f64c5c3d", "name": "network-vif-deleted", "tag": "f09ac5bc-34a1-471b-8363-5a65f804d570", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:45:38.534682 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-4b779510-ff84-4c7a-b779-fc482fc2969d {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:45:38.535081 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0b1a02ec-9f35-47ec-b701-8399f64c5c3d', 'name': 'network-vif-deleted', 'tag': 'f09ac5bc-34a1-471b-8363-5a65f804d570', 'status': 'completed', 'code': 200} Sep 18 08:45:39.625630 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25d129bf-0908-4632-ad42-9dc4d12709e7 req-3035a3a7-7747-444b-82e6-e0fc6b4ac292 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:39.627092 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-25d129bf-0908-4632-ad42-9dc4d12709e7 req-3035a3a7-7747-444b-82e6-e0fc6b4ac292 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 943 time: 0.0504518 Sep 18 08:45:39.663765 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-25d129bf-0908-4632-ad42-9dc4d12709e7 req-8fe1057a-f39b-4ea2-941c-f7e67f993c57 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0308614 Sep 18 08:45:40.777914 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3132f667-2fde-4dd2-939b-9c7fb3f308b1 req-7d47170d-e8b9-4726-a835-aa93d7e9136d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:40.779365 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3132f667-2fde-4dd2-939b-9c7fb3f308b1 req-7d47170d-e8b9-4726-a835-aa93d7e9136d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 943 time: 0.0470374 Sep 18 08:45:40.815098 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3132f667-2fde-4dd2-939b-9c7fb3f308b1 req-4fad7cf6-9e9d-4b52-a6f3-348f3bde4b3c tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0299673 Sep 18 08:45:41.861988 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device fb17b7f6-af82-4371-b33a-e2a9b265ea42 details requested by agent hyperv_hv-cinder-80447 with host hv-cinder-80447 {{(pid=94348) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 18 08:45:41.929492 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fa36638-7223-4f94-8a91-d9d220861186 req-aa3988ba-54c2-427b-9772-d5aff672a1f4 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:41.931025 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4fa36638-7223-4f94-8a91-d9d220861186 req-aa3988ba-54c2-427b-9772-d5aff672a1f4 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 943 time: 0.0473454 Sep 18 08:45:41.955285 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port fb17b7f6-af82-4371-b33a-e2a9b265ea42, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=fb17b7f6-af82-4371-b33a-e2a9b265ea42,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:45:41.966761 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Returning: {'device': 'fb17b7f6-af82-4371-b33a-e2a9b265ea42', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'port_id': 'fb17b7f6-af82-4371-b33a-e2a9b265ea42', 'mac_address': 'fa:16:3e:21:d8:84', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 214, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94348) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 18 08:45:41.969837 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4fa36638-7223-4f94-8a91-d9d220861186 req-2e559c2a-09c5-4283-8451-aa3d62c8d837 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0325599 Sep 18 08:45:42.008145 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:42.020022 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fb17b7f6-af82-4371-b33a-e2a9b265ea42 {{(pid=94348) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:45:42.038356 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port fb17b7f6-af82-4371-b33a-e2a9b265ea42, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=fb17b7f6-af82-4371-b33a-e2a9b265ea42,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:45:42.041324 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:42.086438 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=fb17b7f6-af82-4371-b33a-e2a9b265ea42,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:45:43.088436 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7939d828-502f-4c7e-afcc-3b89818c69ce req-593ea1a6-47e0-4671-ad7b-4dcf25bb8fef tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:43.089950 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7939d828-502f-4c7e-afcc-3b89818c69ce req-593ea1a6-47e0-4671-ad7b-4dcf25bb8fef tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 944 time: 0.0504038 Sep 18 08:45:43.126052 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7939d828-502f-4c7e-afcc-3b89818c69ce req-fa69e726-8631-484f-b539-529188921ce2 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0304360 Sep 18 08:45:43.711132 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['fb17b7f6-af82-4371-b33a-e2a9b265ea42'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:45:44.239210 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a190213-ec5a-4ff9-bd03-c260b15097ff req-6cd039ef-898a-4681-92bb-819e6b38e239 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:44.241192 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0a190213-ec5a-4ff9-bd03-c260b15097ff req-6cd039ef-898a-4681-92bb-819e6b38e239 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 944 time: 0.0477676 Sep 18 08:45:44.277702 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0a190213-ec5a-4ff9-bd03-c260b15097ff req-f8e40ef9-4efa-4da5-8cbc-505aa61d0620 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0305889 Sep 18 08:45:45.155394 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device fb17b7f6-af82-4371-b33a-e2a9b265ea42 up at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:45:45.202036 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning for port fb17b7f6-af82-4371-b33a-e2a9b265ea42 completed by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 18 08:45:45.205511 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning complete for port fb17b7f6-af82-4371-b33a-e2a9b265ea42 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:45:45.205911 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:45.278676 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:45.300221 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a40b16b8-10f1-416c-933c-1f01dd483851', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fb17b7f6-af82-4371-b33a-e2a9b265ea42'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:45:45.302492 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-48caf573-342d-471a-8d9a-e7ba79a24be9" -d '{"events": [{"server_uuid": "a40b16b8-10f1-416c-933c-1f01dd483851", "name": "network-vif-plugged", "status": "completed", "tag": "fb17b7f6-af82-4371-b33a-e2a9b265ea42"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:45:45.318191 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port fb17b7f6-af82-4371-b33a-e2a9b265ea42, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=fb17b7f6-af82-4371-b33a-e2a9b265ea42,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:45:45.322419 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:45.323191 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device f09ac5bc-34a1-471b-8363-5a65f804d570 no longer exists at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:45:45.362389 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:45:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1613ee45-4795-4257-8217-c2425b21ae2a x-openstack-request-id: req-1613ee45-4795-4257-8217-c2425b21ae2a {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:45:45.362698 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a40b16b8-10f1-416c-933c-1f01dd483851", "name": "network-vif-plugged", "status": "completed", "tag": "fb17b7f6-af82-4371-b33a-e2a9b265ea42", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:45:45.362916 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-1613ee45-4795-4257-8217-c2425b21ae2a {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:45:45.363301 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a40b16b8-10f1-416c-933c-1f01dd483851', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fb17b7f6-af82-4371-b33a-e2a9b265ea42', 'code': 200} Sep 18 08:45:45.365797 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] No Port match for: f09ac5bc-34a1-471b-8363-5a65f804d570 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:45:45.366144 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device f09ac5bc-34a1-471b-8363-5a65f804d570 not bound to the agent host hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:45:45.391210 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=fb17b7f6-af82-4371-b33a-e2a9b265ea42,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:45:45.400381 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9539bbc-0509-41bf-892f-f0a9238a1929 req-0d90eb91-f104-4459-8c69-4e46ff91bc48 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:45.401288 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e9539bbc-0509-41bf-892f-f0a9238a1929 req-0d90eb91-f104-4459-8c69-4e46ff91bc48 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0530105 Sep 18 08:45:45.441100 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e9539bbc-0509-41bf-892f-f0a9238a1929 req-bb7bb828-11f2-47ff-b069-a304b987e21c tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0331154 Sep 18 08:45:45.546373 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a01ba279-f189-40b8-91d0-51d6704e420e req-68a948af-864e-4e83-ac44-c92e5ed998a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:45.547819 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a01ba279-f189-40b8-91d0-51d6704e420e req-68a948af-864e-4e83-ac44-c92e5ed998a1 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 1098 time: 0.0410447 Sep 18 08:45:45.581684 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a01ba279-f189-40b8-91d0-51d6704e420e req-833431c0-c912-4626-9ae8-2b9c6dbdfd1b service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0264077 Sep 18 08:45:46.563642 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-741fcd3a-8c0f-4395-87ac-9c37e0aaab26 req-e4956316-add8-4d10-a515-215f48840f15 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:46.565126 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-741fcd3a-8c0f-4395-87ac-9c37e0aaab26 req-e4956316-add8-4d10-a515-215f48840f15 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0476627 Sep 18 08:45:46.602494 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-741fcd3a-8c0f-4395-87ac-9c37e0aaab26 req-ec868ca1-ac10-4ea3-8103-43f8dc293281 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0313306 Sep 18 08:45:47.716889 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-940211dc-5774-4a51-b060-ccb05e3b36a8 req-7604cd7b-6a5b-4a5f-81ec-48f6ade25375 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:47.718388 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-940211dc-5774-4a51-b060-ccb05e3b36a8 req-7604cd7b-6a5b-4a5f-81ec-48f6ade25375 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0471981 Sep 18 08:45:47.754136 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-940211dc-5774-4a51-b060-ccb05e3b36a8 req-cb5b36c9-effc-4142-8f9b-378b64c988c8 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0298004 Sep 18 08:45:48.874023 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-883515c3-3834-4600-b265-76e341e98fd5 req-a5a9ed2c-5dcf-4169-89ac-c737149dbe31 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:48.875538 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-883515c3-3834-4600-b265-76e341e98fd5 req-a5a9ed2c-5dcf-4169-89ac-c737149dbe31 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0514367 Sep 18 08:45:48.911928 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-883515c3-3834-4600-b265-76e341e98fd5 req-331dda78-f544-44fc-8f22-0becec6419a5 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0306222 Sep 18 08:45:49.612273 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-4bb4e031-2c74-47fd-8282-88e5d29ac7e2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:50.023490 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:50.031243 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4df29851-ad1d-499e-a514-cddfae1d4db1 req-6a6440d2-d3c6-4be4-9446-e3f8fd1e4932 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:50.032766 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4df29851-ad1d-499e-a514-cddfae1d4db1 req-6a6440d2-d3c6-4be4-9446-e3f8fd1e4932 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0494845 Sep 18 08:45:50.070693 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4df29851-ad1d-499e-a514-cddfae1d4db1 req-d9ac767e-c4d1-4f3e-8a21-d9ca83df73de tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0312722 Sep 18 08:45:51.121889 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-e41e133b-b791-4288-bcaf-d4393677f1ec tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:51.123361 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-e41e133b-b791-4288-bcaf-d4393677f1ec tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/networks?id=344dbdfa-9f7e-4311-9160-286f3356d748 HTTP/1.1" status: 200 len: 814 time: 0.1047089 Sep 18 08:45:51.137795 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-6e97bc4c-4c90-412e-bd46-0cbd41811844 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/quotas/e54453321aba48dc881baeadd2c69473 HTTP/1.1" status: 200 len: 375 time: 0.0088398 Sep 18 08:45:51.183983 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-03eecae1-e770-4fb9-a02a-76d1e0fdcb19 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?tenant_id=e54453321aba48dc881baeadd2c69473&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0359726 Sep 18 08:45:51.226904 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47b06a08-895b-41fe-9195-a2ebae7cea4c req-735f614f-ee84-4d58-a0c0-8eca98f3e717 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:51.228346 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-47b06a08-895b-41fe-9195-a2ebae7cea4c req-735f614f-ee84-4d58-a0c0-8eca98f3e717 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0885501 Sep 18 08:45:51.311346 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-47b06a08-895b-41fe-9195-a2ebae7cea4c req-05a8446d-b42c-46f4-be55-0be78ab45636 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0771585 Sep 18 08:45:51.317157 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-5cfa6e74-61ba-4cdb-8cff-9b83e68abef3 service neutron] 10.222.0.35 "GET /v2.0/networks/344dbdfa-9f7e-4311-9160-286f3356d748?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1262190 Sep 18 08:45:51.438358 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-5dc02c70-6a0e-4caa-9189-9670b2742ae0 service neutron] 10.222.0.35 "GET /v2.0/networks/344dbdfa-9f7e-4311-9160-286f3356d748?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1142712 Sep 18 08:45:51.447104 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24b4c889-eab7-4f2a-9d40-c9b6bf9912ce req-5967f33d-77f7-44b7-8958-b52b3dde9b51 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:51.448498 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-24b4c889-eab7-4f2a-9d40-c9b6bf9912ce req-5967f33d-77f7-44b7-8958-b52b3dde9b51 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0697141 Sep 18 08:45:51.456893 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 36348) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:45:51.462272 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-e1855e8d-f1ea-442f-bd0d-7eb4b5e7b7a1 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Request body: {'floatingip': {'port_id': 'fb17b7f6-af82-4371-b33a-e2a9b265ea42'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:45:51.531205 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-e1855e8d-f1ea-442f-bd0d-7eb4b5e7b7a1 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for floatingip, before_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:51.598896 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2ff0b1c0-b66b-4986-b3eb-9084d124a596 req-ae776778-e069-4b04-9f71-719140d4cc29 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=4826cd28-72c8-4b55-af33-4e175feee25f HTTP/1.1" status: 200 len: 210 time: 0.0255773 Sep 18 08:45:52.000528 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-e1855e8d-f1ea-442f-bd0d-7eb4b5e7b7a1 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for floatingip, precommit_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:52.004495 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-e1855e8d-f1ea-442f-bd0d-7eb4b5e7b7a1 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-784908'] for floatingip, after_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:52.103749 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.db.l3_db [None req-e1855e8d-f1ea-442f-bd0d-7eb4b5e7b7a1 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Floating IP 5c658964-1086-4b4a-a459-5019e1da8dc0 associated. External IP: 172.27.1.181, port: fb17b7f6-af82-4371-b33a-e2a9b265ea42. Sep 18 08:45:52.310000 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e1855e8d-f1ea-442f-bd0d-7eb4b5e7b7a1 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Router 73ec8685-1119-4d34-a85d-af65c74d9e25 has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94346) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:45:52.406923 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-7203be55-1e1a-4f84-87ba-05949c2a4b4d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:52.414389 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e1855e8d-f1ea-442f-bd0d-7eb4b5e7b7a1 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94346) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:45:52.418948 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-e1855e8d-f1ea-442f-bd0d-7eb4b5e7b7a1 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for floatingip, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:52.423261 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76fd8fef-ff9e-462b-9e77-e5c7524fc042 None None] Sync routers for ids ['73ec8685-1119-4d34-a85d-af65c74d9e25'] in dv-cinder-804470-6-iscsi {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:45:52.432320 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76fd8fef-ff9e-462b-9e77-e5c7524fc042 None None] Routers {'73ec8685-1119-4d34-a85d-af65c74d9e25'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:45:52.432930 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-76fd8fef-ff9e-462b-9e77-e5c7524fc042 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:45:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['73ec8685-1119-4d34-a85d-af65c74d9e25'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:45:52.444793 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-e1855e8d-f1ea-442f-bd0d-7eb4b5e7b7a1 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "PUT /v2.0/floatingips/5c658964-1086-4b4a-a459-5019e1da8dc0 HTTP/1.1" status: 200 len: 991 time: 0.9866703 Sep 18 08:45:52.445399 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a40b16b8-10f1-416c-933c-1f01dd483851', 'tag': 'fb17b7f6-af82-4371-b33a-e2a9b265ea42'}] {{(pid=94346) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:45:52.448313 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9c65146fa140f7f105fbfe1cfc0ed8a4aa4ddea85af05f4a70363726e3aa059" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-47907bf6-36bb-4d18-9b94-19f1ae4aaa77" -d '{"events": [{"name": "network-changed", "server_uuid": "a40b16b8-10f1-416c-933c-1f01dd483851", "tag": "fb17b7f6-af82-4371-b33a-e2a9b265ea42"}]}' {{(pid=94346) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:45:52.542163 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-76fd8fef-ff9e-462b-9e77-e5c7524fc042 None None] Set router 73ec8685-1119-4d34-a85d-af65c74d9e25 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:45:52.561561 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:45:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-466e5cb8-4bcb-4b4b-9382-ffea6d49a28b x-openstack-request-id: req-466e5cb8-4bcb-4b4b-9382-ffea6d49a28b {{(pid=94346) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:45:52.562071 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a40b16b8-10f1-416c-933c-1f01dd483851", "tag": "fb17b7f6-af82-4371-b33a-e2a9b265ea42", "status": "completed", "code": 200}]} {{(pid=94346) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:45:52.562071 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-466e5cb8-4bcb-4b4b-9382-ffea6d49a28b {{(pid=94346) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:45:52.562661 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a40b16b8-10f1-416c-933c-1f01dd483851', 'tag': 'fb17b7f6-af82-4371-b33a-e2a9b265ea42', 'status': 'completed', 'code': 200} Sep 18 08:45:52.758484 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ec20ddd7-8ec7-4f9d-85e5-0b74de4dbfdf req-e073903e-82d8-4dd7-8152-e7f7fd33cf5b tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=4826cd28-72c8-4b55-af33-4e175feee25f HTTP/1.1" status: 200 len: 210 time: 0.0736570 Sep 18 08:45:52.778132 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47907bf6-36bb-4d18-9b94-19f1ae4aaa77 req-d1f5ff4f-15fd-4413-a00c-6463a4f9fd5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:52.779607 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-47907bf6-36bb-4d18-9b94-19f1ae4aaa77 req-d1f5ff4f-15fd-4413-a00c-6463a4f9fd5e service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0700a96e9b3f48e8b6bcdd75b820b813&device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 1098 time: 0.1036367 Sep 18 08:45:52.786574 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-76fd8fef-ff9e-462b-9e77-e5c7524fc042 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'name': 'tempest-AttachVolumeShelveTestJSON-230900396-router', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12'}], 'enable_snat': True}, 'gw_port_id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:04Z', 'updated_at': '2021-09-18T08:38:12Z', 'revision_number': 4, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'gw_port': {'id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:ed:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:05Z', 'updated_at': '2021-09-18T08:38:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': '5c658964-1086-4b4a-a459-5019e1da8dc0', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'floating_ip_address': '172.27.1.181', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'port_id': 'fb17b7f6-af82-4371-b33a-e2a9b265ea42', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 626, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'mac_address': 'fa:16:3e:21:d8:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a40b16b8-10f1-416c-933c-1f01dd483851', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:45:32Z', 'updated_at': '2021-09-18T08:45:51Z', 'revision_number': 1, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '09652b84-a3b3-476f-815f-f0c78f8543ba', 'name': '', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'mac_address': 'fa:16:3e:20:cb:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:10Z', 'updated_at': '2021-09-18T08:38:18Z', 'revision_number': 5, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'subnets': [{'id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:45:52.814264 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76fd8fef-ff9e-462b-9e77-e5c7524fc042 None None] Checking router: 73ec8685-1119-4d34-a85d-af65c74d9e25 for host: dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:45:52.820480 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-0c09fb45-597a-4041-86dc-af9c23800a3f tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:52.821962 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-0c09fb45-597a-4041-86dc-af9c23800a3f tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.13 "GET /v2.0/networks?id=344dbdfa-9f7e-4311-9160-286f3356d748 HTTP/1.1" status: 200 len: 814 time: 0.1824315 Sep 18 08:45:52.823119 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76fd8fef-ff9e-462b-9e77-e5c7524fc042 None None] Routers {'73ec8685-1119-4d34-a85d-af65c74d9e25'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:45:52.823735 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-76fd8fef-ff9e-462b-9e77-e5c7524fc042 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:45:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['73ec8685-1119-4d34-a85d-af65c74d9e25'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:45:52.865182 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-1fa358da-ae68-4492-8b5b-d7db73205878 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Request body: {'port': {'device_id': '4826cd28-72c8-4b55-af33-4e175feee25f', 'network_id': '344dbdfa-9f7e-4311-9160-286f3356d748', 'admin_state_up': True, 'tenant_id': 'e54453321aba48dc881baeadd2c69473'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:45:52.928211 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-76fd8fef-ff9e-462b-9e77-e5c7524fc042 None None] Set router 73ec8685-1119-4d34-a85d-af65c74d9e25 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:45:52.946877 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47907bf6-36bb-4d18-9b94-19f1ae4aaa77 req-0dce93b8-5664-48fe-9385-20d4cc6ddc41 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:52.948365 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-47907bf6-36bb-4d18-9b94-19f1ae4aaa77 req-0dce93b8-5664-48fe-9385-20d4cc6ddc41 service neutron] 10.222.0.13 "GET /v2.0/networks?id=f430397d-03a8-4da2-bd1d-25890a3a0727 HTTP/1.1" status: 200 len: 917 time: 0.1617906 Sep 18 08:45:53.038788 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-47907bf6-36bb-4d18-9b94-19f1ae4aaa77 req-1c322f4e-16fa-43de-a5a9-8a8d7e3a1310 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=fb17b7f6-af82-4371-b33a-e2a9b265ea42 HTTP/1.1" status: 200 len: 999 time: 0.0809064 Sep 18 08:45:53.043154 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-1fa358da-ae68-4492-8b5b-d7db73205878 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Made reservation on behalf of e54453321aba48dc881baeadd2c69473 for: {'port': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:45:53.046985 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-1fa358da-ae68-4492-8b5b-d7db73205878 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:53.136269 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47907bf6-36bb-4d18-9b94-19f1ae4aaa77 req-a0288365-7949-4d10-9793-8853550024e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:53.137685 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-47907bf6-36bb-4d18-9b94-19f1ae4aaa77 req-a0288365-7949-4d10-9793-8853550024e0 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=acdeb8a1-5de9-425f-ae0a-890d310246e9 HTTP/1.1" status: 200 len: 855 time: 0.0886269 Sep 18 08:45:53.153515 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-76fd8fef-ff9e-462b-9e77-e5c7524fc042 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'name': 'tempest-AttachVolumeShelveTestJSON-230900396-router', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12'}], 'enable_snat': True}, 'gw_port_id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:04Z', 'updated_at': '2021-09-18T08:38:12Z', 'revision_number': 4, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'gw_port': {'id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:ed:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:05Z', 'updated_at': '2021-09-18T08:38:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': '5c658964-1086-4b4a-a459-5019e1da8dc0', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'floating_ip_address': '172.27.1.181', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'port_id': 'fb17b7f6-af82-4371-b33a-e2a9b265ea42', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 626, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'mac_address': 'fa:16:3e:21:d8:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a40b16b8-10f1-416c-933c-1f01dd483851', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:45:32Z', 'updated_at': '2021-09-18T08:45:51Z', 'revision_number': 1, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '09652b84-a3b3-476f-815f-f0c78f8543ba', 'name': '', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'mac_address': 'fa:16:3e:20:cb:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:10Z', 'updated_at': '2021-09-18T08:38:18Z', 'revision_number': 5, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'subnets': [{'id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:45:53.180803 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-76fd8fef-ff9e-462b-9e77-e5c7524fc042 None None] The sync data for ids ['73ec8685-1119-4d34-a85d-af65c74d9e25'] in dv-cinder-804470-6-iscsi is: [{'id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'name': 'tempest-AttachVolumeShelveTestJSON-230900396-router', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12'}], 'enable_snat': True}, 'gw_port_id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:04Z', 'updated_at': '2021-09-18T08:38:12Z', 'revision_number': 4, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'gw_port': {'id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:ed:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:05Z', 'updated_at': '2021-09-18T08:38:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': '5c658964-1086-4b4a-a459-5019e1da8dc0', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'floating_ip_address': '172.27.1.181', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'port_id': 'fb17b7f6-af82-4371-b33a-e2a9b265ea42', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 626, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'mac_address': 'fa:16:3e:21:d8:84', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a40b16b8-10f1-416c-933c-1f01dd483851', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:45:32Z', 'updated_at': '2021-09-18T08:45:51Z', 'revision_number': 1, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '09652b84-a3b3-476f-815f-f0c78f8543ba', 'name': '', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'mac_address': 'fa:16:3e:20:cb:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:10Z', 'updated_at': '2021-09-18T08:38:18Z', 'revision_number': 5, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'subnets': [{'id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:45:53.214664 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:53.226784 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47907bf6-36bb-4d18-9b94-19f1ae4aaa77 req-8857cc47-63eb-464f-b78b-b1892375d573 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:53.228304 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-47907bf6-36bb-4d18-9b94-19f1ae4aaa77 req-8857cc47-63eb-464f-b78b-b1892375d573 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=f430397d-03a8-4da2-bd1d-25890a3a0727&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0832901 Sep 18 08:45:53.256551 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_common [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-1fa358da-ae68-4492-8b5b-d7db73205878 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Allocated IP 172.20.0.9 (344dbdfa-9f7e-4311-9160-286f3356d748/46d0ba5d-1c6d-4148-a267-3aba2885e5ce/43836ca4-b347-4c25-8ca1-83794a17feac) {{(pid=94347) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:45:53.358145 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:53.366441 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-47907bf6-36bb-4d18-9b94-19f1ae4aaa77 req-4d31ed7d-3379-4670-84df-1da03cadf80c service neutron] 10.222.0.13 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1298954 Sep 18 08:45:53.379266 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2bb5d9a3-c2e6-477b-9e83-e226ff670907 None None] New status for floating IP 5c658964-1086-4b4a-a459-5019e1da8dc0: ACTIVE {{(pid=94349) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 18 08:45:53.524023 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-47907bf6-36bb-4d18-9b94-19f1ae4aaa77 req-ee31172e-551c-447d-8643-1ad6cba5f962 service neutron] 10.222.0.13 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1477935 Sep 18 08:45:53.526788 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-1fa358da-ae68-4492-8b5b-d7db73205878 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Notify callbacks [] for port, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:53.566464 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-1fa358da-ae68-4492-8b5b-d7db73205878 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:53.608035 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-1fa358da-ae68-4492-8b5b-d7db73205878 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Network 344dbdfa-9f7e-4311-9160-286f3356d748 is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:45:53.611097 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-1fa358da-ae68-4492-8b5b-d7db73205878 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:45:53.613525 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-1fa358da-ae68-4492-8b5b-d7db73205878 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Received port after_create {{(pid=94347) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:45:53.655234 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fa358da-ae68-4492-8b5b-d7db73205878 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Pushing event updated for resources: {'Port': ['ID=43836ca4-b347-4c25-8ca1-83794a17feac,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:45:53.673678 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-1fa358da-ae68-4492-8b5b-d7db73205878 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:53.674293 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-1fa358da-ae68-4492-8b5b-d7db73205878 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:53.687335 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-1fa358da-ae68-4492-8b5b-d7db73205878 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8273869 Sep 18 08:45:53.705398 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-28c7ea78-0423-4605-b410-20169878516a service neutron] Request body: {'port': {'device_id': '4826cd28-72c8-4b55-af33-4e175feee25f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80447'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:45:53.755024 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-28c7ea78-0423-4605-b410-20169878516a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:54.175346 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c10dd93-e6ce-4f29-b63b-a8de02a11bf3 req-41c554f6-0e57-4aa6-95c0-49cfd6758c73 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:54.176810 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7c10dd93-e6ce-4f29-b63b-a8de02a11bf3 req-41c554f6-0e57-4aa6-95c0-49cfd6758c73 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=4826cd28-72c8-4b55-af33-4e175feee25f HTTP/1.1" status: 200 len: 931 time: 0.0774462 Sep 18 08:45:54.255631 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7c10dd93-e6ce-4f29-b63b-a8de02a11bf3 req-f10bbb5c-97f1-4501-9764-cda06693bfd9 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0483904 Sep 18 08:45:54.316411 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-28c7ea78-0423-4605-b410-20169878516a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 43836ca4-b347-4c25-8ca1-83794a17feac {{(pid=94347) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:45:54.324426 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-28c7ea78-0423-4605-b410-20169878516a service neutron] Notify callbacks [] for port, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:54.335835 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.provisioning_blocks [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-28c7ea78-0423-4605-b410-20169878516a service neutron] Transition to ACTIVE for port object 43836ca4-b347-4c25-8ca1-83794a17feac will not be triggered until provisioned by entity L2. {{(pid=94347) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 18 08:45:54.339531 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-28c7ea78-0423-4605-b410-20169878516a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:54.386513 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28c7ea78-0423-4605-b410-20169878516a service neutron] Pushing event updated for resources: {'Port': ['ID=43836ca4-b347-4c25-8ca1-83794a17feac,revision_number=2']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:45:54.454168 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-28c7ea78-0423-4605-b410-20169878516a service neutron] Attempting to bind port 43836ca4-b347-4c25-8ca1-83794a17feac on host hv-cinder-80447 for vnic_type normal with profile {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:45:54.454502 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-28c7ea78-0423-4605-b410-20169878516a service neutron] Attempting to bind port 43836ca4-b347-4c25-8ca1-83794a17feac by drivers openvswitch,hyperv on host hv-cinder-80447 at level 0 using segments [{'id': '020db71b-b4f2-4e88-b835-5db154c945b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 204, 'network_id': '344dbdfa-9f7e-4311-9160-286f3356d748'}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:45:54.454827 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-28c7ea78-0423-4605-b410-20169878516a service neutron] Attempting to bind port 43836ca4-b347-4c25-8ca1-83794a17feac on network 344dbdfa-9f7e-4311-9160-286f3356d748 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:45:54.458901 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-28c7ea78-0423-4605-b410-20169878516a service neutron] Port 43836ca4-b347-4c25-8ca1-83794a17feac on network 344dbdfa-9f7e-4311-9160-286f3356d748 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80447 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 18 08:45:54.459218 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-28c7ea78-0423-4605-b410-20169878516a service neutron] Attempting to bind port 43836ca4-b347-4c25-8ca1-83794a17feac on network 344dbdfa-9f7e-4311-9160-286f3356d748 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:45:54.463832 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-28c7ea78-0423-4605-b410-20169878516a service neutron] Checking agent: {'id': '8d51fdc4-974b-4200-9c3f-5dddea60a869', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80447', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'started_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 45, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:45:54.464166 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-28c7ea78-0423-4605-b410-20169878516a service neutron] Checking segment: {'id': '020db71b-b4f2-4e88-b835-5db154c945b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 204, 'network_id': '344dbdfa-9f7e-4311-9160-286f3356d748'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94347) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:45:54.464543 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-28c7ea78-0423-4605-b410-20169878516a service neutron] Bound using segment: {'id': '020db71b-b4f2-4e88-b835-5db154c945b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 204, 'network_id': '344dbdfa-9f7e-4311-9160-286f3356d748'} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:45:54.464962 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-28c7ea78-0423-4605-b410-20169878516a service neutron] Bound port: 43836ca4-b347-4c25-8ca1-83794a17feac, host: hv-cinder-80447, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '020db71b-b4f2-4e88-b835-5db154c945b2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 204, 'network_id': '344dbdfa-9f7e-4311-9160-286f3356d748'}}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:45:54.465361 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-28c7ea78-0423-4605-b410-20169878516a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:54.525030 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-28c7ea78-0423-4605-b410-20169878516a service neutron] For port 43836ca4-b347-4c25-8ca1-83794a17feac, host hv-cinder-80447, cleared binding levels {{(pid=94347) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:45:54.527890 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-28c7ea78-0423-4605-b410-20169878516a service neutron] For port 43836ca4-b347-4c25-8ca1-83794a17feac, host hv-cinder-80447, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=43836ca4-b347-4c25-8ca1-83794a17feac,segment=NetworkSegment(020db71b-b4f2-4e88-b835-5db154c945b2),segment_id=020db71b-b4f2-4e88-b835-5db154c945b2)] {{(pid=94347) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:45:54.532322 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-28c7ea78-0423-4605-b410-20169878516a service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:54.564478 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-28c7ea78-0423-4605-b410-20169878516a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:54.565096 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-28c7ea78-0423-4605-b410-20169878516a service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:54.566502 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-28c7ea78-0423-4605-b410-20169878516a service neutron] 10.222.0.13 "PUT /v2.0/ports/43836ca4-b347-4c25-8ca1-83794a17feac HTTP/1.1" status: 200 len: 1093 time: 0.8651145 Sep 18 08:45:54.566942 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4826cd28-72c8-4b55-af33-4e175feee25f', 'tag': '43836ca4-b347-4c25-8ca1-83794a17feac'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:45:54.569174 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b4bcd6bb-e55d-4ddc-a2a2-6ef9e95f0711" -d '{"events": [{"name": "network-changed", "server_uuid": "4826cd28-72c8-4b55-af33-4e175feee25f", "tag": "43836ca4-b347-4c25-8ca1-83794a17feac"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:45:54.595836 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28c7ea78-0423-4605-b410-20169878516a service neutron] Pushing event updated for resources: {'Port': ['ID=43836ca4-b347-4c25-8ca1-83794a17feac,revision_number=3']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:45:54.607512 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:45:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-62eb4058-9d77-428c-ba53-5569bb4282e1 x-openstack-request-id: req-62eb4058-9d77-428c-ba53-5569bb4282e1 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:45:54.607803 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4826cd28-72c8-4b55-af33-4e175feee25f", "tag": "43836ca4-b347-4c25-8ca1-83794a17feac", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:45:54.608056 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-62eb4058-9d77-428c-ba53-5569bb4282e1 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:45:54.608449 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4826cd28-72c8-4b55-af33-4e175feee25f', 'tag': '43836ca4-b347-4c25-8ca1-83794a17feac', 'status': 'completed', 'code': 200} Sep 18 08:45:54.674394 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-6626c815-40e1-441b-a58f-35c2969f0776 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:54.675932 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-6626c815-40e1-441b-a58f-35c2969f0776 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=e54453321aba48dc881baeadd2c69473&device_id=4826cd28-72c8-4b55-af33-4e175feee25f HTTP/1.1" status: 200 len: 1096 time: 0.0428190 Sep 18 08:45:54.723942 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-9f1909c5-13ac-4783-b4d3-8955835f2715 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=43836ca4-b347-4c25-8ca1-83794a17feac HTTP/1.1" status: 200 len: 217 time: 0.0334253 Sep 18 08:45:54.771134 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-ea137139-c0cd-4ddc-8328-06b45bb2179e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:54.773107 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-ea137139-c0cd-4ddc-8328-06b45bb2179e service neutron] 10.222.0.13 "GET /v2.0/subnets?id=46d0ba5d-1c6d-4148-a267-3aba2885e5ce HTTP/1.1" status: 200 len: 854 time: 0.0420604 Sep 18 08:45:54.807095 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-56249c34-5448-4a37-8a0b-3f67399079a4 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=344dbdfa-9f7e-4311-9160-286f3356d748&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0266755 Sep 18 08:45:54.881413 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:54.894369 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-34b87657-8820-44ed-a06c-1daf512a9c22 service neutron] 10.222.0.13 "GET /v2.0/networks/344dbdfa-9f7e-4311-9160-286f3356d748?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0800231 Sep 18 08:45:54.986410 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a87e2196-4ea2-4819-8e6c-4ca072ef78f6 req-53f70ea7-7042-4fe3-b640-52e805c511f9 service neutron] 10.222.0.13 "GET /v2.0/networks/344dbdfa-9f7e-4311-9160-286f3356d748?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0845401 Sep 18 08:45:55.123221 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4bcd6bb-e55d-4ddc-a2a2-6ef9e95f0711 req-defacfcf-1356-4da1-ac90-60693c7d5ddb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:55.124674 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b4bcd6bb-e55d-4ddc-a2a2-6ef9e95f0711 req-defacfcf-1356-4da1-ac90-60693c7d5ddb service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=e54453321aba48dc881baeadd2c69473&device_id=4826cd28-72c8-4b55-af33-4e175feee25f HTTP/1.1" status: 200 len: 1096 time: 0.0384195 Sep 18 08:45:55.215313 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4bcd6bb-e55d-4ddc-a2a2-6ef9e95f0711 req-2cf864bd-667a-4f2c-b362-36b91f3856eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:55.216747 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b4bcd6bb-e55d-4ddc-a2a2-6ef9e95f0711 req-2cf864bd-667a-4f2c-b362-36b91f3856eb service neutron] 10.222.0.13 "GET /v2.0/networks?id=344dbdfa-9f7e-4311-9160-286f3356d748 HTTP/1.1" status: 200 len: 915 time: 0.0839994 Sep 18 08:45:55.257803 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b4bcd6bb-e55d-4ddc-a2a2-6ef9e95f0711 req-9e036172-e37f-4682-9166-49f60a29eb5e service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=43836ca4-b347-4c25-8ca1-83794a17feac HTTP/1.1" status: 200 len: 217 time: 0.0331404 Sep 18 08:45:55.304936 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4bcd6bb-e55d-4ddc-a2a2-6ef9e95f0711 req-b066c6d4-ba59-431a-ba28-2b02ca933d08 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:55.306444 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b4bcd6bb-e55d-4ddc-a2a2-6ef9e95f0711 req-b066c6d4-ba59-431a-ba28-2b02ca933d08 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=46d0ba5d-1c6d-4148-a267-3aba2885e5ce HTTP/1.1" status: 200 len: 854 time: 0.0420194 Sep 18 08:45:55.344968 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b4bcd6bb-e55d-4ddc-a2a2-6ef9e95f0711 req-2e366ad0-fbe8-4046-9a4a-b1a3a4d6afbd service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=344dbdfa-9f7e-4311-9160-286f3356d748&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0315757 Sep 18 08:45:55.435329 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c062bbc-afa5-4af7-a0a5-5da0d415d74e req-39b110f7-3ab5-467a-9813-dfd40626c1fc tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:55.436738 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4c062bbc-afa5-4af7-a0a5-5da0d415d74e req-39b110f7-3ab5-467a-9813-dfd40626c1fc tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=4826cd28-72c8-4b55-af33-4e175feee25f HTTP/1.1" status: 200 len: 943 time: 0.1143951 Sep 18 08:45:55.472528 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b4bcd6bb-e55d-4ddc-a2a2-6ef9e95f0711 req-d8600d63-73ee-4ae0-be0a-61611b17d60c service neutron] 10.222.0.13 "GET /v2.0/networks/344dbdfa-9f7e-4311-9160-286f3356d748?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1113374 Sep 18 08:45:55.507744 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4c062bbc-afa5-4af7-a0a5-5da0d415d74e req-e11dd19c-20e3-4f2f-996f-8367636a5eaa tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0637133 Sep 18 08:45:55.573279 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b4bcd6bb-e55d-4ddc-a2a2-6ef9e95f0711 req-fab3b4d7-7cf7-4b11-9aed-d1b588e08eec service neutron] 10.222.0.13 "GET /v2.0/networks/344dbdfa-9f7e-4311-9160-286f3356d748?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0918434 Sep 18 08:45:56.619489 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bc6cc73-15b3-4998-9dc0-594f374d052a req-eb403464-391c-4d36-bbd8-344b929ef94e tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:56.620962 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9bc6cc73-15b3-4998-9dc0-594f374d052a req-eb403464-391c-4d36-bbd8-344b929ef94e tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=4826cd28-72c8-4b55-af33-4e175feee25f HTTP/1.1" status: 200 len: 943 time: 0.0472925 Sep 18 08:45:56.657616 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9bc6cc73-15b3-4998-9dc0-594f374d052a req-aabe0844-d359-4066-8af1-a7d4986923be tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0309162 Sep 18 08:45:57.771575 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8986ac09-4df8-4a11-9f05-2fb43d525294 req-4f3d0a5b-bc80-4b30-8213-cfea4293f23a tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:57.773482 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8986ac09-4df8-4a11-9f05-2fb43d525294 req-4f3d0a5b-bc80-4b30-8213-cfea4293f23a tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=4826cd28-72c8-4b55-af33-4e175feee25f HTTP/1.1" status: 200 len: 943 time: 0.0517066 Sep 18 08:45:57.809809 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8986ac09-4df8-4a11-9f05-2fb43d525294 req-d84ccf69-0ff5-42e0-ad2f-0b884378c151 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0306072 Sep 18 08:45:58.919462 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-757cd6aa-c941-4295-bdbe-4a211abc4d20 req-a4da53e9-c24e-47de-a953-4b329eaf2894 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:45:58.920967 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-757cd6aa-c941-4295-bdbe-4a211abc4d20 req-a4da53e9-c24e-47de-a953-4b329eaf2894 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=4826cd28-72c8-4b55-af33-4e175feee25f HTTP/1.1" status: 200 len: 943 time: 0.0465255 Sep 18 08:45:58.958305 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-757cd6aa-c941-4295-bdbe-4a211abc4d20 req-5165dec1-8899-46ac-b950-e7c1b1000db3 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0315220 Sep 18 08:45:59.184549 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 43836ca4-b347-4c25-8ca1-83794a17feac details requested by agent hyperv_hv-cinder-80447 with host hv-cinder-80447 {{(pid=94348) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 18 08:45:59.279770 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 43836ca4-b347-4c25-8ca1-83794a17feac, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=43836ca4-b347-4c25-8ca1-83794a17feac,segment=NetworkSegment(020db71b-b4f2-4e88-b835-5db154c945b2),segment_id=020db71b-b4f2-4e88-b835-5db154c945b2)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:45:59.405078 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Returning: {'device': '43836ca4-b347-4c25-8ca1-83794a17feac', 'network_id': '344dbdfa-9f7e-4311-9160-286f3356d748', 'port_id': '43836ca4-b347-4c25-8ca1-83794a17feac', 'mac_address': 'fa:16:3e:40:bb:58', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 204, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '46d0ba5d-1c6d-4148-a267-3aba2885e5ce', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94348) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 18 08:45:59.441521 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:59.454259 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 43836ca4-b347-4c25-8ca1-83794a17feac {{(pid=94348) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:45:59.474230 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 43836ca4-b347-4c25-8ca1-83794a17feac, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=43836ca4-b347-4c25-8ca1-83794a17feac,segment=NetworkSegment(020db71b-b4f2-4e88-b835-5db154c945b2),segment_id=020db71b-b4f2-4e88-b835-5db154c945b2)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:45:59.477641 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:45:59.523580 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=43836ca4-b347-4c25-8ca1-83794a17feac,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:45:59.530766 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:59.531122 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:59.531468 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:59.531809 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:59.532145 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:59.532478 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:59.532829 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:59.533142 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:59.533520 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:59.533855 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:59.534183 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:59.534508 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:45:59.939470 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['43836ca4-b347-4c25-8ca1-83794a17feac'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:46:00.082714 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-877b11bd-20a7-413c-baf8-1053e9502407 req-52abbf31-8f0a-4a89-b54f-daa51ca2a0ac tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:00.084183 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-877b11bd-20a7-413c-baf8-1053e9502407 req-52abbf31-8f0a-4a89-b54f-daa51ca2a0ac tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=4826cd28-72c8-4b55-af33-4e175feee25f HTTP/1.1" status: 200 len: 944 time: 0.0550685 Sep 18 08:46:00.122111 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-877b11bd-20a7-413c-baf8-1053e9502407 req-db204f34-d73d-4f18-9104-8fb5d60703d5 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0313377 Sep 18 08:46:01.189753 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 43836ca4-b347-4c25-8ca1-83794a17feac up at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:46:01.235310 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cfce50e-d7f8-4124-b0d1-673d4a5f2ad2 req-aaed380c-8bfc-4b83-9a69-395238e1d6a2 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:01.237067 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9cfce50e-d7f8-4124-b0d1-673d4a5f2ad2 req-aaed380c-8bfc-4b83-9a69-395238e1d6a2 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=4826cd28-72c8-4b55-af33-4e175feee25f HTTP/1.1" status: 200 len: 944 time: 0.0510781 Sep 18 08:46:01.238770 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning for port 43836ca4-b347-4c25-8ca1-83794a17feac completed by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 18 08:46:01.243004 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning complete for port 43836ca4-b347-4c25-8ca1-83794a17feac triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:46:01.243518 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:01.275750 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9cfce50e-d7f8-4124-b0d1-673d4a5f2ad2 req-11a929c3-7dce-4bbd-b296-9d2cd10a438f tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0316482 Sep 18 08:46:01.322013 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:01.343812 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4826cd28-72c8-4b55-af33-4e175feee25f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '43836ca4-b347-4c25-8ca1-83794a17feac'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:46:01.346333 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e1c4ccc1-854d-4406-b6b7-b3e9aa83e959" -d '{"events": [{"server_uuid": "4826cd28-72c8-4b55-af33-4e175feee25f", "name": "network-vif-plugged", "status": "completed", "tag": "43836ca4-b347-4c25-8ca1-83794a17feac"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:46:01.359450 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 43836ca4-b347-4c25-8ca1-83794a17feac, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=43836ca4-b347-4c25-8ca1-83794a17feac,segment=NetworkSegment(020db71b-b4f2-4e88-b835-5db154c945b2),segment_id=020db71b-b4f2-4e88-b835-5db154c945b2)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:46:01.363564 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:01.386275 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:46:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-056d7980-a532-406b-8568-48010f02aea2 x-openstack-request-id: req-056d7980-a532-406b-8568-48010f02aea2 {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:46:01.386568 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4826cd28-72c8-4b55-af33-4e175feee25f", "name": "network-vif-plugged", "status": "completed", "tag": "43836ca4-b347-4c25-8ca1-83794a17feac", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:46:01.386822 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-056d7980-a532-406b-8568-48010f02aea2 {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:46:01.387211 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4826cd28-72c8-4b55-af33-4e175feee25f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '43836ca4-b347-4c25-8ca1-83794a17feac', 'code': 200} Sep 18 08:46:01.411273 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=43836ca4-b347-4c25-8ca1-83794a17feac,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:01.614691 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09adebb0-f939-4d95-91d1-b1f84e853ef5 req-d852a5ee-5d32-4e91-9f02-1d2405ed2ed1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:01.616204 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-09adebb0-f939-4d95-91d1-b1f84e853ef5 req-d852a5ee-5d32-4e91-9f02-1d2405ed2ed1 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=4826cd28-72c8-4b55-af33-4e175feee25f HTTP/1.1" status: 200 len: 1098 time: 0.0390992 Sep 18 08:46:01.649679 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-09adebb0-f939-4d95-91d1-b1f84e853ef5 req-5b9f08fe-e282-466d-81aa-2edf8b5b1777 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0267093 Sep 18 08:46:02.390696 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a6a36a5-9347-42f8-9572-1b2319a1363e req-411a6369-a113-4142-8efa-f5441546d334 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:02.392190 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7a6a36a5-9347-42f8-9572-1b2319a1363e req-411a6369-a113-4142-8efa-f5441546d334 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=4826cd28-72c8-4b55-af33-4e175feee25f HTTP/1.1" status: 200 len: 945 time: 0.0484807 Sep 18 08:46:02.428575 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7a6a36a5-9347-42f8-9572-1b2319a1363e req-cc6f004a-b6c0-4376-86b3-8681109f8ad3 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0299983 Sep 18 08:46:03.546262 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-906e36c0-65f5-425c-9673-e915327b3b95 req-910de96b-0ec4-406c-be23-84f5c87f5072 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:03.547858 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-906e36c0-65f5-425c-9673-e915327b3b95 req-910de96b-0ec4-406c-be23-84f5c87f5072 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=4826cd28-72c8-4b55-af33-4e175feee25f HTTP/1.1" status: 200 len: 945 time: 0.0537400 Sep 18 08:46:03.588932 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-906e36c0-65f5-425c-9673-e915327b3b95 req-2c8ff43e-f036-4d4d-8cac-c85c7ea23519 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0337696 Sep 18 08:46:04.705458 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee2eeed4-acfd-49f8-ad11-9a718379cf26 req-ab3f72e6-6851-471a-9bf9-2066e99df196 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:04.706976 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ee2eeed4-acfd-49f8-ad11-9a718379cf26 req-ab3f72e6-6851-471a-9bf9-2066e99df196 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=4826cd28-72c8-4b55-af33-4e175feee25f HTTP/1.1" status: 200 len: 945 time: 0.0489042 Sep 18 08:46:04.746336 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ee2eeed4-acfd-49f8-ad11-9a718379cf26 req-1c46311e-a25c-48d8-8820-ff5b9c6f0cd8 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0329072 Sep 18 08:46:06.706082 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:46:18.409414 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e034fccf-cb2c-40c0-861e-f97ec59ba1da req-9fb1f02d-7bab-497b-bde5-596dae0cdd2c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:18.410892 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e034fccf-cb2c-40c0-861e-f97ec59ba1da req-9fb1f02d-7bab-497b-bde5-596dae0cdd2c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 945 time: 0.0477176 Sep 18 08:46:18.447118 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e034fccf-cb2c-40c0-861e-f97ec59ba1da req-0dcdccd3-33e4-4815-9be3-ce9675f92fa4 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0303662 Sep 18 08:46:19.563815 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ee3f275-95a4-417c-95dd-9b45041d0402 req-10ae7abf-88f4-4d54-ba94-ec90a92c2d3b tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:19.565423 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8ee3f275-95a4-417c-95dd-9b45041d0402 req-10ae7abf-88f4-4d54-ba94-ec90a92c2d3b tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 945 time: 0.0521615 Sep 18 08:46:19.607303 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8ee3f275-95a4-417c-95dd-9b45041d0402 req-e2b32330-2734-4d5c-86b5-8f11fcae62ee tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0359979 Sep 18 08:46:19.616958 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-addb148b-8b01-49ea-b926-184037dbeb3d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:20.016027 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:20.716791 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a21b9ef-21a9-4a6c-85e2-753d1353a8d9 req-fb7d40bd-5fd0-41a8-a416-363a5e59387a tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:20.718284 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5a21b9ef-21a9-4a6c-85e2-753d1353a8d9 req-fb7d40bd-5fd0-41a8-a416-363a5e59387a tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 945 time: 0.0470691 Sep 18 08:46:20.755494 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5a21b9ef-21a9-4a6c-85e2-753d1353a8d9 req-55a800d2-d95e-4c9c-b528-d289f8cbc694 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0312309 Sep 18 08:46:21.866901 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1b553ee-5f21-49c1-9d93-e782369951e0 req-5e7b0af3-f87e-4d19-ab29-88fa446aa3af tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:21.868413 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f1b553ee-5f21-49c1-9d93-e782369951e0 req-5e7b0af3-f87e-4d19-ab29-88fa446aa3af tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 945 time: 0.0481157 Sep 18 08:46:21.907735 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f1b553ee-5f21-49c1-9d93-e782369951e0 req-4831f4c7-e468-44e1-839b-15bec32213c7 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0328140 Sep 18 08:46:22.406663 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-58330f33-f336-4769-9a52-fd8f0d47d4e1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:23.024428 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bea9470-006c-44c3-ace5-21892b08bd35 req-d8f3440f-7996-4ab4-9c82-28d8edafa79d tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:23.025964 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8bea9470-006c-44c3-ace5-21892b08bd35 req-d8f3440f-7996-4ab4-9c82-28d8edafa79d tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 945 time: 0.0515244 Sep 18 08:46:23.062254 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8bea9470-006c-44c3-ace5-21892b08bd35 req-1499b258-2f82-45e4-9329-956c4f78d2e0 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0303788 Sep 18 08:46:23.184143 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8feab33-9d64-4b9a-b091-b01d34816ffd req-2fb83890-dbcb-41f9-8477-2840bbcde163 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0391502 Sep 18 08:46:23.216531 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:23.295361 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8feab33-9d64-4b9a-b091-b01d34816ffd req-90d70532-4340-4679-b10d-136b692effdf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:23.296818 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8feab33-9d64-4b9a-b091-b01d34816ffd req-90d70532-4340-4679-b10d-136b692effdf service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=62a8d3b5ed4d4fe085db724f264e25c4&device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 1138 time: 0.0382462 Sep 18 08:46:23.359759 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:23.410988 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8feab33-9d64-4b9a-b091-b01d34816ffd req-ac33aa74-5b85-4491-8e9e-e362beac31a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:23.412396 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8feab33-9d64-4b9a-b091-b01d34816ffd req-ac33aa74-5b85-4491-8e9e-e362beac31a1 service neutron] 10.222.0.13 "GET /v2.0/networks?id=48bd9423-5b85-4344-9434-17e10e227731 HTTP/1.1" status: 200 len: 916 time: 0.0958054 Sep 18 08:46:23.474611 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dc62cc3f-1cf8-49bd-ae04-4d85a128ef3f req-e6fa11c8-a136-420f-a59e-8c53706612b3 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1101793206&fields=id&tenant_id=62a8d3b5ed4d4fe085db724f264e25c4 HTTP/1.1" status: 200 len: 267 time: 0.0712662 Sep 18 08:46:23.499412 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8feab33-9d64-4b9a-b091-b01d34816ffd req-119a151f-f208-46dc-8912-cb742b9bf504 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a16828fd-b0f1-4ba0-a92a-61614fabe668 HTTP/1.1" status: 200 len: 1002 time: 0.0791445 Sep 18 08:46:23.569779 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc62cc3f-1cf8-49bd-ae04-4d85a128ef3f req-b6410db6-986c-4f83-94a7-e383ef2b545e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:23.571236 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dc62cc3f-1cf8-49bd-ae04-4d85a128ef3f req-b6410db6-986c-4f83-94a7-e383ef2b545e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 985 time: 0.0885820 Sep 18 08:46:23.578084 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8feab33-9d64-4b9a-b091-b01d34816ffd req-0418e6ce-b4e5-40a2-945c-ba0f589ab13e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:23.579428 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8feab33-9d64-4b9a-b091-b01d34816ffd req-0418e6ce-b4e5-40a2-945c-ba0f589ab13e service neutron] 10.222.0.13 "GET /v2.0/subnets?id=95fb2797-9ac9-40f9-9ea9-56d2c5a16291 HTTP/1.1" status: 200 len: 854 time: 0.0575044 Sep 18 08:46:23.584694 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-dc62cc3f-1cf8-49bd-ae04-4d85a128ef3f req-6c7563a1-75e1-470c-8631-d9af94ae464d tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Request body: {'port': {'security_groups': ['207d68f0-4931-4c69-8d7d-61006b3de552']}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:46:23.682604 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-dc62cc3f-1cf8-49bd-ae04-4d85a128ef3f req-6c7563a1-75e1-470c-8631-d9af94ae464d tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:23.692148 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8feab33-9d64-4b9a-b091-b01d34816ffd req-9ae714b4-4358-4340-b3d7-33eb85682346 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:23.694009 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8feab33-9d64-4b9a-b091-b01d34816ffd req-9ae714b4-4358-4340-b3d7-33eb85682346 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=48bd9423-5b85-4344-9434-17e10e227731&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1041799 Sep 18 08:46:23.848747 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8feab33-9d64-4b9a-b091-b01d34816ffd req-bfdf2467-b3b9-4a0e-acd9-55379bf8d721 service neutron] 10.222.0.13 "GET /v2.0/networks/48bd9423-5b85-4344-9434-17e10e227731?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1293957 Sep 18 08:46:23.979843 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-dc62cc3f-1cf8-49bd-ae04-4d85a128ef3f req-6c7563a1-75e1-470c-8631-d9af94ae464d tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] For port a16828fd-b0f1-4ba0-a92a-61614fabe668, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=a16828fd-b0f1-4ba0-a92a-61614fabe668,segment=NetworkSegment(5d556fd8-f02d-4c49-9c67-863cea39ec4a),segment_id=5d556fd8-f02d-4c49-9c67-863cea39ec4a)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:46:24.002007 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8feab33-9d64-4b9a-b091-b01d34816ffd req-6755c129-1747-48ce-8bf9-66039543eb63 service neutron] 10.222.0.13 "GET /v2.0/networks/48bd9423-5b85-4344-9434-17e10e227731?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1436248 Sep 18 08:46:24.018306 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-dc62cc3f-1cf8-49bd-ae04-4d85a128ef3f req-6c7563a1-75e1-470c-8631-d9af94ae464d tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for port, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:24.024031 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-dc62cc3f-1cf8-49bd-ae04-4d85a128ef3f req-6c7563a1-75e1-470c-8631-d9af94ae464d tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:24.068909 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc62cc3f-1cf8-49bd-ae04-4d85a128ef3f req-6c7563a1-75e1-470c-8631-d9af94ae464d tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:24.069677 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-dc62cc3f-1cf8-49bd-ae04-4d85a128ef3f req-6c7563a1-75e1-470c-8631-d9af94ae464d tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:24.071131 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dc62cc3f-1cf8-49bd-ae04-4d85a128ef3f req-6c7563a1-75e1-470c-8631-d9af94ae464d tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "PUT /v2.0/ports/a16828fd-b0f1-4ba0-a92a-61614fabe668 HTTP/1.1" status: 200 len: 943 time: 0.4908175 Sep 18 08:46:24.071655 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e85a7284-e6ea-47ab-9674-09d8666b742f', 'tag': 'a16828fd-b0f1-4ba0-a92a-61614fabe668'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:46:24.074024 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c4179af0-564d-4904-a0cc-f4b006e72009" -d '{"events": [{"name": "network-changed", "server_uuid": "e85a7284-e6ea-47ab-9674-09d8666b742f", "tag": "a16828fd-b0f1-4ba0-a92a-61614fabe668"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:46:24.080018 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 36534) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:46:24.080503 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['a16828fd-b0f1-4ba0-a92a-61614fabe668'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:46:24.105721 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c7563a1-75e1-470c-8631-d9af94ae464d tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Pushing event updated for resources: {'Port': ['ID=a16828fd-b0f1-4ba0-a92a-61614fabe668,revision_number=7']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:24.181329 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:46:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-78713a5e-8965-4c0f-8d62-9d4def765d6a x-openstack-request-id: req-78713a5e-8965-4c0f-8d62-9d4def765d6a {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:46:24.181827 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e85a7284-e6ea-47ab-9674-09d8666b742f", "tag": "a16828fd-b0f1-4ba0-a92a-61614fabe668", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:46:24.182238 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-78713a5e-8965-4c0f-8d62-9d4def765d6a {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:46:24.182782 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e85a7284-e6ea-47ab-9674-09d8666b742f', 'tag': 'a16828fd-b0f1-4ba0-a92a-61614fabe668', 'status': 'completed', 'code': 200} Sep 18 08:46:24.232581 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0086876c-e878-4a60-ac0e-2d77899b72fc req-caba9c3f-94f8-46ea-93d8-d22db5eb8045 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:24.234187 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0086876c-e878-4a60-ac0e-2d77899b72fc req-caba9c3f-94f8-46ea-93d8-d22db5eb8045 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 945 time: 0.0636024 Sep 18 08:46:24.305690 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-462a6371-e5d5-4768-bb5b-0958609c4dae tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:24.337135 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0086876c-e878-4a60-ac0e-2d77899b72fc req-db9ed401-6030-4e91-b374-327f1dbf4ca7 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0894322 Sep 18 08:46:24.339745 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-462a6371-e5d5-4768-bb5b-0958609c4dae tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:24.351956 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4179af0-564d-4904-a0cc-f4b006e72009 req-a5036073-14c7-4963-bb51-59117e5173cc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:24.353556 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c4179af0-564d-4904-a0cc-f4b006e72009 req-a5036073-14c7-4963-bb51-59117e5173cc service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=62a8d3b5ed4d4fe085db724f264e25c4&device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 1099 time: 0.0729105 Sep 18 08:46:24.402573 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-462a6371-e5d5-4768-bb5b-0958609c4dae tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:24.405053 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-462a6371-e5d5-4768-bb5b-0958609c4dae tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:24.406284 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-462a6371-e5d5-4768-bb5b-0958609c4dae tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "DELETE /v2.0/security-groups/a1773be7-b5fe-42cf-af53-72ae4a128df3 HTTP/1.1" status: 204 len: 168 time: 0.3254662 Sep 18 08:46:24.410410 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 36546) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:46:24.421380 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-462a6371-e5d5-4768-bb5b-0958609c4dae tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a1773be7-b5fe-42cf-af53-72ae4a128df3,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:24.439742 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-592c88de-1c68-454b-9177-9a443690977a None None] Provisioning complete for port a16828fd-b0f1-4ba0-a92a-61614fabe668 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:46:24.440224 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-592c88de-1c68-454b-9177-9a443690977a None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:24.469129 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4179af0-564d-4904-a0cc-f4b006e72009 req-4a9ddff7-b614-4120-a880-c66301586df0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:24.471599 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c4179af0-564d-4904-a0cc-f4b006e72009 req-4a9ddff7-b614-4120-a880-c66301586df0 service neutron] 10.222.0.13 "GET /v2.0/networks?id=48bd9423-5b85-4344-9434-17e10e227731 HTTP/1.1" status: 200 len: 916 time: 0.1025648 Sep 18 08:46:24.475336 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['a16828fd-b0f1-4ba0-a92a-61614fabe668'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:46:24.544931 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c4179af0-564d-4904-a0cc-f4b006e72009 req-ae61e422-97a5-41ee-953e-53c8edeec023 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a16828fd-b0f1-4ba0-a92a-61614fabe668 HTTP/1.1" status: 200 len: 1002 time: 0.0630341 Sep 18 08:46:24.578660 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.plugin [None req-a9e92453-5d60-4b8d-afa2-cd6055d63705 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Deleting port 67a080af-449c-444f-93d0-5cb66582b807 {{(pid=94346) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:46:24.579014 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-a9e92453-5d60-4b8d-afa2-cd6055d63705 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:24.653169 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-a9e92453-5d60-4b8d-afa2-cd6055d63705 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:24.653441 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-a9e92453-5d60-4b8d-afa2-cd6055d63705 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:24.665699 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.plugin [None req-a9e92453-5d60-4b8d-afa2-cd6055d63705 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Calling delete_port for 67a080af-449c-444f-93d0-5cb66582b807 owned by network:floatingip {{(pid=94346) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:46:24.710576 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4179af0-564d-4904-a0cc-f4b006e72009 req-e198a249-e9ae-4c20-a6fd-1d3bdb9999e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:24.712037 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c4179af0-564d-4904-a0cc-f4b006e72009 req-e198a249-e9ae-4c20-a6fd-1d3bdb9999e9 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=95fb2797-9ac9-40f9-9ea9-56d2c5a16291 HTTP/1.1" status: 200 len: 854 time: 0.0745175 Sep 18 08:46:24.722791 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cd4221b-77ee-4508-b2bb-ebe4148bcd7c req-06486231-6072-4db2-a630-3d215e1e5944 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:24.724128 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0cd4221b-77ee-4508-b2bb-ebe4148bcd7c req-06486231-6072-4db2-a630-3d215e1e5944 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.13 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 945 time: 0.0789523 Sep 18 08:46:24.791864 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4179af0-564d-4904-a0cc-f4b006e72009 req-63cba9d8-e89e-4214-81aa-417d87e6f545 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:24.793371 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c4179af0-564d-4904-a0cc-f4b006e72009 req-63cba9d8-e89e-4214-81aa-417d87e6f545 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=48bd9423-5b85-4344-9434-17e10e227731&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0683393 Sep 18 08:46:24.838555 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-a9e92453-5d60-4b8d-afa2-cd6055d63705 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:24.879850 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9e92453-5d60-4b8d-afa2-cd6055d63705 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Pushing event deleted for resources: {'Port': ['ID=67a080af-449c-444f-93d0-5cb66582b807,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:24.891786 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:24.902754 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-0cd4221b-77ee-4508-b2bb-ebe4148bcd7c req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Deleting port 3f56fe96-8f0e-4410-8e3c-da651c794d50 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:46:24.903110 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-0cd4221b-77ee-4508-b2bb-ebe4148bcd7c req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:24.934572 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-a9e92453-5d60-4b8d-afa2-cd6055d63705 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks [] for floatingip, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:24.934840 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.db.l3_db [None req-a9e92453-5d60-4b8d-afa2-cd6055d63705 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Floating IP 4ba4ba6b-76bb-404f-89a3-659445347a63 disassociated (deleted). External IP: 172.27.1.115, port: a16828fd-b0f1-4ba0-a92a-61614fabe668. Sep 18 08:46:24.935565 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c4179af0-564d-4904-a0cc-f4b006e72009 req-322fda65-8b24-4781-9b01-9822181a3dae service neutron] 10.222.0.13 "GET /v2.0/networks/48bd9423-5b85-4344-9434-17e10e227731?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1247008 Sep 18 08:46:25.059308 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-0cd4221b-77ee-4508-b2bb-ebe4148bcd7c req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] For port 3f56fe96-8f0e-4410-8e3c-da651c794d50, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=3f56fe96-8f0e-4410-8e3c-da651c794d50,segment=NetworkSegment(c215153d-2878-4c82-8dc0-2a92b453bf12),segment_id=c215153d-2878-4c82-8dc0-2a92b453bf12)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:46:25.059870 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-0cd4221b-77ee-4508-b2bb-ebe4148bcd7c req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:25.122383 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c4179af0-564d-4904-a0cc-f4b006e72009 req-cdf25b8a-848a-4577-887a-dfb402b3c80f service neutron] 10.222.0.13 "GET /v2.0/networks/48bd9423-5b85-4344-9434-17e10e227731?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1794164 Sep 18 08:46:25.139712 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a9e92453-5d60-4b8d-afa2-cd6055d63705 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Router 2406a855-e08c-4bcc-974c-cd88788039b3 has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94346) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:46:25.252061 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-0cd4221b-77ee-4508-b2bb-ebe4148bcd7c req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for floatingip, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:25.252431 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-0cd4221b-77ee-4508-b2bb-ebe4148bcd7c req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-784908'] for floatingip, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:25.252754 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.db.l3_db [req-0cd4221b-77ee-4508-b2bb-ebe4148bcd7c req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Floating IP 4fbfe49e-e2af-4355-b7c5-c404ed6af093 disassociated. External IP: 172.27.1.145, port: 3f56fe96-8f0e-4410-8e3c-da651c794d50. Sep 18 08:46:25.253097 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-0cd4221b-77ee-4508-b2bb-ebe4148bcd7c req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Calling delete_port for 3f56fe96-8f0e-4410-8e3c-da651c794d50 owned by compute:nova {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:46:25.390442 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-0cd4221b-77ee-4508-b2bb-ebe4148bcd7c req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:25.430014 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Pushing event deleted for resources: {'Port': ['ID=3f56fe96-8f0e-4410-8e3c-da651c794d50,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:25.460449 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-40000ce7-6277-471c-b825-81af461834d2 req-7cb08166-2d63-4f87-a6a0-a1a27c360911 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 210 time: 0.0418358 Sep 18 08:46:25.463081 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:46:25.463391 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:46:25.463841 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:46:25.464061 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:46:25.464394 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:46:25.464724 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:46:25.465051 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:46:25.465399 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:46:25.466052 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:46:25.466052 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:46:25.466346 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:46:25.466648 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:46:25.467602 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a9e92453-5d60-4b8d-afa2-cd6055d63705 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94346) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:46:25.476943 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-a9e92453-5d60-4b8d-afa2-cd6055d63705 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for floatingip, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:25.497780 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-474b83c1-51d2-49de-ae25-2c5b1f8421b9 None None] Sync routers for ids ['2406a855-e08c-4bcc-974c-cd88788039b3'] in dv-cinder-804470-6-iscsi {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:46:25.515400 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-a9e92453-5d60-4b8d-afa2-cd6055d63705 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "DELETE /v2.0/floatingips/4ba4ba6b-76bb-404f-89a3-659445347a63 HTTP/1.1" status: 204 len: 168 time: 1.1012568 Sep 18 08:46:25.515400 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'e85a7284-e6ea-47ab-9674-09d8666b742f', 'tag': 'a16828fd-b0f1-4ba0-a92a-61614fabe668'}] {{(pid=94346) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:46:25.515839 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9c65146fa140f7f105fbfe1cfc0ed8a4aa4ddea85af05f4a70363726e3aa059" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-18e78ffc-7322-4316-a275-65d093ac07bb" -d '{"events": [{"name": "network-changed", "server_uuid": "e85a7284-e6ea-47ab-9674-09d8666b742f", "tag": "a16828fd-b0f1-4ba0-a92a-61614fabe668"}]}' {{(pid=94346) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:46:25.518374 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-474b83c1-51d2-49de-ae25-2c5b1f8421b9 None None] Routers {'2406a855-e08c-4bcc-974c-cd88788039b3'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:46:25.519275 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-474b83c1-51d2-49de-ae25-2c5b1f8421b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:46:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['2406a855-e08c-4bcc-974c-cd88788039b3'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:46:25.663268 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-474b83c1-51d2-49de-ae25-2c5b1f8421b9 None None] Set router 2406a855-e08c-4bcc-974c-cd88788039b3 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:46:25.685987 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:46:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2e8b3fac-4241-4c1e-b263-a7c684b5e44f x-openstack-request-id: req-2e8b3fac-4241-4c1e-b263-a7c684b5e44f {{(pid=94346) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:46:25.686454 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "e85a7284-e6ea-47ab-9674-09d8666b742f", "tag": "a16828fd-b0f1-4ba0-a92a-61614fabe668", "status": "completed", "code": 200}]} {{(pid=94346) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:46:25.686788 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-2e8b3fac-4241-4c1e-b263-a7c684b5e44f {{(pid=94346) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:46:25.687444 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'e85a7284-e6ea-47ab-9674-09d8666b742f', 'tag': 'a16828fd-b0f1-4ba0-a92a-61614fabe668', 'status': 'completed', 'code': 200} Sep 18 08:46:25.939779 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18e78ffc-7322-4316-a275-65d093ac07bb req-4fde2c54-e462-4bf0-881f-731b28f59642 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:25.941534 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-18e78ffc-7322-4316-a275-65d093ac07bb req-4fde2c54-e462-4bf0-881f-731b28f59642 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=62a8d3b5ed4d4fe085db724f264e25c4&device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 1099 time: 0.1162143 Sep 18 08:46:25.951498 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-474b83c1-51d2-49de-ae25-2c5b1f8421b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'name': 'tempest-TestMinimumBasicScenario-2061029967-router', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '1c451dba-c399-4ceb-a969-412896a38aec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:12Z', 'revision_number': 4, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'gw_port': {'id': '1c451dba-c399-4ceb-a969-412896a38aec', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:c3:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 441, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': 'cda97d8d-7e99-46b1-937f-0a3ae975c076', 'name': '', 'network_id': '48bd9423-5b85-4344-9434-17e10e227731', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'mac_address': 'fa:16:3e:f2:78:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': '95fb2797-9ac9-40f9-9ea9-56d2c5a16291', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:11Z', 'updated_at': '2021-09-18T08:41:17Z', 'revision_number': 5, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'subnets': [{'id': '95fb2797-9ac9-40f9-9ea9-56d2c5a16291', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:46:25.966379 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.l3_agent_scheduler [req-0cd4221b-77ee-4508-b2bb-ebe4148bcd7c req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Router 4922fc58-f2eb-480a-878f-2bc3f212b4da has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94347) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:46:25.983568 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-474b83c1-51d2-49de-ae25-2c5b1f8421b9 None None] Checking router: 2406a855-e08c-4bcc-974c-cd88788039b3 for host: dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:46:25.996060 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-474b83c1-51d2-49de-ae25-2c5b1f8421b9 None None] Routers {'2406a855-e08c-4bcc-974c-cd88788039b3'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:46:25.997576 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-474b83c1-51d2-49de-ae25-2c5b1f8421b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:46:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['2406a855-e08c-4bcc-974c-cd88788039b3'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:46:26.111566 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-474b83c1-51d2-49de-ae25-2c5b1f8421b9 None None] Set router 2406a855-e08c-4bcc-974c-cd88788039b3 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:46:26.132856 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18e78ffc-7322-4316-a275-65d093ac07bb req-3bdd9882-f8bc-4ab5-99e7-55a9056ffbde service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:26.134371 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-18e78ffc-7322-4316-a275-65d093ac07bb req-3bdd9882-f8bc-4ab5-99e7-55a9056ffbde service neutron] 10.222.0.13 "GET /v2.0/networks?id=48bd9423-5b85-4344-9434-17e10e227731 HTTP/1.1" status: 200 len: 916 time: 0.1669202 Sep 18 08:46:26.182658 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-18e78ffc-7322-4316-a275-65d093ac07bb req-98433ee6-db0b-4204-b98d-1cc75af4433b service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=a16828fd-b0f1-4ba0-a92a-61614fabe668 HTTP/1.1" status: 200 len: 217 time: 0.0366240 Sep 18 08:46:26.184026 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-0cd4221b-77ee-4508-b2bb-ebe4148bcd7c req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94347) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:46:26.194103 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a99a22c-8bc9-4e33-9fb9-a345ff2dee47 None None] Sync routers for ids ['4922fc58-f2eb-480a-878f-2bc3f212b4da'] in dv-cinder-804470-6-iscsi {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:46:26.204486 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a99a22c-8bc9-4e33-9fb9-a345ff2dee47 None None] Routers {'4922fc58-f2eb-480a-878f-2bc3f212b4da'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:46:26.205108 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-4a99a22c-8bc9-4e33-9fb9-a345ff2dee47 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:46:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['4922fc58-f2eb-480a-878f-2bc3f212b4da'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:46:26.223502 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-0cd4221b-77ee-4508-b2bb-ebe4148bcd7c req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] No DVR routers for this DVR port 3f56fe96-8f0e-4410-8e3c-da651c794d50 on host hv-cinder-80447 {{(pid=94347) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:46:26.231920 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-0cd4221b-77ee-4508-b2bb-ebe4148bcd7c req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:26.233973 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0cd4221b-77ee-4508-b2bb-ebe4148bcd7c req-288a1a48-1b50-43f5-beb3-4cf61c24292f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.13 "DELETE /v2.0/ports/3f56fe96-8f0e-4410-8e3c-da651c794d50 HTTP/1.1" status: 204 len: 173 time: 1.5018542 Sep 18 08:46:26.234347 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5c332939-c954-4f64-97d5-07d5b2cb727d', 'name': 'network-vif-deleted', 'tag': '3f56fe96-8f0e-4410-8e3c-da651c794d50'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:46:26.236567 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-de453653-b453-49d2-9c4f-26b57b4d9a2b" -d '{"events": [{"server_uuid": "5c332939-c954-4f64-97d5-07d5b2cb727d", "name": "network-vif-deleted", "tag": "3f56fe96-8f0e-4410-8e3c-da651c794d50"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:46:26.292270 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:46:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-150670a8-8ebc-4734-b4c7-52343d0a54f5 x-openstack-request-id: req-150670a8-8ebc-4734-b4c7-52343d0a54f5 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:46:26.292571 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5c332939-c954-4f64-97d5-07d5b2cb727d", "name": "network-vif-deleted", "tag": "3f56fe96-8f0e-4410-8e3c-da651c794d50", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:46:26.292801 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-150670a8-8ebc-4734-b4c7-52343d0a54f5 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:46:26.293226 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5c332939-c954-4f64-97d5-07d5b2cb727d', 'name': 'network-vif-deleted', 'tag': '3f56fe96-8f0e-4410-8e3c-da651c794d50', 'status': 'completed', 'code': 200} Sep 18 08:46:26.321872 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18e78ffc-7322-4316-a275-65d093ac07bb req-a12fbfcc-098c-49ac-aeca-8c951ebc3fec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:26.323879 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-18e78ffc-7322-4316-a275-65d093ac07bb req-a12fbfcc-098c-49ac-aeca-8c951ebc3fec service neutron] 10.222.0.13 "GET /v2.0/subnets?id=95fb2797-9ac9-40f9-9ea9-56d2c5a16291 HTTP/1.1" status: 200 len: 854 time: 0.1016228 Sep 18 08:46:26.326999 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-4a99a22c-8bc9-4e33-9fb9-a345ff2dee47 None None] Set router 4922fc58-f2eb-480a-878f-2bc3f212b4da gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:46:26.383516 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-474b83c1-51d2-49de-ae25-2c5b1f8421b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'name': 'tempest-TestMinimumBasicScenario-2061029967-router', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '1c451dba-c399-4ceb-a969-412896a38aec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:12Z', 'revision_number': 4, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'gw_port': {'id': '1c451dba-c399-4ceb-a969-412896a38aec', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:c3:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 441, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': 'cda97d8d-7e99-46b1-937f-0a3ae975c076', 'name': '', 'network_id': '48bd9423-5b85-4344-9434-17e10e227731', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'mac_address': 'fa:16:3e:f2:78:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': '95fb2797-9ac9-40f9-9ea9-56d2c5a16291', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:11Z', 'updated_at': '2021-09-18T08:41:17Z', 'revision_number': 5, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'subnets': [{'id': '95fb2797-9ac9-40f9-9ea9-56d2c5a16291', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:46:26.396231 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18e78ffc-7322-4316-a275-65d093ac07bb req-3da7f12c-25d0-4997-a01e-51451823cfd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:26.397767 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-18e78ffc-7322-4316-a275-65d093ac07bb req-3da7f12c-25d0-4997-a01e-51451823cfd7 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=48bd9423-5b85-4344-9434-17e10e227731&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0507772 Sep 18 08:46:26.424770 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-474b83c1-51d2-49de-ae25-2c5b1f8421b9 None None] The sync data for ids ['2406a855-e08c-4bcc-974c-cd88788039b3'] in dv-cinder-804470-6-iscsi is: [{'id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'name': 'tempest-TestMinimumBasicScenario-2061029967-router', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '1c451dba-c399-4ceb-a969-412896a38aec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:12Z', 'revision_number': 4, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'gw_port': {'id': '1c451dba-c399-4ceb-a969-412896a38aec', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:c3:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 441, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': 'cda97d8d-7e99-46b1-937f-0a3ae975c076', 'name': '', 'network_id': '48bd9423-5b85-4344-9434-17e10e227731', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'mac_address': 'fa:16:3e:f2:78:1e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'device_owner': 'network:router_interface', 'standard_attr_id': 442, 'fixed_ips': [{'subnet_id': '95fb2797-9ac9-40f9-9ea9-56d2c5a16291', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:11Z', 'updated_at': '2021-09-18T08:41:17Z', 'revision_number': 5, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'subnets': [{'id': '95fb2797-9ac9-40f9-9ea9-56d2c5a16291', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:46:26.528557 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-18e78ffc-7322-4316-a275-65d093ac07bb req-9914bcb6-032a-4951-9773-1faa087753d5 service neutron] 10.222.0.13 "GET /v2.0/networks/48bd9423-5b85-4344-9434-17e10e227731?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1058035 Sep 18 08:46:26.566324 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-4a99a22c-8bc9-4e33-9fb9-a345ff2dee47 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 4, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port': {'id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ad:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 474, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:54Z', 'updated_at': '2021-09-18T08:41:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '4eb6aada-4647-4cc0-b357-a3113e1607e9', 'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'mac_address': 'fa:16:3e:49:34:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_interface', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:56Z', 'updated_at': '2021-09-18T08:42:01Z', 'revision_number': 5, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'subnets': [{'id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:46:26.596987 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f70684ea-e829-46fc-88c6-4cfe90df2e73 req-7c4147a4-5371-40eb-ba41-ceff655ef041 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 210 time: 0.0468192 Sep 18 08:46:26.600201 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a99a22c-8bc9-4e33-9fb9-a345ff2dee47 None None] Checking router: 4922fc58-f2eb-480a-878f-2bc3f212b4da for host: dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:46:26.609189 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a99a22c-8bc9-4e33-9fb9-a345ff2dee47 None None] Routers {'4922fc58-f2eb-480a-878f-2bc3f212b4da'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:46:26.609836 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-4a99a22c-8bc9-4e33-9fb9-a345ff2dee47 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:46:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['4922fc58-f2eb-480a-878f-2bc3f212b4da'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:46:26.676268 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-18e78ffc-7322-4316-a275-65d093ac07bb req-d758297b-a8d1-4041-84a5-8a05cb57f538 service neutron] 10.222.0.13 "GET /v2.0/networks/48bd9423-5b85-4344-9434-17e10e227731?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1345723 Sep 18 08:46:26.730629 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-4a99a22c-8bc9-4e33-9fb9-a345ff2dee47 None None] Set router 4922fc58-f2eb-480a-878f-2bc3f212b4da gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:46:26.737658 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-afaef6e6-b942-4eb9-93d3-b687992e9ff4 None None] New status for floating IP 4ba4ba6b-76bb-404f-89a3-659445347a63: DOWN {{(pid=94348) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 18 08:46:27.007797 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-4a99a22c-8bc9-4e33-9fb9-a345ff2dee47 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 4, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port': {'id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ad:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 474, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:54Z', 'updated_at': '2021-09-18T08:41:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '4eb6aada-4647-4cc0-b357-a3113e1607e9', 'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'mac_address': 'fa:16:3e:49:34:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_interface', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:56Z', 'updated_at': '2021-09-18T08:42:01Z', 'revision_number': 5, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'subnets': [{'id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:46:27.036151 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a99a22c-8bc9-4e33-9fb9-a345ff2dee47 None None] The sync data for ids ['4922fc58-f2eb-480a-878f-2bc3f212b4da'] in dv-cinder-804470-6-iscsi is: [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 4, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port': {'id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ad:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 474, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:54Z', 'updated_at': '2021-09-18T08:41:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '4eb6aada-4647-4cc0-b357-a3113e1607e9', 'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'mac_address': 'fa:16:3e:49:34:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_interface', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:56Z', 'updated_at': '2021-09-18T08:42:01Z', 'revision_number': 5, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'subnets': [{'id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:46:27.248058 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63c36019-09cd-492f-ae41-5e17a6ecf75a None None] New status for floating IP 4fbfe49e-e2af-4355-b7c5-c404ed6af093: DOWN {{(pid=94349) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 18 08:46:27.327935 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 3f56fe96-8f0e-4410-8e3c-da651c794d50 no longer exists at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:46:27.364673 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] No Port match for: 3f56fe96-8f0e-4410-8e3c-da651c794d50 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:46:27.365617 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 3f56fe96-8f0e-4410-8e3c-da651c794d50 not bound to the agent host hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:46:27.706880 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-126150b2-2a69-4b1a-af33-d589e7b87eef req-613a0077-2b8b-48e4-88a7-f5c4873227a3 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5c332939-c954-4f64-97d5-07d5b2cb727d HTTP/1.1" status: 200 len: 210 time: 0.0254893 Sep 18 08:46:28.899323 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f39bd30-48ce-49c3-bb7d-9ab0cbf52aac req-93441073-45fd-4956-bd4d-3a15cb140110 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:28.900988 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0f39bd30-48ce-49c3-bb7d-9ab0cbf52aac req-93441073-45fd-4956-bd4d-3a15cb140110 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=4826cd28-72c8-4b55-af33-4e175feee25f HTTP/1.1" status: 200 len: 945 time: 0.0495679 Sep 18 08:46:28.955745 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0f39bd30-48ce-49c3-bb7d-9ab0cbf52aac req-b509f199-da4f-41a3-8dc4-7f8b79a2129d tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0488179 Sep 18 08:46:28.975098 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-990de135-7c8b-4228-aab9-6dee317cece0 req-86a7cff7-2016-4ef9-a173-8a0bb33e279a tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-143517560&fields=id&tenant_id=0c7c58787ad549afa94b716f4c2f187b HTTP/1.1" status: 200 len: 267 time: 0.0433910 Sep 18 08:46:29.081694 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-990de135-7c8b-4228-aab9-6dee317cece0 req-cb964210-7c47-40cf-9b3c-cef286fbe268 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:29.083173 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-990de135-7c8b-4228-aab9-6dee317cece0 req-cb964210-7c47-40cf-9b3c-cef286fbe268 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/networks?id=000f3583-b7de-458d-9146-0010cd28b00d HTTP/1.1" status: 200 len: 812 time: 0.1006525 Sep 18 08:46:29.098037 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-990de135-7c8b-4228-aab9-6dee317cece0 req-0f61a026-6264-4698-b0fd-550e5f9767e4 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/quotas/0c7c58787ad549afa94b716f4c2f187b HTTP/1.1" status: 200 len: 375 time: 0.0092132 Sep 18 08:46:29.154688 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-990de135-7c8b-4228-aab9-6dee317cece0 req-ea66b4d3-1b4c-4774-8182-6c75b985e160 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?tenant_id=0c7c58787ad549afa94b716f4c2f187b&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0508735 Sep 18 08:46:29.253172 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-990de135-7c8b-4228-aab9-6dee317cece0 req-aa262a66-387f-4740-afaf-67659b5edeae service neutron] 10.222.0.35 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0860910 Sep 18 08:46:29.367801 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-990de135-7c8b-4228-aab9-6dee317cece0 req-8385317c-5ce1-4b96-9440-d04e5070015a service neutron] 10.222.0.35 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1087821 Sep 18 08:46:29.408340 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-255c36ea-2179-4b36-bd04-21a36b6a3c7b req-f78e89ed-a624-485a-811c-c4b121c1032e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:29.409875 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-255c36ea-2179-4b36-bd04-21a36b6a3c7b req-f78e89ed-a624-485a-811c-c4b121c1032e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 946 time: 0.0528708 Sep 18 08:46:29.448218 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-255c36ea-2179-4b36-bd04-21a36b6a3c7b req-66097e12-0361-4c95-be0d-c501e532e32f tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0319922 Sep 18 08:46:29.646170 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d39787a5-6715-4d01-8210-7a5c70d02a84 req-0864f8ed-1a09-4972-a7b0-1aafb09e5d48 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 210 time: 0.0257223 Sep 18 08:46:30.078234 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b07e406-3e27-45ff-a0a0-45a115981452 req-88d1103b-9035-4a7e-83b1-0a4afe227284 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:30.079714 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5b07e406-3e27-45ff-a0a0-45a115981452 req-88d1103b-9035-4a7e-83b1-0a4afe227284 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=4826cd28-72c8-4b55-af33-4e175feee25f HTTP/1.1" status: 200 len: 945 time: 0.0518034 Sep 18 08:46:30.121219 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5b07e406-3e27-45ff-a0a0-45a115981452 req-997a714b-5ae3-4343-b658-8b62a4cb86bb tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0348465 Sep 18 08:46:30.560776 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-066b1c36-9227-4987-a014-b9c937d77ec9 req-90e32252-aeea-4e75-8ecf-5ee4ece3bda7 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:30.562281 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-066b1c36-9227-4987-a014-b9c937d77ec9 req-90e32252-aeea-4e75-8ecf-5ee4ece3bda7 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 946 time: 0.0486944 Sep 18 08:46:30.602417 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-066b1c36-9227-4987-a014-b9c937d77ec9 req-699e6987-2dd2-4bed-81e3-11933c797ee6 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0342267 Sep 18 08:46:30.750094 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-26883ec3-8438-4432-9e27-409f7e52b614 req-24cd457f-346e-4f6c-830a-06b0121b81c6 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 210 time: 0.0357695 Sep 18 08:46:30.818895 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-990de135-7c8b-4228-aab9-6dee317cece0 req-2aa2f530-6fae-41a3-867d-786e76cf192b tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:30.820338 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-990de135-7c8b-4228-aab9-6dee317cece0 req-2aa2f530-6fae-41a3-867d-786e76cf192b tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.13 "GET /v2.0/networks?id=000f3583-b7de-458d-9146-0010cd28b00d HTTP/1.1" status: 200 len: 812 time: 0.1267323 Sep 18 08:46:30.948075 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-990de135-7c8b-4228-aab9-6dee317cece0 req-15e8d733-aa11-45b2-a621-3e451def4a59 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.13 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=0c7c58787ad549afa94b716f4c2f187b HTTP/1.1" status: 200 len: 379 time: 0.0328312 Sep 18 08:46:30.958229 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-990de135-7c8b-4228-aab9-6dee317cece0 req-3de39dc9-dbf0-447e-ae48-22f236f01ef9 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Request body: {'port': {'device_id': '825bdf32-25b4-4b50-a9b5-ed2f13f19319', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'admin_state_up': True, 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'security_groups': ['c480fa62-0ee8-4f20-8da2-07bbb721cd7c']}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:46:31.066066 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-990de135-7c8b-4228-aab9-6dee317cece0 req-3de39dc9-dbf0-447e-ae48-22f236f01ef9 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Made reservation on behalf of 0c7c58787ad549afa94b716f4c2f187b for: {'port': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:46:31.070072 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-990de135-7c8b-4228-aab9-6dee317cece0 req-3de39dc9-dbf0-447e-ae48-22f236f01ef9 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:31.197776 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_common [req-990de135-7c8b-4228-aab9-6dee317cece0 req-3de39dc9-dbf0-447e-ae48-22f236f01ef9 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Allocated IP 172.20.0.12 (000f3583-b7de-458d-9146-0010cd28b00d/a4c047cf-cba6-4b94-8339-59469f96c92a/068a71a1-cf8a-4759-a743-216fe1a17a75) {{(pid=94347) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:46:31.267818 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db00ab66-0466-4a76-a298-c82a1cd26b18 req-af2890fd-ad67-4ee1-af1e-92e5883b81eb tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:31.269201 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-db00ab66-0466-4a76-a298-c82a1cd26b18 req-af2890fd-ad67-4ee1-af1e-92e5883b81eb tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=4826cd28-72c8-4b55-af33-4e175feee25f HTTP/1.1" status: 200 len: 945 time: 0.0827165 Sep 18 08:46:31.390721 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-db00ab66-0466-4a76-a298-c82a1cd26b18 req-e25db7dd-b3cc-4c91-9d9e-0ebfef0e17dc tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/security-groups?id=ac0c31fa-f384-4228-91ba-eb44fe1b2a70&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1147981 Sep 18 08:46:31.419913 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-990de135-7c8b-4228-aab9-6dee317cece0 req-3de39dc9-dbf0-447e-ae48-22f236f01ef9 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for port, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:31.435127 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1623fa9-0f25-4ba2-8cc6-89279606d904 req-6aa09742-e479-44ae-8eb8-05c97e5fb495 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:31.436561 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c1623fa9-0f25-4ba2-8cc6-89279606d904 req-6aa09742-e479-44ae-8eb8-05c97e5fb495 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.13 "GET /v2.0/ports?device_id=4826cd28-72c8-4b55-af33-4e175feee25f HTTP/1.1" status: 200 len: 945 time: 0.0961266 Sep 18 08:46:31.516675 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-990de135-7c8b-4228-aab9-6dee317cece0 req-3de39dc9-dbf0-447e-ae48-22f236f01ef9 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:31.566130 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-990de135-7c8b-4228-aab9-6dee317cece0 req-3de39dc9-dbf0-447e-ae48-22f236f01ef9 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Network 000f3583-b7de-458d-9146-0010cd28b00d is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:46:31.573704 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [req-990de135-7c8b-4228-aab9-6dee317cece0 req-3de39dc9-dbf0-447e-ae48-22f236f01ef9 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:46:31.582753 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-990de135-7c8b-4228-aab9-6dee317cece0 req-3de39dc9-dbf0-447e-ae48-22f236f01ef9 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Received port after_create {{(pid=94347) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:46:31.589749 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3de39dc9-dbf0-447e-ae48-22f236f01ef9 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Pushing event updated for resources: {'Port': ['ID=068a71a1-cf8a-4759-a743-216fe1a17a75,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:31.633147 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-c1623fa9-0f25-4ba2-8cc6-89279606d904 req-ea3e09c8-9f48-4340-b1ec-4e16e751cba1 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Deleting port 43836ca4-b347-4c25-8ca1-83794a17feac {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:46:31.633530 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-c1623fa9-0f25-4ba2-8cc6-89279606d904 req-ea3e09c8-9f48-4340-b1ec-4e16e751cba1 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:31.660397 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-990de135-7c8b-4228-aab9-6dee317cece0 req-3de39dc9-dbf0-447e-ae48-22f236f01ef9 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:31.661054 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-990de135-7c8b-4228-aab9-6dee317cece0 req-3de39dc9-dbf0-447e-ae48-22f236f01ef9 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:31.726093 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-990de135-7c8b-4228-aab9-6dee317cece0 req-3de39dc9-dbf0-447e-ae48-22f236f01ef9 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7713685 Sep 18 08:46:31.753956 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-990de135-7c8b-4228-aab9-6dee317cece0 req-dd9b95a4-063a-4902-bf2e-4c62e11ab52f service neutron] Request body: {'port': {'device_id': '825bdf32-25b4-4b50-a9b5-ed2f13f19319', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80447'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:46:31.801244 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-c1623fa9-0f25-4ba2-8cc6-89279606d904 req-ea3e09c8-9f48-4340-b1ec-4e16e751cba1 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] For port 43836ca4-b347-4c25-8ca1-83794a17feac, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=43836ca4-b347-4c25-8ca1-83794a17feac,segment=NetworkSegment(020db71b-b4f2-4e88-b835-5db154c945b2),segment_id=020db71b-b4f2-4e88-b835-5db154c945b2)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:46:31.801611 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-c1623fa9-0f25-4ba2-8cc6-89279606d904 req-ea3e09c8-9f48-4340-b1ec-4e16e751cba1 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:31.849848 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-f1ab9df4-318f-46e6-b59a-693509d8298d None None] Provisioning complete for port 068a71a1-cf8a-4759-a743-216fe1a17a75 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:46:31.850926 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-f1ab9df4-318f-46e6-b59a-693509d8298d None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:31.851041 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b318cec9-130b-4441-badf-3fcafa4bb43c req-ba530cef-ac31-45c0-957f-84d0d68f9380 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:31.852494 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b318cec9-130b-4441-badf-3fcafa4bb43c req-ba530cef-ac31-45c0-957f-84d0d68f9380 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 946 time: 0.1460435 Sep 18 08:46:31.855122 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-c1623fa9-0f25-4ba2-8cc6-89279606d904 req-ea3e09c8-9f48-4340-b1ec-4e16e751cba1 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Calling delete_port for 43836ca4-b347-4c25-8ca1-83794a17feac owned by compute:nova {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:46:31.884760 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-f1ab9df4-318f-46e6-b59a-693509d8298d None None] Port 068a71a1-cf8a-4759-a743-216fe1a17a75 cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:46:31.888062 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-990de135-7c8b-4228-aab9-6dee317cece0 req-dd9b95a4-063a-4902-bf2e-4c62e11ab52f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:31.994449 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f05bef67-6dd0-435c-b536-91d72d2066f8 req-e681fb49-2409-4d49-976d-5a05849df6ab tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:31.995938 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f05bef67-6dd0-435c-b536-91d72d2066f8 req-e681fb49-2409-4d49-976d-5a05849df6ab tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 932 time: 0.1815076 Sep 18 08:46:32.006300 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b318cec9-130b-4441-badf-3fcafa4bb43c req-f18f3c60-5a9c-41a3-bde1-30786f3ec39e tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1307795 Sep 18 08:46:32.128274 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f05bef67-6dd0-435c-b536-91d72d2066f8 req-a8a50779-28f5-41f1-b4de-bd89066284d7 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1137087 Sep 18 08:46:32.228799 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-c1623fa9-0f25-4ba2-8cc6-89279606d904 req-ea3e09c8-9f48-4340-b1ec-4e16e751cba1 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:32.275002 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea3e09c8-9f48-4340-b1ec-4e16e751cba1 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Pushing event deleted for resources: {'Port': ['ID=43836ca4-b347-4c25-8ca1-83794a17feac,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:32.347898 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-c1623fa9-0f25-4ba2-8cc6-89279606d904 req-ea3e09c8-9f48-4340-b1ec-4e16e751cba1 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] No DVR routers for this DVR port 43836ca4-b347-4c25-8ca1-83794a17feac on host hv-cinder-80447 {{(pid=94347) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:46:32.355581 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-c1623fa9-0f25-4ba2-8cc6-89279606d904 req-ea3e09c8-9f48-4340-b1ec-4e16e751cba1 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:32.357612 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c1623fa9-0f25-4ba2-8cc6-89279606d904 req-ea3e09c8-9f48-4340-b1ec-4e16e751cba1 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.13 "DELETE /v2.0/ports/43836ca4-b347-4c25-8ca1-83794a17feac HTTP/1.1" status: 204 len: 173 time: 0.9118400 Sep 18 08:46:32.360949 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4826cd28-72c8-4b55-af33-4e175feee25f', 'name': 'network-vif-deleted', 'tag': '43836ca4-b347-4c25-8ca1-83794a17feac'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:46:32.363177 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cacc8a74-b639-4cf0-8045-10f30d084681" -d '{"events": [{"server_uuid": "4826cd28-72c8-4b55-af33-4e175feee25f", "name": "network-vif-deleted", "tag": "43836ca4-b347-4c25-8ca1-83794a17feac"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:46:32.376376 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f394e6b-a1ab-4fca-aea4-8c7a7d4fe632 req-4a8d2311-8d77-4689-893e-32432523d099 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:32.377807 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5f394e6b-a1ab-4fca-aea4-8c7a7d4fe632 req-4a8d2311-8d77-4689-893e-32432523d099 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.13 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 946 time: 0.1148858 Sep 18 08:46:32.413577 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:46:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bd1a0e8b-afbd-42c4-9df5-b6c1b22c8c49 x-openstack-request-id: req-bd1a0e8b-afbd-42c4-9df5-b6c1b22c8c49 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:46:32.413577 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4826cd28-72c8-4b55-af33-4e175feee25f", "name": "network-vif-deleted", "tag": "43836ca4-b347-4c25-8ca1-83794a17feac", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:46:32.413853 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-bd1a0e8b-afbd-42c4-9df5-b6c1b22c8c49 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:46:32.414070 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4826cd28-72c8-4b55-af33-4e175feee25f', 'name': 'network-vif-deleted', 'tag': '43836ca4-b347-4c25-8ca1-83794a17feac', 'status': 'completed', 'code': 200} Sep 18 08:46:32.446725 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [req-990de135-7c8b-4228-aab9-6dee317cece0 req-dd9b95a4-063a-4902-bf2e-4c62e11ab52f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 068a71a1-cf8a-4759-a743-216fe1a17a75 {{(pid=94347) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:46:32.477470 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-990de135-7c8b-4228-aab9-6dee317cece0 req-dd9b95a4-063a-4902-bf2e-4c62e11ab52f service neutron] Notify callbacks [] for port, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:32.514629 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.provisioning_blocks [req-990de135-7c8b-4228-aab9-6dee317cece0 req-dd9b95a4-063a-4902-bf2e-4c62e11ab52f service neutron] Transition to ACTIVE for port object 068a71a1-cf8a-4759-a743-216fe1a17a75 will not be triggered until provisioned by entity L2. {{(pid=94347) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 18 08:46:32.516721 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-853ff56b-ce10-4540-8007-0957e51f825b req-5e08b99d-24a7-4a48-b420-38df3b1f792f tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] 10.222.0.35 "GET /v2.0/ports?device_id=4826cd28-72c8-4b55-af33-4e175feee25f HTTP/1.1" status: 200 len: 210 time: 0.0367832 Sep 18 08:46:32.520667 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-990de135-7c8b-4228-aab9-6dee317cece0 req-dd9b95a4-063a-4902-bf2e-4c62e11ab52f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:32.829888 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd9b95a4-063a-4902-bf2e-4c62e11ab52f service neutron] Pushing event updated for resources: {'Port': ['ID=068a71a1-cf8a-4759-a743-216fe1a17a75,revision_number=2']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:32.835440 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-5f394e6b-a1ab-4fca-aea4-8c7a7d4fe632 req-d61b178f-6679-45dd-8fad-bf5e51d241ab tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Deleting port a16828fd-b0f1-4ba0-a92a-61614fabe668 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:46:32.835789 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-5f394e6b-a1ab-4fca-aea4-8c7a7d4fe632 req-d61b178f-6679-45dd-8fad-bf5e51d241ab tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:32.973091 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-990de135-7c8b-4228-aab9-6dee317cece0 req-dd9b95a4-063a-4902-bf2e-4c62e11ab52f service neutron] Attempting to bind port 068a71a1-cf8a-4759-a743-216fe1a17a75 on host hv-cinder-80447 for vnic_type normal with profile {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:46:32.973461 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-990de135-7c8b-4228-aab9-6dee317cece0 req-dd9b95a4-063a-4902-bf2e-4c62e11ab52f service neutron] Attempting to bind port 068a71a1-cf8a-4759-a743-216fe1a17a75 by drivers openvswitch,hyperv on host hv-cinder-80447 at level 0 using segments [{'id': 'c215153d-2878-4c82-8dc0-2a92b453bf12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 200, 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d'}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:46:32.973809 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-990de135-7c8b-4228-aab9-6dee317cece0 req-dd9b95a4-063a-4902-bf2e-4c62e11ab52f service neutron] Attempting to bind port 068a71a1-cf8a-4759-a743-216fe1a17a75 on network 000f3583-b7de-458d-9146-0010cd28b00d {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:46:32.987237 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-990de135-7c8b-4228-aab9-6dee317cece0 req-dd9b95a4-063a-4902-bf2e-4c62e11ab52f service neutron] Port 068a71a1-cf8a-4759-a743-216fe1a17a75 on network 000f3583-b7de-458d-9146-0010cd28b00d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80447 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 18 08:46:32.987568 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-990de135-7c8b-4228-aab9-6dee317cece0 req-dd9b95a4-063a-4902-bf2e-4c62e11ab52f service neutron] Attempting to bind port 068a71a1-cf8a-4759-a743-216fe1a17a75 on network 000f3583-b7de-458d-9146-0010cd28b00d {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:46:32.991317 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-5f394e6b-a1ab-4fca-aea4-8c7a7d4fe632 req-d61b178f-6679-45dd-8fad-bf5e51d241ab tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] For port a16828fd-b0f1-4ba0-a92a-61614fabe668, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=a16828fd-b0f1-4ba0-a92a-61614fabe668,segment=NetworkSegment(5d556fd8-f02d-4c49-9c67-863cea39ec4a),segment_id=5d556fd8-f02d-4c49-9c67-863cea39ec4a)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:46:32.991645 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-5f394e6b-a1ab-4fca-aea4-8c7a7d4fe632 req-d61b178f-6679-45dd-8fad-bf5e51d241ab tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:33.007960 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-990de135-7c8b-4228-aab9-6dee317cece0 req-dd9b95a4-063a-4902-bf2e-4c62e11ab52f service neutron] Checking agent: {'id': '8d51fdc4-974b-4200-9c3f-5dddea60a869', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80447', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'started_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 46, 20), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:46:33.007960 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-990de135-7c8b-4228-aab9-6dee317cece0 req-dd9b95a4-063a-4902-bf2e-4c62e11ab52f service neutron] Checking segment: {'id': 'c215153d-2878-4c82-8dc0-2a92b453bf12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 200, 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94347) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:46:33.008238 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-990de135-7c8b-4228-aab9-6dee317cece0 req-dd9b95a4-063a-4902-bf2e-4c62e11ab52f service neutron] Bound using segment: {'id': 'c215153d-2878-4c82-8dc0-2a92b453bf12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 200, 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d'} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:46:33.008665 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-990de135-7c8b-4228-aab9-6dee317cece0 req-dd9b95a4-063a-4902-bf2e-4c62e11ab52f service neutron] Bound port: 068a71a1-cf8a-4759-a743-216fe1a17a75, host: hv-cinder-80447, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c215153d-2878-4c82-8dc0-2a92b453bf12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 200, 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d'}}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:46:33.009019 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-990de135-7c8b-4228-aab9-6dee317cece0 req-dd9b95a4-063a-4902-bf2e-4c62e11ab52f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:33.011840 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-5f394e6b-a1ab-4fca-aea4-8c7a7d4fe632 req-d61b178f-6679-45dd-8fad-bf5e51d241ab tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Calling delete_port for a16828fd-b0f1-4ba0-a92a-61614fabe668 owned by compute:nova {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:46:33.171816 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-990de135-7c8b-4228-aab9-6dee317cece0 req-dd9b95a4-063a-4902-bf2e-4c62e11ab52f service neutron] For port 068a71a1-cf8a-4759-a743-216fe1a17a75, host hv-cinder-80447, cleared binding levels {{(pid=94347) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:46:33.181300 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2b34942-7250-433a-a9f4-0bde3ced53f5 req-c388d557-c45b-4953-abeb-7bfd6155f1b5 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:33.182829 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d2b34942-7250-433a-a9f4-0bde3ced53f5 req-c388d557-c45b-4953-abeb-7bfd6155f1b5 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/ports?device_id=e85a7284-e6ea-47ab-9674-09d8666b742f HTTP/1.1" status: 200 len: 946 time: 0.1076987 Sep 18 08:46:33.200939 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-990de135-7c8b-4228-aab9-6dee317cece0 req-dd9b95a4-063a-4902-bf2e-4c62e11ab52f service neutron] For port 068a71a1-cf8a-4759-a743-216fe1a17a75, host hv-cinder-80447, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=068a71a1-cf8a-4759-a743-216fe1a17a75,segment=NetworkSegment(c215153d-2878-4c82-8dc0-2a92b453bf12),segment_id=c215153d-2878-4c82-8dc0-2a92b453bf12)] {{(pid=94347) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:46:33.219814 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-990de135-7c8b-4228-aab9-6dee317cece0 req-dd9b95a4-063a-4902-bf2e-4c62e11ab52f service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:33.320743 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-990de135-7c8b-4228-aab9-6dee317cece0 req-dd9b95a4-063a-4902-bf2e-4c62e11ab52f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:33.321448 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-990de135-7c8b-4228-aab9-6dee317cece0 req-dd9b95a4-063a-4902-bf2e-4c62e11ab52f service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:33.322815 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-990de135-7c8b-4228-aab9-6dee317cece0 req-dd9b95a4-063a-4902-bf2e-4c62e11ab52f service neutron] 10.222.0.13 "PUT /v2.0/ports/068a71a1-cf8a-4759-a743-216fe1a17a75 HTTP/1.1" status: 200 len: 1094 time: 1.5754738 Sep 18 08:46:33.345082 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d2b34942-7250-433a-a9f4-0bde3ced53f5 req-cf45999b-cd3b-42a1-b8c8-cd38558264b4 tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.35 "GET /v2.0/security-groups?id=207d68f0-4931-4c69-8d7d-61006b3de552&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1535084 Sep 18 08:46:33.357305 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-5f394e6b-a1ab-4fca-aea4-8c7a7d4fe632 req-d61b178f-6679-45dd-8fad-bf5e51d241ab tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:33.359675 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 43836ca4-b347-4c25-8ca1-83794a17feac no longer exists at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:46:33.373662 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d76de1ae-2ac6-493d-b0ad-958b3ebbc0c6 req-7ab45d5d-77d1-4d72-a4eb-31d29be2655f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:33.375566 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d76de1ae-2ac6-493d-b0ad-958b3ebbc0c6 req-7ab45d5d-77d1-4d72-a4eb-31d29be2655f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 944 time: 0.1733508 Sep 18 08:46:33.376666 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd9b95a4-063a-4902-bf2e-4c62e11ab52f service neutron] Pushing event updated for resources: {'Port': ['ID=068a71a1-cf8a-4759-a743-216fe1a17a75,revision_number=3']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:33.387717 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] No Port match for: 43836ca4-b347-4c25-8ca1-83794a17feac {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:46:33.388164 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 43836ca4-b347-4c25-8ca1-83794a17feac not bound to the agent host hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:46:33.407113 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['a16828fd-b0f1-4ba0-a92a-61614fabe668'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:46:33.421779 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d61b178f-6679-45dd-8fad-bf5e51d241ab tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Pushing event deleted for resources: {'Port': ['ID=a16828fd-b0f1-4ba0-a92a-61614fabe668,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:33.488622 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-5f394e6b-a1ab-4fca-aea4-8c7a7d4fe632 req-d61b178f-6679-45dd-8fad-bf5e51d241ab tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] No DVR routers for this DVR port a16828fd-b0f1-4ba0-a92a-61614fabe668 on host hv-cinder-80447 {{(pid=94347) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:46:33.495089 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-5f394e6b-a1ab-4fca-aea4-8c7a7d4fe632 req-d61b178f-6679-45dd-8fad-bf5e51d241ab tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:33.497007 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5f394e6b-a1ab-4fca-aea4-8c7a7d4fe632 req-d61b178f-6679-45dd-8fad-bf5e51d241ab tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] 10.222.0.13 "DELETE /v2.0/ports/a16828fd-b0f1-4ba0-a92a-61614fabe668 HTTP/1.1" status: 204 len: 173 time: 1.0959067 Sep 18 08:46:33.514890 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d76de1ae-2ac6-493d-b0ad-958b3ebbc0c6 req-ad281a21-d3c2-488e-8038-38a82475b947 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1180232 Sep 18 08:46:33.520991 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-990de135-7c8b-4228-aab9-6dee317cece0 req-c9c16080-3b92-4dc6-9846-ad8584285d0d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:33.523768 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-990de135-7c8b-4228-aab9-6dee317cece0 req-c9c16080-3b92-4dc6-9846-ad8584285d0d service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0c7c58787ad549afa94b716f4c2f187b&device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 1097 time: 0.1346653 Sep 18 08:46:33.587898 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-990de135-7c8b-4228-aab9-6dee317cece0 req-27943eb0-8d91-4ba3-bd7c-dd0b945fc9e4 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=068a71a1-cf8a-4759-a743-216fe1a17a75 HTTP/1.1" status: 200 len: 217 time: 0.0417950 Sep 18 08:46:33.638489 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-990de135-7c8b-4228-aab9-6dee317cece0 req-1535ffe5-346f-40ad-ad60-fc39f92d4e45 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:33.640174 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-990de135-7c8b-4228-aab9-6dee317cece0 req-1535ffe5-346f-40ad-ad60-fc39f92d4e45 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=a4c047cf-cba6-4b94-8339-59469f96c92a HTTP/1.1" status: 200 len: 851 time: 0.0493655 Sep 18 08:46:33.688445 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-990de135-7c8b-4228-aab9-6dee317cece0 req-a2ab1dab-9ddd-485d-a935-ab7b99fc5263 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:33.690021 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-990de135-7c8b-4228-aab9-6dee317cece0 req-a2ab1dab-9ddd-485d-a935-ab7b99fc5263 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=000f3583-b7de-458d-9146-0010cd28b00d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0415180 Sep 18 08:46:33.783854 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-990de135-7c8b-4228-aab9-6dee317cece0 req-ed8a3370-96ff-47a2-9fb4-f583da02bac2 service neutron] 10.222.0.13 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0855894 Sep 18 08:46:33.900724 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-990de135-7c8b-4228-aab9-6dee317cece0 req-ac3d5586-b919-4e7c-b501-6a6e196b6df7 service neutron] 10.222.0.13 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1072023 Sep 18 08:46:34.414775 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '825bdf32-25b4-4b50-a9b5-ed2f13f19319', 'tag': '068a71a1-cf8a-4759-a743-216fe1a17a75'}, {'server_uuid': 'e85a7284-e6ea-47ab-9674-09d8666b742f', 'name': 'network-vif-deleted', 'tag': 'a16828fd-b0f1-4ba0-a92a-61614fabe668'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:46:34.417200 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-55237a59-312f-4955-ac56-cc73510a0c98" -d '{"events": [{"name": "network-changed", "server_uuid": "825bdf32-25b4-4b50-a9b5-ed2f13f19319", "tag": "068a71a1-cf8a-4759-a743-216fe1a17a75"}, {"server_uuid": "e85a7284-e6ea-47ab-9674-09d8666b742f", "name": "network-vif-deleted", "tag": "a16828fd-b0f1-4ba0-a92a-61614fabe668"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:46:34.458868 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 350 Content-Type: application/json Date: Sat, 18 Sep 2021 08:46:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ac4ab052-643c-4ca7-b934-3e7ad5c97c24 x-openstack-request-id: req-ac4ab052-643c-4ca7-b934-3e7ad5c97c24 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:46:34.459170 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "825bdf32-25b4-4b50-a9b5-ed2f13f19319", "tag": "068a71a1-cf8a-4759-a743-216fe1a17a75", "status": "completed", "code": 200}, {"server_uuid": "e85a7284-e6ea-47ab-9674-09d8666b742f", "name": "network-vif-deleted", "tag": "a16828fd-b0f1-4ba0-a92a-61614fabe668", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:46:34.459423 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-ac4ab052-643c-4ca7-b934-3e7ad5c97c24 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:46:34.460319 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '825bdf32-25b4-4b50-a9b5-ed2f13f19319', 'tag': '068a71a1-cf8a-4759-a743-216fe1a17a75', 'status': 'completed', 'code': 200} Sep 18 08:46:34.460684 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'e85a7284-e6ea-47ab-9674-09d8666b742f', 'name': 'network-vif-deleted', 'tag': 'a16828fd-b0f1-4ba0-a92a-61614fabe668', 'status': 'completed', 'code': 200} Sep 18 08:46:34.552400 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55237a59-312f-4955-ac56-cc73510a0c98 req-b9fb37c6-7867-41e2-8b2a-f1b74082a072 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:34.554226 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-55237a59-312f-4955-ac56-cc73510a0c98 req-b9fb37c6-7867-41e2-8b2a-f1b74082a072 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0c7c58787ad549afa94b716f4c2f187b&device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 1097 time: 0.0435581 Sep 18 08:46:34.686968 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-138f1b52-432f-4582-be8a-b24ad7dddfe4 req-ebb7a6fe-2cb4-4a18-bc1e-a94bfda5a5e3 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:34.688497 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-138f1b52-432f-4582-be8a-b24ad7dddfe4 req-ebb7a6fe-2cb4-4a18-bc1e-a94bfda5a5e3 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 944 time: 0.0957458 Sep 18 08:46:34.689961 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55237a59-312f-4955-ac56-cc73510a0c98 req-545fc730-7d4b-4cc9-9b07-23c5c6429f36 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:34.691618 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-55237a59-312f-4955-ac56-cc73510a0c98 req-545fc730-7d4b-4cc9-9b07-23c5c6429f36 service neutron] 10.222.0.13 "GET /v2.0/networks?id=000f3583-b7de-458d-9146-0010cd28b00d HTTP/1.1" status: 200 len: 913 time: 0.1300514 Sep 18 08:46:34.745471 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-55237a59-312f-4955-ac56-cc73510a0c98 req-e50f3d72-4340-4212-978d-f5d86bb16d12 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=068a71a1-cf8a-4759-a743-216fe1a17a75 HTTP/1.1" status: 200 len: 217 time: 0.0436060 Sep 18 08:46:34.762562 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-138f1b52-432f-4582-be8a-b24ad7dddfe4 req-c85a6bcc-003f-4e4c-a9eb-a0608fdcda38 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0669889 Sep 18 08:46:34.831641 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55237a59-312f-4955-ac56-cc73510a0c98 req-d9bb7759-ea34-44a6-9457-2b22e6c5242b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:34.833140 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-55237a59-312f-4955-ac56-cc73510a0c98 req-d9bb7759-ea34-44a6-9457-2b22e6c5242b service neutron] 10.222.0.13 "GET /v2.0/subnets?id=a4c047cf-cba6-4b94-8339-59469f96c92a HTTP/1.1" status: 200 len: 851 time: 0.0517952 Sep 18 08:46:34.882444 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55237a59-312f-4955-ac56-cc73510a0c98 req-37d9642b-85c4-4149-a8a0-d438274892d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:34.884138 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-55237a59-312f-4955-ac56-cc73510a0c98 req-37d9642b-85c4-4149-a8a0-d438274892d4 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=000f3583-b7de-458d-9146-0010cd28b00d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0427608 Sep 18 08:46:34.984087 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-55237a59-312f-4955-ac56-cc73510a0c98 req-0a159828-dd87-41cf-8f18-d5fa6989e1d8 service neutron] 10.222.0.13 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0922182 Sep 18 08:46:35.063095 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 36738) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:46:35.106453 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-55237a59-312f-4955-ac56-cc73510a0c98 req-17fa277c-2565-4fea-b36f-c7e0fdf8352f service neutron] 10.222.0.13 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1156762 Sep 18 08:46:35.363016 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device a16828fd-b0f1-4ba0-a92a-61614fabe668 no longer exists at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:46:35.387196 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] No Port match for: a16828fd-b0f1-4ba0-a92a-61614fabe668 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:46:35.387542 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device a16828fd-b0f1-4ba0-a92a-61614fabe668 not bound to the agent host hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:46:35.513315 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ac7bc27c-098b-4148-8268-7baa2b82af19 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-783372'] for router_interface, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:35.747544 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-ac7bc27c-098b-4148-8268-7baa2b82af19 admin admin] Deleting port cda97d8d-7e99-46b1-937f-0a3ae975c076 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:46:35.747883 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ac7bc27c-098b-4148-8268-7baa2b82af19 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:35.823261 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [None req-ac7bc27c-098b-4148-8268-7baa2b82af19 admin admin] For port cda97d8d-7e99-46b1-937f-0a3ae975c076, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=cda97d8d-7e99-46b1-937f-0a3ae975c076,segment=NetworkSegment(5d556fd8-f02d-4c49-9c67-863cea39ec4a),segment_id=5d556fd8-f02d-4c49-9c67-863cea39ec4a)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:46:35.823617 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ac7bc27c-098b-4148-8268-7baa2b82af19 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:35.844539 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-ac7bc27c-098b-4148-8268-7baa2b82af19 admin admin] Calling delete_port for cda97d8d-7e99-46b1-937f-0a3ae975c076 owned by network:router_interface {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:46:35.917747 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16df10b9-753a-4878-a421-e5db28e53c9e req-3a6e1436-e46b-45be-a21b-66daa680016c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:35.919219 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-16df10b9-753a-4878-a421-e5db28e53c9e req-3a6e1436-e46b-45be-a21b-66daa680016c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 944 time: 0.0886393 Sep 18 08:46:36.017793 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-16df10b9-753a-4878-a421-e5db28e53c9e req-779daf36-7f19-4274-83cf-562b0f7fc6da tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0922034 Sep 18 08:46:36.098817 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ac7bc27c-098b-4148-8268-7baa2b82af19 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:36.124666 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac7bc27c-098b-4148-8268-7baa2b82af19 admin admin] Pushing event deleted for resources: {'Port': ['ID=cda97d8d-7e99-46b1-937f-0a3ae975c076,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:36.289019 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ac7bc27c-098b-4148-8268-7baa2b82af19 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-580042', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-785084'] for router_interface, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:36.500014 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ac7bc27c-098b-4148-8268-7baa2b82af19 admin admin] Router 2406a855-e08c-4bcc-974c-cd88788039b3 has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94347) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:46:36.602991 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ac7bc27c-098b-4148-8268-7baa2b82af19 admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94347) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:46:36.607926 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-ac7bc27c-098b-4148-8268-7baa2b82af19 admin admin] 10.222.0.35 "PUT /v2.0/routers/2406a855-e08c-4bcc-974c-cd88788039b3/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5477295 Sep 18 08:46:36.610427 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 36750) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:46:36.612912 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e0720e4-510e-4021-9ef1-bdb9db41d1a4 None None] Sync routers for ids ['2406a855-e08c-4bcc-974c-cd88788039b3'] in dv-cinder-804470-6-iscsi {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:46:36.623274 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e0720e4-510e-4021-9ef1-bdb9db41d1a4 None None] Routers {'2406a855-e08c-4bcc-974c-cd88788039b3'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:46:36.623883 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-8e0720e4-510e-4021-9ef1-bdb9db41d1a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:46:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['2406a855-e08c-4bcc-974c-cd88788039b3'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:46:36.731303 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-8e0720e4-510e-4021-9ef1-bdb9db41d1a4 None None] Set router 2406a855-e08c-4bcc-974c-cd88788039b3 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:46:36.912763 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-8e0720e4-510e-4021-9ef1-bdb9db41d1a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'name': 'tempest-TestMinimumBasicScenario-2061029967-router', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '1c451dba-c399-4ceb-a969-412896a38aec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:46:36Z', 'revision_number': 5, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'gw_port': {'id': '1c451dba-c399-4ceb-a969-412896a38aec', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:c3:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 441, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:46:36.939518 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e0720e4-510e-4021-9ef1-bdb9db41d1a4 None None] Checking router: 2406a855-e08c-4bcc-974c-cd88788039b3 for host: dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:46:36.948386 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e0720e4-510e-4021-9ef1-bdb9db41d1a4 None None] Routers {'2406a855-e08c-4bcc-974c-cd88788039b3'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:46:36.949000 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-8e0720e4-510e-4021-9ef1-bdb9db41d1a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:46:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['2406a855-e08c-4bcc-974c-cd88788039b3'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:46:36.959936 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b845e661-67dc-404e-98ca-e473611e41da admin admin] Notify callbacks [] for router, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:37.057826 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-8e0720e4-510e-4021-9ef1-bdb9db41d1a4 None None] Set router 2406a855-e08c-4bcc-974c-cd88788039b3 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:46:37.073454 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b845e661-67dc-404e-98ca-e473611e41da admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:37.162398 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf28ff34-d636-41e0-9409-ce5b12fb01ea req-d5aa3a69-e184-429b-a936-f094d60b40ff tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:37.164731 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bf28ff34-d636-41e0-9409-ce5b12fb01ea req-d5aa3a69-e184-429b-a936-f094d60b40ff tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 944 time: 0.0765028 Sep 18 08:46:37.181577 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-b845e661-67dc-404e-98ca-e473611e41da admin admin] Deleting port 1c451dba-c399-4ceb-a969-412896a38aec {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:46:37.181915 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b845e661-67dc-404e-98ca-e473611e41da admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:37.258836 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bf28ff34-d636-41e0-9409-ce5b12fb01ea req-b784ca96-91a4-494b-b89c-2935e978e5a4 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0864484 Sep 18 08:46:37.290514 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [None req-b845e661-67dc-404e-98ca-e473611e41da admin admin] For port 1c451dba-c399-4ceb-a969-412896a38aec, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=1c451dba-c399-4ceb-a969-412896a38aec,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:46:37.290879 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b845e661-67dc-404e-98ca-e473611e41da admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:37.302102 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-b845e661-67dc-404e-98ca-e473611e41da admin admin] Calling delete_port for 1c451dba-c399-4ceb-a969-412896a38aec owned by network:router_gateway {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:46:37.354238 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-8e0720e4-510e-4021-9ef1-bdb9db41d1a4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'name': 'tempest-TestMinimumBasicScenario-2061029967-router', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '1c451dba-c399-4ceb-a969-412896a38aec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:46:36Z', 'revision_number': 5, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'gw_port': {'id': '1c451dba-c399-4ceb-a969-412896a38aec', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:c3:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 441, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:46:37.381534 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e0720e4-510e-4021-9ef1-bdb9db41d1a4 None None] The sync data for ids ['2406a855-e08c-4bcc-974c-cd88788039b3'] in dv-cinder-804470-6-iscsi is: [{'id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'name': 'tempest-TestMinimumBasicScenario-2061029967-router', 'tenant_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137'}], 'enable_snat': True}, 'gw_port_id': '1c451dba-c399-4ceb-a969-412896a38aec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:46:36Z', 'revision_number': 5, 'project_id': '62a8d3b5ed4d4fe085db724f264e25c4', 'gw_port': {'id': '1c451dba-c399-4ceb-a969-412896a38aec', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:1c:c3:fe', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2406a855-e08c-4bcc-974c-cd88788039b3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 441, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.137', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:09Z', 'updated_at': '2021-09-18T08:41:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}] {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:46:37.469203 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b845e661-67dc-404e-98ca-e473611e41da admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:37.495250 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b845e661-67dc-404e-98ca-e473611e41da admin admin] Pushing event deleted for resources: {'Port': ['ID=1c451dba-c399-4ceb-a969-412896a38aec,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:37.550115 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b845e661-67dc-404e-98ca-e473611e41da admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-785018'] for router_gateway, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:37.651581 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b845e661-67dc-404e-98ca-e473611e41da admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-782379', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2977'] for router, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:37.653693 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b845e661-67dc-404e-98ca-e473611e41da admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:37.717335 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b845e661-67dc-404e-98ca-e473611e41da admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-782544'] for router, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:37.717897 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b845e661-67dc-404e-98ca-e473611e41da admin admin] Fanout notify agent at l3_agent the message router_deleted on router 2406a855-e08c-4bcc-974c-cd88788039b3 {{(pid=94347) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 18 08:46:37.724345 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b845e661-67dc-404e-98ca-e473611e41da admin admin] Notify callbacks [] for router, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:37.727275 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-b845e661-67dc-404e-98ca-e473611e41da admin admin] 10.222.0.35 "DELETE /v2.0/routers/2406a855-e08c-4bcc-974c-cd88788039b3 HTTP/1.1" status: 204 len: 168 time: 1.1151538 Sep 18 08:46:37.728969 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 36756) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:46:37.778076 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_v2 [None req-0d34d580-bbb4-4c46-97e5-965b15acf0ec admin admin] Deleting subnet 95fb2797-9ac9-40f9-9ea9-56d2c5a16291 {{(pid=94347) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 18 08:46:37.781285 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0d34d580-bbb4-4c46-97e5-965b15acf0ec admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:37.817022 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0d34d580-bbb4-4c46-97e5-965b15acf0ec admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-13659316'] for subnet, precommit_delete_associations {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:37.862749 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device cda97d8d-7e99-46b1-937f-0a3ae975c076 no longer exists at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:46:37.884197 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-536c997d-2873-442a-81bf-9fe918803742 None None] No Port match for: cda97d8d-7e99-46b1-937f-0a3ae975c076 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:46:37.884817 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device cda97d8d-7e99-46b1-937f-0a3ae975c076 not bound to the agent host dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:46:37.934135 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0d34d580-bbb4-4c46-97e5-965b15acf0ec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1821528'] for subnet, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:37.988696 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0d34d580-bbb4-4c46-97e5-965b15acf0ec admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1821519', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15069100', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-13996283'] for subnet, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:38.017303 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d34d580-bbb4-4c46-97e5-965b15acf0ec admin admin] Pushing event deleted for resources: {'Subnet': ['ID=95fb2797-9ac9-40f9-9ea9-56d2c5a16291,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:38.020753 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0d34d580-bbb4-4c46-97e5-965b15acf0ec admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for subnet, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:38.025273 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-0d34d580-bbb4-4c46-97e5-965b15acf0ec admin admin] 10.222.0.35 "DELETE /v2.0/subnets/95fb2797-9ac9-40f9-9ea9-56d2c5a16291 HTTP/1.1" status: 204 len: 168 time: 0.2951512 Sep 18 08:46:38.027428 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ab223e4b-c9d2-4092-b148-a0fc1fc203c5 None None] Network 48bd9423-5b85-4344-9434-17e10e227731 requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:46:38.030193 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 36758) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:46:38.104988 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1861545'] for network, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:38.155272 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.plugin [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Deleting port a9c99c8c-4dde-4346-b7bd-8d87a5e9c9d3 {{(pid=94346) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:46:38.155626 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:38.218456 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.db [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] For port a9c99c8c-4dde-4346-b7bd-8d87a5e9c9d3, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=a9c99c8c-4dde-4346-b7bd-8d87a5e9c9d3,segment=NetworkSegment(5d556fd8-f02d-4c49-9c67-863cea39ec4a),segment_id=5d556fd8-f02d-4c49-9c67-863cea39ec4a)] {{(pid=94346) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:46:38.218822 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:38.231499 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.plugin [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Calling delete_port for a9c99c8c-4dde-4346-b7bd-8d87a5e9c9d3 owned by network:dhcp {{(pid=94346) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:46:38.308927 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:38.333581 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Pushing event deleted for resources: {'Port': ['ID=a9c99c8c-4dde-4346-b7bd-8d87a5e9c9d3,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:38.341837 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] No DVR routers for this DVR port a9c99c8c-4dde-4346-b7bd-8d87a5e9c9d3 on host dv-cinder-804470-6-iscsi {{(pid=94346) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:46:38.343996 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:46:38.344350 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:46:38.344698 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:46:38.345039 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:46:38.345409 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:46:38.346005 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:46:38.346341 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:46:38.346670 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:46:38.346998 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:46:38.347328 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:46:38.347653 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:46:38.347978 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:46:38.384371 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce942b1a-5940-4904-8b4e-132b3e6c10ef req-e3992ce5-ce14-4a35-bf17-13071316787a tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:38.386072 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ce942b1a-5940-4904-8b4e-132b3e6c10ef req-e3992ce5-ce14-4a35-bf17-13071316787a tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 944 time: 0.0541739 Sep 18 08:46:38.413183 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e2a48ce-6111-4091-921e-ed78b83492ee None None] DHCP port deletion for 48bd9423-5b85-4344-9434-17e10e227731 request from dv-cinder-804470-6-iscsi {{(pid=94348) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 18 08:46:38.430168 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1806559', 'neutron.services.segments.db._delete_segments_for_network-8732885752733'] for network, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:38.435185 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ce942b1a-5940-4904-8b4e-132b3e6c10ef req-7796d47b-6a12-45be-9265-4973dac02e05 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0393462 Sep 18 08:46:38.454723 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['48bd9423-5b85-4344-9434-17e10e227731']}} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:46:38.464165 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5d556fd8-f02d-4c49-9c67-863cea39ec4a') {'for_net_delete': True} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:46:38.464463 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5d556fd8-f02d-4c49-9c67-863cea39ec4a') {} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:46:38.473965 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732885753254', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14122733'] for segment, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:38.487321 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:38.492908 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Releasing vlan 238 on physical network physnet1 to pool {{(pid=94346) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 18 08:46:38.493331 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14289667'] for segment, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: Traceback (most recent call last): Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: timer() Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: cb(*args, **kw) Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: return func(*args, **kwargs) Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: self._notify() Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: self.callback(batched_events) Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: event.method(event) Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: aggregate_uuid = self.p_client.list_aggregates( Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: return f(self, *a, **k) Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: return self._get(url).json() Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: return self.request(url, 'GET', **kwargs) Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: base_url = self.get_endpoint(auth, allow=allow, Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 18 08:46:38.494912 dv-cinder-804470-6-iscsi neutron-server[94346]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 18 08:46:38.546991 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1806534', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-784926'] for network, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:38.554002 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:38.555888 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] 10.222.0.35 "DELETE /v2.0/networks/48bd9423-5b85-4344-9434-17e10e227731 HTTP/1.1" status: 204 len: 168 time: 0.5246408 Sep 18 08:46:38.559015 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 36764) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:46:38.564637 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9f6ec25-0197-4a28-b38b-0bd01f8af2b4 admin admin] Pushing event deleted for resources: {'Network': ['ID=48bd9423-5b85-4344-9434-17e10e227731,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:38.893293 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-e334fd01-49a0-4f64-a35c-0fceaa929eba admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-783372'] for router_interface, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:39.126409 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-e334fd01-49a0-4f64-a35c-0fceaa929eba admin admin] Deleting port 52d7871c-2f26-4048-bd50-331024fd3e4c {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:46:39.126753 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-e334fd01-49a0-4f64-a35c-0fceaa929eba admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:39.202177 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [None req-e334fd01-49a0-4f64-a35c-0fceaa929eba admin admin] For port 52d7871c-2f26-4048-bd50-331024fd3e4c, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=52d7871c-2f26-4048-bd50-331024fd3e4c,segment=NetworkSegment(6b776d8d-2b4b-44ff-bc79-dee6b1f71cff),segment_id=6b776d8d-2b4b-44ff-bc79-dee6b1f71cff)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:46:39.202461 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-e334fd01-49a0-4f64-a35c-0fceaa929eba admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:39.218421 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-e334fd01-49a0-4f64-a35c-0fceaa929eba admin admin] Calling delete_port for 52d7871c-2f26-4048-bd50-331024fd3e4c owned by network:router_interface {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:46:39.391322 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-e334fd01-49a0-4f64-a35c-0fceaa929eba admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:39.415029 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e334fd01-49a0-4f64-a35c-0fceaa929eba admin admin] Pushing event deleted for resources: {'Port': ['ID=52d7871c-2f26-4048-bd50-331024fd3e4c,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:39.617019 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-900e0255-5c9b-4883-856a-454168a8e387 req-4577b408-f99f-4500-a130-c624796bb71f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:39.618568 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-900e0255-5c9b-4883-856a-454168a8e387 req-4577b408-f99f-4500-a130-c624796bb71f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 944 time: 0.1003575 Sep 18 08:46:39.623857 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-e334fd01-49a0-4f64-a35c-0fceaa929eba admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-580042', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-785084'] for router_interface, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:39.654187 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device a9c99c8c-4dde-4346-b7bd-8d87a5e9c9d3 no longer exists at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:46:39.673795 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-536c997d-2873-442a-81bf-9fe918803742 None None] No Port match for: a9c99c8c-4dde-4346-b7bd-8d87a5e9c9d3 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:46:39.674141 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device a9c99c8c-4dde-4346-b7bd-8d87a5e9c9d3 not bound to the agent host dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:46:39.674553 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 1c451dba-c399-4ceb-a969-412896a38aec no longer exists at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:46:39.692894 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-536c997d-2873-442a-81bf-9fe918803742 None None] No Port match for: 1c451dba-c399-4ceb-a969-412896a38aec {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:46:39.693181 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 1c451dba-c399-4ceb-a969-412896a38aec not bound to the agent host dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:46:39.706323 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-900e0255-5c9b-4883-856a-454168a8e387 req-4eb9c526-72d5-4843-81df-1af10cc47faf tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0803914 Sep 18 08:46:39.859572 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e334fd01-49a0-4f64-a35c-0fceaa929eba admin admin] Router d2c00031-a918-482a-ab17-bf2b1058f4a4 has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94347) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:46:39.962626 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e334fd01-49a0-4f64-a35c-0fceaa929eba admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94347) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:46:39.967528 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-e334fd01-49a0-4f64-a35c-0fceaa929eba admin admin] 10.222.0.35 "PUT /v2.0/routers/d2c00031-a918-482a-ab17-bf2b1058f4a4/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4073868 Sep 18 08:46:39.970018 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 36770) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:46:39.974546 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2cc1765-7acf-4c39-96b9-799f0f98f0fe None None] Sync routers for ids ['d2c00031-a918-482a-ab17-bf2b1058f4a4'] in dv-cinder-804470-6-iscsi {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:46:39.984371 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2cc1765-7acf-4c39-96b9-799f0f98f0fe None None] Routers {'d2c00031-a918-482a-ab17-bf2b1058f4a4'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:46:39.984978 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-d2cc1765-7acf-4c39-96b9-799f0f98f0fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:46:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['d2c00031-a918-482a-ab17-bf2b1058f4a4'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:46:40.078944 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b8f92485-9d73-4e65-9e9a-deebfcab7fe0 admin admin] Notify callbacks [] for router, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:40.088268 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-d2cc1765-7acf-4c39-96b9-799f0f98f0fe None None] Set router d2c00031-a918-482a-ab17-bf2b1058f4a4 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:46:40.179504 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b8f92485-9d73-4e65-9e9a-deebfcab7fe0 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:40.231899 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-b8f92485-9d73-4e65-9e9a-deebfcab7fe0 admin admin] Deleting port 0bfc635e-76c9-4d59-8312-62cb4d0c808d {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:46:40.232251 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b8f92485-9d73-4e65-9e9a-deebfcab7fe0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:40.266122 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-d2cc1765-7acf-4c39-96b9-799f0f98f0fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd2c00031-a918-482a-ab17-bf2b1058f4a4', 'name': 'tempest-TestMinimumBasicScenario-2027707586-router', 'tenant_id': 'e5499776ba4b4ca1a60a858539853303', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.196'}], 'enable_snat': True}, 'gw_port_id': '0bfc635e-76c9-4d59-8312-62cb4d0c808d', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:14Z', 'updated_at': '2021-09-18T08:46:39Z', 'revision_number': 5, 'project_id': 'e5499776ba4b4ca1a60a858539853303', 'gw_port': {'id': '0bfc635e-76c9-4d59-8312-62cb4d0c808d', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:a4:0a:e2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd2c00031-a918-482a-ab17-bf2b1058f4a4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 453, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.196', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:14Z', 'updated_at': '2021-09-18T08:41:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:46:40.295637 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2cc1765-7acf-4c39-96b9-799f0f98f0fe None None] Checking router: d2c00031-a918-482a-ab17-bf2b1058f4a4 for host: dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:46:40.304051 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2cc1765-7acf-4c39-96b9-799f0f98f0fe None None] Routers {'d2c00031-a918-482a-ab17-bf2b1058f4a4'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:46:40.304658 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-d2cc1765-7acf-4c39-96b9-799f0f98f0fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:46:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['d2c00031-a918-482a-ab17-bf2b1058f4a4'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:46:40.321787 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [None req-b8f92485-9d73-4e65-9e9a-deebfcab7fe0 admin admin] For port 0bfc635e-76c9-4d59-8312-62cb4d0c808d, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=0bfc635e-76c9-4d59-8312-62cb4d0c808d,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:46:40.322147 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b8f92485-9d73-4e65-9e9a-deebfcab7fe0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:40.339548 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-b8f92485-9d73-4e65-9e9a-deebfcab7fe0 admin admin] Calling delete_port for 0bfc635e-76c9-4d59-8312-62cb4d0c808d owned by network:router_gateway {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:46:40.387495 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-d2cc1765-7acf-4c39-96b9-799f0f98f0fe None None] Set router d2c00031-a918-482a-ab17-bf2b1058f4a4 gateway port host: None {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:46:40.441545 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-d2cc1765-7acf-4c39-96b9-799f0f98f0fe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd2c00031-a918-482a-ab17-bf2b1058f4a4', 'name': 'tempest-TestMinimumBasicScenario-2027707586-router', 'tenant_id': 'e5499776ba4b4ca1a60a858539853303', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:14Z', 'updated_at': '2021-09-18T08:46:40Z', 'revision_number': 6, 'project_id': 'e5499776ba4b4ca1a60a858539853303', 'gw_port_host': None}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:46:40.468709 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2cc1765-7acf-4c39-96b9-799f0f98f0fe None None] The sync data for ids ['d2c00031-a918-482a-ab17-bf2b1058f4a4'] in dv-cinder-804470-6-iscsi is: [{'id': 'd2c00031-a918-482a-ab17-bf2b1058f4a4', 'name': 'tempest-TestMinimumBasicScenario-2027707586-router', 'tenant_id': 'e5499776ba4b4ca1a60a858539853303', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:14Z', 'updated_at': '2021-09-18T08:46:40Z', 'revision_number': 6, 'project_id': 'e5499776ba4b4ca1a60a858539853303', 'gw_port_host': None}] {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:46:40.514780 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b8f92485-9d73-4e65-9e9a-deebfcab7fe0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:40.550136 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8f92485-9d73-4e65-9e9a-deebfcab7fe0 admin admin] Pushing event deleted for resources: {'Port': ['ID=0bfc635e-76c9-4d59-8312-62cb4d0c808d,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:40.624014 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b8f92485-9d73-4e65-9e9a-deebfcab7fe0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-785018'] for router_gateway, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:40.718252 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b8f92485-9d73-4e65-9e9a-deebfcab7fe0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-782379', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2977'] for router, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:40.720316 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b8f92485-9d73-4e65-9e9a-deebfcab7fe0 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:41.031185 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b8f92485-9d73-4e65-9e9a-deebfcab7fe0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-782544'] for router, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:41.031842 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b8f92485-9d73-4e65-9e9a-deebfcab7fe0 admin admin] Fanout notify agent at l3_agent the message router_deleted on router d2c00031-a918-482a-ab17-bf2b1058f4a4 {{(pid=94347) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 18 08:46:41.036398 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-b8f92485-9d73-4e65-9e9a-deebfcab7fe0 admin admin] Notify callbacks [] for router, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:41.038029 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-b8f92485-9d73-4e65-9e9a-deebfcab7fe0 admin admin] 10.222.0.35 "DELETE /v2.0/routers/d2c00031-a918-482a-ab17-bf2b1058f4a4 HTTP/1.1" status: 204 len: 168 time: 1.0666256 Sep 18 08:46:41.040476 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 36784) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:46:41.097250 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a7ca046-4eb6-47d0-9933-ae0eeae0d280 req-b011b340-4b90-4835-984e-c12dacd43f0a tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:41.098841 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3a7ca046-4eb6-47d0-9933-ae0eeae0d280 req-b011b340-4b90-4835-984e-c12dacd43f0a tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 944 time: 0.0949268 Sep 18 08:46:41.104623 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_v2 [None req-77f8757b-eae6-496a-81e0-fd269280fa4b admin admin] Deleting subnet 55d4aec3-9a5a-49a9-a580-2748bcb64e49 {{(pid=94347) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 18 08:46:41.114024 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-77f8757b-eae6-496a-81e0-fd269280fa4b admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:41.167847 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-77f8757b-eae6-496a-81e0-fd269280fa4b admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-13659316'] for subnet, precommit_delete_associations {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:41.172338 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3a7ca046-4eb6-47d0-9933-ae0eeae0d280 req-2eab2f71-6b71-4c89-8b05-dda4cde7b085 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0652077 Sep 18 08:46:41.250223 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-77f8757b-eae6-496a-81e0-fd269280fa4b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1821528'] for subnet, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:41.307330 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-77f8757b-eae6-496a-81e0-fd269280fa4b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1821519', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15069100', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-13996283'] for subnet, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:41.331870 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77f8757b-eae6-496a-81e0-fd269280fa4b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=55d4aec3-9a5a-49a9-a580-2748bcb64e49,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:41.336184 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-77f8757b-eae6-496a-81e0-fd269280fa4b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for subnet, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:41.340145 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-77f8757b-eae6-496a-81e0-fd269280fa4b admin admin] 10.222.0.35 "DELETE /v2.0/subnets/55d4aec3-9a5a-49a9-a580-2748bcb64e49 HTTP/1.1" status: 204 len: 168 time: 0.2966132 Sep 18 08:46:41.340454 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 36788) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:46:41.341863 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e3105b41-a5f8-45f8-b82c-b0952c43cb2b None None] Network dcbcf1bc-d782-4448-8e94-4151a8b0647f requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:46:41.407281 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3d0d7266-c577-48e1-87ee-d5fd0e4585f6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1861545'] for network, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:41.457933 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-3d0d7266-c577-48e1-87ee-d5fd0e4585f6 admin admin] Deleting port f4151bdd-91ac-4e48-872e-d060b4b6ad29 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:46:41.458452 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3d0d7266-c577-48e1-87ee-d5fd0e4585f6 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:41.521231 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c8845cca-324a-450c-8e4c-d0abe38285fb None None] DHCP port deletion for dcbcf1bc-d782-4448-8e94-4151a8b0647f request from dv-cinder-804470-6-iscsi {{(pid=94348) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 18 08:46:41.524437 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [None req-3d0d7266-c577-48e1-87ee-d5fd0e4585f6 admin admin] For port f4151bdd-91ac-4e48-872e-d060b4b6ad29, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=f4151bdd-91ac-4e48-872e-d060b4b6ad29,segment=NetworkSegment(6b776d8d-2b4b-44ff-bc79-dee6b1f71cff),segment_id=6b776d8d-2b4b-44ff-bc79-dee6b1f71cff)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:46:41.524798 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3d0d7266-c577-48e1-87ee-d5fd0e4585f6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:41.537088 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-3d0d7266-c577-48e1-87ee-d5fd0e4585f6 admin admin] Calling delete_port for f4151bdd-91ac-4e48-872e-d060b4b6ad29 owned by network:dhcp {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:46:41.575533 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-c8845cca-324a-450c-8e4c-d0abe38285fb None None] Deleting port f4151bdd-91ac-4e48-872e-d060b4b6ad29 {{(pid=94348) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:46:41.575916 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-c8845cca-324a-450c-8e4c-d0abe38285fb None None] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:41.621021 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3d0d7266-c577-48e1-87ee-d5fd0e4585f6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:41.632176 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device f4151bdd-91ac-4e48-872e-d060b4b6ad29 no longer exists at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:46:41.649507 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d0d7266-c577-48e1-87ee-d5fd0e4585f6 admin admin] Pushing event deleted for resources: {'Port': ['ID=f4151bdd-91ac-4e48-872e-d060b4b6ad29,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:41.656271 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3d0d7266-c577-48e1-87ee-d5fd0e4585f6 admin admin] No DVR routers for this DVR port f4151bdd-91ac-4e48-872e-d060b4b6ad29 on host dv-cinder-804470-6-iscsi {{(pid=94347) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:46:41.662446 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-536c997d-2873-442a-81bf-9fe918803742 None None] No Port match for: f4151bdd-91ac-4e48-872e-d060b4b6ad29 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:46:41.662804 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device f4151bdd-91ac-4e48-872e-d060b4b6ad29 not bound to the agent host dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:46:41.663227 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 52d7871c-2f26-4048-bd50-331024fd3e4c no longer exists at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:46:41.665930 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-c8845cca-324a-450c-8e4c-d0abe38285fb None None] For port f4151bdd-91ac-4e48-872e-d060b4b6ad29, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=f4151bdd-91ac-4e48-872e-d060b4b6ad29,segment=NetworkSegment(6b776d8d-2b4b-44ff-bc79-dee6b1f71cff),segment_id=6b776d8d-2b4b-44ff-bc79-dee6b1f71cff)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:46:41.666327 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-c8845cca-324a-450c-8e4c-d0abe38285fb None None] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:41.707722 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-536c997d-2873-442a-81bf-9fe918803742 None None] No Port match for: 52d7871c-2f26-4048-bd50-331024fd3e4c {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:46:41.708070 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 52d7871c-2f26-4048-bd50-331024fd3e4c not bound to the agent host dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:46:41.708486 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 0bfc635e-76c9-4d59-8312-62cb4d0c808d no longer exists at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:46:41.710915 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-c8845cca-324a-450c-8e4c-d0abe38285fb None None] Calling delete_port for f4151bdd-91ac-4e48-872e-d060b4b6ad29 owned by network:dhcp {{(pid=94348) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:46:41.733290 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3d0d7266-c577-48e1-87ee-d5fd0e4585f6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1806559', 'neutron.services.segments.db._delete_segments_for_network-8732885752733'] for network, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:41.739398 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-536c997d-2873-442a-81bf-9fe918803742 None None] No Port match for: 0bfc635e-76c9-4d59-8312-62cb4d0c808d {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:46:41.739849 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 0bfc635e-76c9-4d59-8312-62cb4d0c808d not bound to the agent host dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:46:41.741372 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 068a71a1-cf8a-4759-a743-216fe1a17a75 details requested by agent hyperv_hv-cinder-80447 with host hv-cinder-80447 {{(pid=94348) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 18 08:46:41.761860 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.services.segments.db [None req-3d0d7266-c577-48e1-87ee-d5fd0e4585f6 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['dcbcf1bc-d782-4448-8e94-4151a8b0647f']}} {{(pid=94347) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:46:41.774348 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.services.segments.db [None req-3d0d7266-c577-48e1-87ee-d5fd0e4585f6 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6b776d8d-2b4b-44ff-bc79-dee6b1f71cff') {'for_net_delete': True} {{(pid=94347) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:46:41.774657 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.services.segments.db [None req-3d0d7266-c577-48e1-87ee-d5fd0e4585f6 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6b776d8d-2b4b-44ff-bc79-dee6b1f71cff') {} {{(pid=94347) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:46:41.789611 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3d0d7266-c577-48e1-87ee-d5fd0e4585f6 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732885753254', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-13659327'] for segment, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:41.808364 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3d0d7266-c577-48e1-87ee-d5fd0e4585f6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:41.815096 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3d0d7266-c577-48e1-87ee-d5fd0e4585f6 admin admin] Releasing vlan 247 on physical network physnet1 to pool {{(pid=94347) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 18 08:46:41.815605 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3d0d7266-c577-48e1-87ee-d5fd0e4585f6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15067250'] for segment, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: Traceback (most recent call last): Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: timer() Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: cb(*args, **kw) Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: return func(*args, **kwargs) Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: self._notify() Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: self.callback(batched_events) Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: event.method(event) Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: aggregate_uuid = self.p_client.list_aggregates( Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: return f(self, *a, **k) Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: return self._get(url).json() Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: return self.request(url, 'GET', **kwargs) Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: base_url = self.get_endpoint(auth, allow=allow, Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 18 08:46:41.817506 dv-cinder-804470-6-iscsi neutron-server[94347]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 18 08:46:41.877840 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3d0d7266-c577-48e1-87ee-d5fd0e4585f6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1806534', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-784926'] for network, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:41.882662 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3d0d7266-c577-48e1-87ee-d5fd0e4585f6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:41.884772 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-3d0d7266-c577-48e1-87ee-d5fd0e4585f6 admin admin] 10.222.0.35 "DELETE /v2.0/networks/dcbcf1bc-d782-4448-8e94-4151a8b0647f HTTP/1.1" status: 204 len: 168 time: 0.5434036 Sep 18 08:46:41.901510 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d0d7266-c577-48e1-87ee-d5fd0e4585f6 admin admin] Pushing event deleted for resources: {'Network': ['ID=dcbcf1bc-d782-4448-8e94-4151a8b0647f,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:41.930531 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-c8845cca-324a-450c-8e4c-d0abe38285fb None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537'] for port, after_delete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:41.962332 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-c8845cca-324a-450c-8e4c-d0abe38285fb None None] Network dcbcf1bc-d782-4448-8e94-4151a8b0647f is not hosted by any dhcp agent {{(pid=94348) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Sep 18 08:46:41.962890 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8845cca-324a-450c-8e4c-d0abe38285fb None None] No DVR routers for this DVR port f4151bdd-91ac-4e48-872e-d060b4b6ad29 on host dv-cinder-804470-6-iscsi {{(pid=94348) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:46:41.968830 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8845cca-324a-450c-8e4c-d0abe38285fb None None] Pushing event deleted for resources: {'Port': ['ID=f4151bdd-91ac-4e48-872e-d060b4b6ad29,revision_number=None']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:41.975477 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 068a71a1-cf8a-4759-a743-216fe1a17a75, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=068a71a1-cf8a-4759-a743-216fe1a17a75,segment=NetworkSegment(c215153d-2878-4c82-8dc0-2a92b453bf12),segment_id=c215153d-2878-4c82-8dc0-2a92b453bf12)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:46:41.987296 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Returning: {'device': '068a71a1-cf8a-4759-a743-216fe1a17a75', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'port_id': '068a71a1-cf8a-4759-a743-216fe1a17a75', 'mac_address': 'fa:16:3e:ee:92:e0', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 200, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94348) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 18 08:46:42.009841 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 36800) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:46:42.029248 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:42.047614 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 068a71a1-cf8a-4759-a743-216fe1a17a75 {{(pid=94348) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:46:42.059804 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-60e04785-1721-4cfe-aa90-66a71a9cce13 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=62a8d3b5ed4d4fe085db724f264e25c4&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0487700 Sep 18 08:46:42.062307 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 36802) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:46:42.067857 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 068a71a1-cf8a-4759-a743-216fe1a17a75, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=068a71a1-cf8a-4759-a743-216fe1a17a75,segment=NetworkSegment(c215153d-2878-4c82-8dc0-2a92b453bf12),segment_id=c215153d-2878-4c82-8dc0-2a92b453bf12)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:46:42.073308 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:42.113836 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-74d6d868-818b-4387-8e7f-aac2448ac4d1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:42.122636 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=068a71a1-cf8a-4759-a743-216fe1a17a75,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:42.134995 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-74d6d868-818b-4387-8e7f-aac2448ac4d1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:42.179306 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-74d6d868-818b-4387-8e7f-aac2448ac4d1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:42.181752 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-74d6d868-818b-4387-8e7f-aac2448ac4d1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:42.182881 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-74d6d868-818b-4387-8e7f-aac2448ac4d1 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/207d68f0-4931-4c69-8d7d-61006b3de552 HTTP/1.1" status: 204 len: 168 time: 0.1196668 Sep 18 08:46:42.189958 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74d6d868-818b-4387-8e7f-aac2448ac4d1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=207d68f0-4931-4c69-8d7d-61006b3de552,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:42.292370 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-effbab2a-de8e-4b9f-8223-034f11bf13fd req-07d69853-bd5e-4347-a047-ca2bf95fef83 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:42.293940 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-effbab2a-de8e-4b9f-8223-034f11bf13fd req-07d69853-bd5e-4347-a047-ca2bf95fef83 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 945 time: 0.0521371 Sep 18 08:46:42.333828 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-effbab2a-de8e-4b9f-8223-034f11bf13fd req-ac323955-e44b-4dd8-b5ca-8501647c5228 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0333457 Sep 18 08:46:42.479088 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['068a71a1-cf8a-4759-a743-216fe1a17a75'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:46:42.500824 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 36812) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:46:42.539288 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-3d14e8f9-1385-4256-9d78-bfe2e025f50c admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=e5499776ba4b4ca1a60a858539853303&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0372913 Sep 18 08:46:42.541751 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 36814) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:46:42.588290 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1cacce86-007a-44cc-ad72-b375e97c013d admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:42.608706 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1cacce86-007a-44cc-ad72-b375e97c013d admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:42.655131 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1cacce86-007a-44cc-ad72-b375e97c013d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:42.657618 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1cacce86-007a-44cc-ad72-b375e97c013d admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:42.658771 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-1cacce86-007a-44cc-ad72-b375e97c013d admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/222216ae-d03d-409b-b2d1-4611285b541d HTTP/1.1" status: 204 len: 168 time: 0.1161051 Sep 18 08:46:42.666988 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cacce86-007a-44cc-ad72-b375e97c013d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=222216ae-d03d-409b-b2d1-4611285b541d,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:43.450974 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b8ed0c7-3bd3-4d80-858d-e6f5f04fffe1 req-32e09214-6d97-42e0-ba98-5a44f9da77ea tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:43.452485 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7b8ed0c7-3bd3-4d80-858d-e6f5f04fffe1 req-32e09214-6d97-42e0-ba98-5a44f9da77ea tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 945 time: 0.0520384 Sep 18 08:46:43.488377 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7b8ed0c7-3bd3-4d80-858d-e6f5f04fffe1 req-125b459e-e88b-417c-b0a6-89c6cfd4c736 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0300336 Sep 18 08:46:43.704465 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:46:43.727316 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 068a71a1-cf8a-4759-a743-216fe1a17a75 up at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:46:43.774268 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning for port 068a71a1-cf8a-4759-a743-216fe1a17a75 completed by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 18 08:46:43.777867 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning complete for port 068a71a1-cf8a-4759-a743-216fe1a17a75 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:46:43.778216 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:43.854612 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:43.876341 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '825bdf32-25b4-4b50-a9b5-ed2f13f19319', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '068a71a1-cf8a-4759-a743-216fe1a17a75'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:46:43.878695 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-36786085-0f9d-4072-8d1a-77fc50e991fe" -d '{"events": [{"server_uuid": "825bdf32-25b4-4b50-a9b5-ed2f13f19319", "name": "network-vif-plugged", "status": "completed", "tag": "068a71a1-cf8a-4759-a743-216fe1a17a75"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:46:43.891096 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 068a71a1-cf8a-4759-a743-216fe1a17a75, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=068a71a1-cf8a-4759-a743-216fe1a17a75,segment=NetworkSegment(c215153d-2878-4c82-8dc0-2a92b453bf12),segment_id=c215153d-2878-4c82-8dc0-2a92b453bf12)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:46:43.895683 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:43.918354 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:46:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4e30f3b4-5542-442b-84b0-053fcd99a39f x-openstack-request-id: req-4e30f3b4-5542-442b-84b0-053fcd99a39f {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:46:43.918644 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "825bdf32-25b4-4b50-a9b5-ed2f13f19319", "name": "network-vif-plugged", "status": "completed", "tag": "068a71a1-cf8a-4759-a743-216fe1a17a75", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:46:43.918897 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-4e30f3b4-5542-442b-84b0-053fcd99a39f {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:46:43.919284 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '825bdf32-25b4-4b50-a9b5-ed2f13f19319', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '068a71a1-cf8a-4759-a743-216fe1a17a75', 'code': 200} Sep 18 08:46:43.944973 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=068a71a1-cf8a-4759-a743-216fe1a17a75,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:44.151957 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c792b519-f787-47df-b8b3-86fdb7ad44b7 req-d3a45837-2935-4913-8b9f-f04c8acc4e37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:44.153528 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c792b519-f787-47df-b8b3-86fdb7ad44b7 req-d3a45837-2935-4913-8b9f-f04c8acc4e37 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 1099 time: 0.0386965 Sep 18 08:46:44.188544 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c792b519-f787-47df-b8b3-86fdb7ad44b7 req-faf0d147-bd6f-400d-9028-fa149bcf177a service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0282633 Sep 18 08:46:44.603736 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e440a31c-5973-454a-9880-5f82e0a4c17c req-74b5eae7-35f8-47df-853d-ff94f451e429 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:44.605259 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e440a31c-5973-454a-9880-5f82e0a4c17c req-74b5eae7-35f8-47df-853d-ff94f451e429 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 946 time: 0.0482121 Sep 18 08:46:44.641581 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e440a31c-5973-454a-9880-5f82e0a4c17c req-33f688fa-3656-480a-ac86-80bf6831c0c8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0304749 Sep 18 08:46:45.755457 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29ec4131-c9b0-4c47-8c8e-53d95b4ef5d5 req-4a0bc713-d658-4258-9f0d-3ced552e6bd2 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:45.756905 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-29ec4131-c9b0-4c47-8c8e-53d95b4ef5d5 req-4a0bc713-d658-4258-9f0d-3ced552e6bd2 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 946 time: 0.0506110 Sep 18 08:46:45.793155 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-29ec4131-c9b0-4c47-8c8e-53d95b4ef5d5 req-601a7fd5-8ce3-4345-b181-e5d4bc2cecec tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0304656 Sep 18 08:46:46.902886 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a869458d-5abf-4189-ad33-8cc942e262df req-b370ea04-ed9d-46aa-b13f-994df4eff948 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:46.904459 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a869458d-5abf-4189-ad33-8cc942e262df req-b370ea04-ed9d-46aa-b13f-994df4eff948 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 946 time: 0.0475357 Sep 18 08:46:46.940513 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a869458d-5abf-4189-ad33-8cc942e262df req-90db5b01-3689-4825-981d-5ba0aa59555b tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0303984 Sep 18 08:46:48.052022 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aed92620-03d3-44a6-9442-307975c7b72c req-2f19105a-c5fc-4de3-8a8a-4d54db85ebf9 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:48.053548 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-aed92620-03d3-44a6-9442-307975c7b72c req-2f19105a-c5fc-4de3-8a8a-4d54db85ebf9 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 946 time: 0.0471866 Sep 18 08:46:48.089470 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-aed92620-03d3-44a6-9442-307975c7b72c req-4c27593e-3e74-44af-8414-4386da984d49 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0301652 Sep 18 08:46:49.204130 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5239515-328f-42fd-87f2-d21da7a575d4 req-67ad6e0e-e0c5-4d7f-91db-4cbe561befcb tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:49.205658 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b5239515-328f-42fd-87f2-d21da7a575d4 req-67ad6e0e-e0c5-4d7f-91db-4cbe561befcb tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 946 time: 0.0512645 Sep 18 08:46:49.242703 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b5239515-328f-42fd-87f2-d21da7a575d4 req-4bf8f7e7-2ada-4a5d-b365-75527c901311 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0312631 Sep 18 08:46:49.619663 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-9413948b-e5c7-484f-bdb2-3011c4aa4ae8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:50.035308 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:50.354920 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7916486-cdbe-45e2-8e28-038cac98a680 req-76d8da7c-3cf3-474a-a34e-e030e31f30f4 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:50.356853 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d7916486-cdbe-45e2-8e28-038cac98a680 req-76d8da7c-3cf3-474a-a34e-e030e31f30f4 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 946 time: 0.0494058 Sep 18 08:46:50.393571 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d7916486-cdbe-45e2-8e28-038cac98a680 req-59fe84be-e175-48ed-a234-fbbb754c3d46 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0307016 Sep 18 08:46:51.507721 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be5904d7-7dd9-4d8d-9625-3f955e42d97f req-106a2677-88b2-4fcb-9fc6-17f852eca3e7 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:51.509190 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-be5904d7-7dd9-4d8d-9625-3f955e42d97f req-106a2677-88b2-4fcb-9fc6-17f852eca3e7 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 946 time: 0.0469365 Sep 18 08:46:51.546099 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-be5904d7-7dd9-4d8d-9625-3f955e42d97f req-25b78462-2e62-43ef-adad-223d3dc7b1b0 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0311677 Sep 18 08:46:51.660992 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1401381b-ffcf-4149-83bd-c0a70570005a req-cd71aa63-28e0-4c95-98ab-c39298690459 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:51.662471 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1401381b-ffcf-4149-83bd-c0a70570005a req-cd71aa63-28e0-4c95-98ab-c39298690459 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 946 time: 0.0501833 Sep 18 08:46:51.703264 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1401381b-ffcf-4149-83bd-c0a70570005a req-d3e340c6-fb8c-4426-b86f-30324042ae54 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0348761 Sep 18 08:46:51.724809 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 36878) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:46:51.763047 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7f5e89eb-a5bf-40fa-bf52-3be343d8803e tempest-TestVolumeBootPattern-848168784 tempest-TestVolumeBootPattern-848168784-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:51.764585 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-7f5e89eb-a5bf-40fa-bf52-3be343d8803e tempest-TestVolumeBootPattern-848168784 tempest-TestVolumeBootPattern-848168784-project-admin] 10.222.0.35 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 1094 time: 0.0387280 Sep 18 08:46:51.767343 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 36882) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:46:51.771571 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-098c0f14-f052-4425-9b34-508599485acd tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Request body: {'floatingip': {'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'port_id': '068a71a1-cf8a-4759-a743-216fe1a17a75', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'fixed_ip_address': '172.20.0.12'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:46:51.793803 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-098c0f14-f052-4425-9b34-508599485acd tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for floatingip, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:51.887788 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-098c0f14-f052-4425-9b34-508599485acd tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:51.997546 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_common [None req-098c0f14-f052-4425-9b34-508599485acd tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Allocated IP 172.27.1.105 (2e3b3f85-63e4-4380-917a-8c90c80b3e38/cd525bb9-7f93-490c-a5d6-a08911817e54/89b72f1e-8236-4210-967d-a00424856aea) {{(pid=94346) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:46:52.097082 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-098c0f14-f052-4425-9b34-508599485acd tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for port, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:52.134093 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-098c0f14-f052-4425-9b34-508599485acd tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:52.170566 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-098c0f14-f052-4425-9b34-508599485acd tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:46:52.180264 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-098c0f14-f052-4425-9b34-508599485acd tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:46:52.182455 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-098c0f14-f052-4425-9b34-508599485acd tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Pushing event updated for resources: {'Port': ['ID=89b72f1e-8236-4210-967d-a00424856aea,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:52.184611 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [None req-098c0f14-f052-4425-9b34-508599485acd tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Received port after_create {{(pid=94346) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:46:52.415986 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-f90bbdaa-0080-42b2-9068-211fa330fcce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:52.522100 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-098c0f14-f052-4425-9b34-508599485acd tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for floatingip, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:52.587235 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-098c0f14-f052-4425-9b34-508599485acd tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:52.732939 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-098c0f14-f052-4425-9b34-508599485acd tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for port, precommit_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:52.737267 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-098c0f14-f052-4425-9b34-508599485acd tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14290155'] for port, after_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:52.800655 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-098c0f14-f052-4425-9b34-508599485acd tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Pushing event updated for resources: {'Port': ['ID=89b72f1e-8236-4210-967d-a00424856aea,revision_number=2']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:46:52.811724 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-098c0f14-f052-4425-9b34-508599485acd tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-784908'] for floatingip, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:52.908193 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.db.l3_db [None req-098c0f14-f052-4425-9b34-508599485acd tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Floating IP 82381b73-8875-486b-bf4a-c647dafc0cbe associated. External IP: 172.27.1.105, port: 068a71a1-cf8a-4759-a743-216fe1a17a75. Sep 18 08:46:53.121971 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-098c0f14-f052-4425-9b34-508599485acd tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Router 4922fc58-f2eb-480a-878f-2bc3f212b4da has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94346) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:46:53.219644 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:53.232658 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-098c0f14-f052-4425-9b34-508599485acd tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94346) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:46:53.242840 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1713961d-6621-4f03-8c6e-a79d5375901e None None] Sync routers for ids ['4922fc58-f2eb-480a-878f-2bc3f212b4da'] in dv-cinder-804470-6-iscsi {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:46:53.249466 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-098c0f14-f052-4425-9b34-508599485acd tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for floatingip, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:53.252415 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1713961d-6621-4f03-8c6e-a79d5375901e None None] Routers {'4922fc58-f2eb-480a-878f-2bc3f212b4da'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:46:53.253034 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-1713961d-6621-4f03-8c6e-a79d5375901e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:46:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['4922fc58-f2eb-480a-878f-2bc3f212b4da'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:46:53.281751 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-098c0f14-f052-4425-9b34-508599485acd tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.5133677 Sep 18 08:46:53.282982 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '825bdf32-25b4-4b50-a9b5-ed2f13f19319', 'tag': '068a71a1-cf8a-4759-a743-216fe1a17a75'}] {{(pid=94346) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:46:53.286214 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c9c65146fa140f7f105fbfe1cfc0ed8a4aa4ddea85af05f4a70363726e3aa059" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e269fd77-1e6c-4952-b1da-e40c1f12ab62" -d '{"events": [{"name": "network-changed", "server_uuid": "825bdf32-25b4-4b50-a9b5-ed2f13f19319", "tag": "068a71a1-cf8a-4759-a743-216fe1a17a75"}]}' {{(pid=94346) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:46:53.330043 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:46:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a58b966a-5333-434b-9250-c4a156b52e88 x-openstack-request-id: req-a58b966a-5333-434b-9250-c4a156b52e88 {{(pid=94346) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:46:53.330339 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "825bdf32-25b4-4b50-a9b5-ed2f13f19319", "tag": "068a71a1-cf8a-4759-a743-216fe1a17a75", "status": "completed", "code": 200}]} {{(pid=94346) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:46:53.330594 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-a58b966a-5333-434b-9250-c4a156b52e88 {{(pid=94346) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:46:53.330995 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '825bdf32-25b4-4b50-a9b5-ed2f13f19319', 'tag': '068a71a1-cf8a-4759-a743-216fe1a17a75', 'status': 'completed', 'code': 200} Sep 18 08:46:53.376452 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:53.378166 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-1713961d-6621-4f03-8c6e-a79d5375901e None None] Set router 4922fc58-f2eb-480a-878f-2bc3f212b4da gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:46:53.410522 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e269fd77-1e6c-4952-b1da-e40c1f12ab62 req-98b26f13-5acc-446f-8623-d772ba0729cf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:53.412023 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e269fd77-1e6c-4952-b1da-e40c1f12ab62 req-98b26f13-5acc-446f-8623-d772ba0729cf service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0c7c58787ad549afa94b716f4c2f187b&device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 1099 time: 0.0398674 Sep 18 08:46:53.504378 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e269fd77-1e6c-4952-b1da-e40c1f12ab62 req-52356d8f-03c3-4f27-a7c9-605936d39662 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:53.505810 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e269fd77-1e6c-4952-b1da-e40c1f12ab62 req-52356d8f-03c3-4f27-a7c9-605936d39662 service neutron] 10.222.0.13 "GET /v2.0/networks?id=000f3583-b7de-458d-9146-0010cd28b00d HTTP/1.1" status: 200 len: 913 time: 0.0863175 Sep 18 08:46:53.571176 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e269fd77-1e6c-4952-b1da-e40c1f12ab62 req-ba459378-d617-44e8-bd49-ccf2d554d082 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=068a71a1-cf8a-4759-a743-216fe1a17a75 HTTP/1.1" status: 200 len: 1000 time: 0.0581703 Sep 18 08:46:53.594021 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-1713961d-6621-4f03-8c6e-a79d5375901e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 4, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port': {'id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ad:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 474, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:54Z', 'updated_at': '2021-09-18T08:41:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': '82381b73-8875-486b-bf4a-c647dafc0cbe', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'floating_ip_address': '172.27.1.105', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'port_id': '068a71a1-cf8a-4759-a743-216fe1a17a75', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'mac_address': 'fa:16:3e:ee:92:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '825bdf32-25b4-4b50-a9b5-ed2f13f19319', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:46:52Z', 'updated_at': '2021-09-18T08:46:52Z', 'revision_number': 0, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4eb6aada-4647-4cc0-b357-a3113e1607e9', 'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'mac_address': 'fa:16:3e:49:34:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_interface', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:56Z', 'updated_at': '2021-09-18T08:42:01Z', 'revision_number': 5, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'subnets': [{'id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:46:53.619842 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e269fd77-1e6c-4952-b1da-e40c1f12ab62 req-f4e74655-79d9-4aad-b83c-cc1e2cb45e1a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:53.620800 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1713961d-6621-4f03-8c6e-a79d5375901e None None] Checking router: 4922fc58-f2eb-480a-878f-2bc3f212b4da for host: dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:46:53.621345 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e269fd77-1e6c-4952-b1da-e40c1f12ab62 req-f4e74655-79d9-4aad-b83c-cc1e2cb45e1a service neutron] 10.222.0.13 "GET /v2.0/subnets?id=a4c047cf-cba6-4b94-8339-59469f96c92a HTTP/1.1" status: 200 len: 851 time: 0.0430608 Sep 18 08:46:53.630947 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1713961d-6621-4f03-8c6e-a79d5375901e None None] Routers {'4922fc58-f2eb-480a-878f-2bc3f212b4da'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:46:53.631557 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-1713961d-6621-4f03-8c6e-a79d5375901e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:46:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['4922fc58-f2eb-480a-878f-2bc3f212b4da'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:46:53.669696 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e269fd77-1e6c-4952-b1da-e40c1f12ab62 req-20fd7423-6b3e-4b90-82ba-a9e907b4e13f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:46:53.671203 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e269fd77-1e6c-4952-b1da-e40c1f12ab62 req-20fd7423-6b3e-4b90-82ba-a9e907b4e13f service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=000f3583-b7de-458d-9146-0010cd28b00d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0427132 Sep 18 08:46:53.737070 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-1713961d-6621-4f03-8c6e-a79d5375901e None None] Set router 4922fc58-f2eb-480a-878f-2bc3f212b4da gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:46:53.759526 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e269fd77-1e6c-4952-b1da-e40c1f12ab62 req-974a6aa6-8152-4966-a80f-ef3dfe8d5f18 service neutron] 10.222.0.13 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0810552 Sep 18 08:46:53.851370 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e269fd77-1e6c-4952-b1da-e40c1f12ab62 req-f31edd6a-921a-4fe9-abf6-f49d4a83229d service neutron] 10.222.0.13 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0838830 Sep 18 08:46:53.956497 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-1713961d-6621-4f03-8c6e-a79d5375901e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 4, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port': {'id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ad:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 474, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:54Z', 'updated_at': '2021-09-18T08:41:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': '82381b73-8875-486b-bf4a-c647dafc0cbe', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'floating_ip_address': '172.27.1.105', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'port_id': '068a71a1-cf8a-4759-a743-216fe1a17a75', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'mac_address': 'fa:16:3e:ee:92:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '825bdf32-25b4-4b50-a9b5-ed2f13f19319', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:46:52Z', 'updated_at': '2021-09-18T08:46:52Z', 'revision_number': 0, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4eb6aada-4647-4cc0-b357-a3113e1607e9', 'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'mac_address': 'fa:16:3e:49:34:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_interface', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:56Z', 'updated_at': '2021-09-18T08:42:01Z', 'revision_number': 5, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'subnets': [{'id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:46:53.983053 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1713961d-6621-4f03-8c6e-a79d5375901e None None] The sync data for ids ['4922fc58-f2eb-480a-878f-2bc3f212b4da'] in dv-cinder-804470-6-iscsi is: [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 4, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port': {'id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ad:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 474, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:54Z', 'updated_at': '2021-09-18T08:41:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': '82381b73-8875-486b-bf4a-c647dafc0cbe', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'floating_ip_address': '172.27.1.105', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'port_id': '068a71a1-cf8a-4759-a743-216fe1a17a75', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'mac_address': 'fa:16:3e:ee:92:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '825bdf32-25b4-4b50-a9b5-ed2f13f19319', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:46:52Z', 'updated_at': '2021-09-18T08:46:52Z', 'revision_number': 0, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4eb6aada-4647-4cc0-b357-a3113e1607e9', 'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'mac_address': 'fa:16:3e:49:34:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_interface', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:56Z', 'updated_at': '2021-09-18T08:42:01Z', 'revision_number': 5, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'subnets': [{'id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:46:54.169516 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a68681bf-aa46-4150-98e6-a3c6aae16573 None None] New status for floating IP 82381b73-8875-486b-bf4a-c647dafc0cbe: ACTIVE {{(pid=94349) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 18 08:46:54.880362 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:59.815085 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 36968) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:46:59.859000 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_v2 [None req-f5a8bf11-bd74-4dee-8219-d298332965b5 admin admin] Deleting subnet 46d0ba5d-1c6d-4148-a267-3aba2885e5ce {{(pid=94346) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 18 08:46:59.862089 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f5a8bf11-bd74-4dee-8219-d298332965b5 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:59.898915 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f5a8bf11-bd74-4dee-8219-d298332965b5 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14122726'] for subnet, precommit_delete_associations {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:59.936389 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f5a8bf11-bd74-4dee-8219-d298332965b5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1821528'] for subnet, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:46:59.986944 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f5a8bf11-bd74-4dee-8219-d298332965b5 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1821519', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14290141', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14198653'] for subnet, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:00.011202 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5a8bf11-bd74-4dee-8219-d298332965b5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=46d0ba5d-1c6d-4148-a267-3aba2885e5ce,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:47:00.014924 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f5a8bf11-bd74-4dee-8219-d298332965b5 admin admin] Notify callbacks [] for subnet, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:00.016751 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-f5a8bf11-bd74-4dee-8219-d298332965b5 admin admin] 10.222.0.35 "DELETE /v2.0/subnets/46d0ba5d-1c6d-4148-a267-3aba2885e5ce HTTP/1.1" status: 204 len: 168 time: 0.2006946 Sep 18 08:47:00.019249 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 36972) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:47:00.088199 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-cd9e5575-2225-4308-a6a1-3cdb3dfe002b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1861545'] for network, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:00.160981 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-cd9e5575-2225-4308-a6a1-3cdb3dfe002b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1806559', 'neutron.services.segments.db._delete_segments_for_network-8732885752733'] for network, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:00.179247 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-cd9e5575-2225-4308-a6a1-3cdb3dfe002b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['344dbdfa-9f7e-4311-9160-286f3356d748']}} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:47:00.187940 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-cd9e5575-2225-4308-a6a1-3cdb3dfe002b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '020db71b-b4f2-4e88-b835-5db154c945b2') {'for_net_delete': True} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:47:00.188232 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-cd9e5575-2225-4308-a6a1-3cdb3dfe002b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '020db71b-b4f2-4e88-b835-5db154c945b2') {} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:47:00.197475 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-cd9e5575-2225-4308-a6a1-3cdb3dfe002b admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732885753254', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14122733'] for segment, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:00.209828 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-cd9e5575-2225-4308-a6a1-3cdb3dfe002b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:00.215936 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cd9e5575-2225-4308-a6a1-3cdb3dfe002b admin admin] Releasing vlan 204 on physical network physnet1 to pool {{(pid=94346) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 18 08:47:00.216350 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-cd9e5575-2225-4308-a6a1-3cdb3dfe002b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14289667'] for segment, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: Traceback (most recent call last): Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: timer() Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: cb(*args, **kw) Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: return func(*args, **kwargs) Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: self._notify() Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: self.callback(batched_events) Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: event.method(event) Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: aggregate_uuid = self.p_client.list_aggregates( Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: return f(self, *a, **k) Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: return self._get(url).json() Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: return self.request(url, 'GET', **kwargs) Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: base_url = self.get_endpoint(auth, allow=allow, Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 18 08:47:00.217955 dv-cinder-804470-6-iscsi neutron-server[94346]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 18 08:47:00.273785 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-cd9e5575-2225-4308-a6a1-3cdb3dfe002b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1806534', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-784926'] for network, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:00.278223 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-cd9e5575-2225-4308-a6a1-3cdb3dfe002b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:00.280115 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-cd9e5575-2225-4308-a6a1-3cdb3dfe002b admin admin] 10.222.0.35 "DELETE /v2.0/networks/344dbdfa-9f7e-4311-9160-286f3356d748 HTTP/1.1" status: 204 len: 168 time: 0.2599702 Sep 18 08:47:00.291828 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd9e5575-2225-4308-a6a1-3cdb3dfe002b admin admin] Pushing event deleted for resources: {'Network': ['ID=344dbdfa-9f7e-4311-9160-286f3356d748,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:47:00.434308 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 36976) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:47:00.472390 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-d1752a11-980c-472f-8ae1-ec71b12a584f admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=e54453321aba48dc881baeadd2c69473&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0369730 Sep 18 08:47:00.474724 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 36978) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:47:00.520266 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c8a5dde4-fcd0-4a08-a957-39d6a0a0bce4 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:00.539813 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c8a5dde4-fcd0-4a08-a957-39d6a0a0bce4 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:00.588813 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c8a5dde4-fcd0-4a08-a957-39d6a0a0bce4 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:00.591365 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c8a5dde4-fcd0-4a08-a957-39d6a0a0bce4 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:00.592504 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-c8a5dde4-fcd0-4a08-a957-39d6a0a0bce4 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/ac0c31fa-f384-4228-91ba-eb44fe1b2a70 HTTP/1.1" status: 204 len: 168 time: 0.1169193 Sep 18 08:47:00.600112 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8a5dde4-fcd0-4a08-a957-39d6a0a0bce4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ac0c31fa-f384-4228-91ba-eb44fe1b2a70,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:47:03.674178 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 36988) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:47:03.824343 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-dd3e82a7-7712-433f-a1f3-fda263e17c2f tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Deleting port 476c0246-be19-45c5-83c9-9aa64b808c49 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:47:03.824687 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-dd3e82a7-7712-433f-a1f3-fda263e17c2f tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:03.896191 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-dd3e82a7-7712-433f-a1f3-fda263e17c2f tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:03.896521 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-dd3e82a7-7712-433f-a1f3-fda263e17c2f tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:03.907759 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-dd3e82a7-7712-433f-a1f3-fda263e17c2f tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Calling delete_port for 476c0246-be19-45c5-83c9-9aa64b808c49 owned by network:floatingip {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:47:04.075257 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-dd3e82a7-7712-433f-a1f3-fda263e17c2f tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:04.099498 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd3e82a7-7712-433f-a1f3-fda263e17c2f tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Pushing event deleted for resources: {'Port': ['ID=476c0246-be19-45c5-83c9-9aa64b808c49,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:47:04.157858 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-dd3e82a7-7712-433f-a1f3-fda263e17c2f tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for floatingip, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:04.158188 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.db.l3_db [None req-dd3e82a7-7712-433f-a1f3-fda263e17c2f tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Floating IP 5ba46ac2-2b32-4120-9e3c-946b63c051ee disassociated (deleted). External IP: 172.27.1.43, port: 2f2f886e-b6d3-4d02-92de-a193d7d276f7. Sep 18 08:47:04.357653 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dd3e82a7-7712-433f-a1f3-fda263e17c2f tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Router d221b587-201f-4923-926d-02481e296d23 has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94347) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:47:04.462169 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dd3e82a7-7712-433f-a1f3-fda263e17c2f tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94347) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:47:04.467120 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-dd3e82a7-7712-433f-a1f3-fda263e17c2f tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for floatingip, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:04.472433 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd7b54f2-3ad0-4fdf-afac-a93fdb0378a3 None None] Sync routers for ids ['d221b587-201f-4923-926d-02481e296d23'] in dv-cinder-804470-6-iscsi {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:47:04.481625 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd7b54f2-3ad0-4fdf-afac-a93fdb0378a3 None None] Routers {'d221b587-201f-4923-926d-02481e296d23'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:47:04.482233 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-dd7b54f2-3ad0-4fdf-afac-a93fdb0378a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:46:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['d221b587-201f-4923-926d-02481e296d23'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:47:04.492877 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-dd3e82a7-7712-433f-a1f3-fda263e17c2f tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "DELETE /v2.0/floatingips/5ba46ac2-2b32-4120-9e3c-946b63c051ee HTTP/1.1" status: 204 len: 168 time: 0.8176374 Sep 18 08:47:04.493490 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b6c407a6-4b6a-4479-911e-1c4620f28924', 'tag': '2f2f886e-b6d3-4d02-92de-a193d7d276f7'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:47:04.495745 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ea46b38e-7908-4385-8532-0b47f0150b23" -d '{"events": [{"name": "network-changed", "server_uuid": "b6c407a6-4b6a-4479-911e-1c4620f28924", "tag": "2f2f886e-b6d3-4d02-92de-a193d7d276f7"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:47:04.540523 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:47:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ee849c15-c506-4740-9a71-3847685d4fc1 x-openstack-request-id: req-ee849c15-c506-4740-9a71-3847685d4fc1 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:47:04.540837 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b6c407a6-4b6a-4479-911e-1c4620f28924", "tag": "2f2f886e-b6d3-4d02-92de-a193d7d276f7", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:47:04.541056 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-ee849c15-c506-4740-9a71-3847685d4fc1 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:47:04.541483 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b6c407a6-4b6a-4479-911e-1c4620f28924', 'tag': '2f2f886e-b6d3-4d02-92de-a193d7d276f7', 'status': 'completed', 'code': 200} Sep 18 08:47:04.641656 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea46b38e-7908-4385-8532-0b47f0150b23 req-902262bb-a231-4ec3-9403-81185e153040 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:04.643185 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ea46b38e-7908-4385-8532-0b47f0150b23 req-902262bb-a231-4ec3-9403-81185e153040 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=467aba0ce03e40a6927a5c05223dd512&device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 1098 time: 0.0514560 Sep 18 08:47:04.709980 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-dd7b54f2-3ad0-4fdf-afac-a93fdb0378a3 None None] Set router d221b587-201f-4923-926d-02481e296d23 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:47:04.772572 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56476e63-893e-493b-ac5e-5155ecb763ce req-800318fb-58c3-42cb-833e-cfdf6b2f81a4 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:04.774103 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-56476e63-893e-493b-ac5e-5155ecb763ce req-800318fb-58c3-42cb-833e-cfdf6b2f81a4 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 945 time: 0.0990677 Sep 18 08:47:04.826154 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea46b38e-7908-4385-8532-0b47f0150b23 req-7c9dd054-39ba-40fc-9137-ad1f1d75ad11 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:04.827626 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ea46b38e-7908-4385-8532-0b47f0150b23 req-7c9dd054-39ba-40fc-9137-ad1f1d75ad11 service neutron] 10.222.0.13 "GET /v2.0/networks?id=c81b2232-3aba-4f15-b8f1-a71826c8c1ca HTTP/1.1" status: 200 len: 909 time: 0.1256490 Sep 18 08:47:04.830583 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-56476e63-893e-493b-ac5e-5155ecb763ce req-5b4b2d2c-a40a-4897-9bf7-54ceb846e3da tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0503442 Sep 18 08:47:04.873691 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ea46b38e-7908-4385-8532-0b47f0150b23 req-987bf2d8-59f3-42c5-80f4-eaf1c86845a0 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=2f2f886e-b6d3-4d02-92de-a193d7d276f7 HTTP/1.1" status: 200 len: 217 time: 0.0375319 Sep 18 08:47:04.906683 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-dd7b54f2-3ad0-4fdf-afac-a93fdb0378a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd221b587-201f-4923-926d-02481e296d23', 'name': 'tempest-TestShelveInstance-734449530-router', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.84'}], 'enable_snat': True}, 'gw_port_id': 'bd096082-b42e-4e6d-a36f-afdc95ef9ae4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:39:48Z', 'updated_at': '2021-09-18T08:39:52Z', 'revision_number': 4, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'gw_port': {'id': 'bd096082-b42e-4e6d-a36f-afdc95ef9ae4', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:ed:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd221b587-201f-4923-926d-02481e296d23', 'device_owner': 'network:router_gateway', 'standard_attr_id': 303, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:49Z', 'updated_at': '2021-09-18T08:39:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '23821731-be27-4d6b-834b-f6953b4d873a', 'name': '', 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'mac_address': 'fa:16:3e:47:27:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd221b587-201f-4923-926d-02481e296d23', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': '58e9d53a-333d-4a2f-a575-92c9de3fb737', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:51Z', 'updated_at': '2021-09-18T08:39:58Z', 'revision_number': 5, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'subnets': [{'id': '58e9d53a-333d-4a2f-a575-92c9de3fb737', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:47:04.922562 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea46b38e-7908-4385-8532-0b47f0150b23 req-109e81d0-784e-44bd-bf44-dd08df8d55fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:04.924043 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ea46b38e-7908-4385-8532-0b47f0150b23 req-109e81d0-784e-44bd-bf44-dd08df8d55fe service neutron] 10.222.0.13 "GET /v2.0/subnets?id=58e9d53a-333d-4a2f-a575-92c9de3fb737 HTTP/1.1" status: 200 len: 847 time: 0.0426853 Sep 18 08:47:04.932136 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd7b54f2-3ad0-4fdf-afac-a93fdb0378a3 None None] Checking router: d221b587-201f-4923-926d-02481e296d23 for host: dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:47:04.940741 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd7b54f2-3ad0-4fdf-afac-a93fdb0378a3 None None] Routers {'d221b587-201f-4923-926d-02481e296d23'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:47:04.941384 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-dd7b54f2-3ad0-4fdf-afac-a93fdb0378a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:46:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['d221b587-201f-4923-926d-02481e296d23'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:47:04.968507 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea46b38e-7908-4385-8532-0b47f0150b23 req-b1ebc775-df93-44dd-bef7-4f75f130e106 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:04.970061 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ea46b38e-7908-4385-8532-0b47f0150b23 req-b1ebc775-df93-44dd-bef7-4f75f130e106 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=c81b2232-3aba-4f15-b8f1-a71826c8c1ca&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0389984 Sep 18 08:47:05.049365 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-dd7b54f2-3ad0-4fdf-afac-a93fdb0378a3 None None] Set router d221b587-201f-4923-926d-02481e296d23 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:47:05.062548 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ea46b38e-7908-4385-8532-0b47f0150b23 req-b5563632-86cd-4b0c-ad8d-ee084a1e4561 service neutron] 10.222.0.13 "GET /v2.0/networks/c81b2232-3aba-4f15-b8f1-a71826c8c1ca?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0841577 Sep 18 08:47:05.167696 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ea46b38e-7908-4385-8532-0b47f0150b23 req-30e5f293-3f4c-4a39-8462-9ff07660012b service neutron] 10.222.0.13 "GET /v2.0/networks/c81b2232-3aba-4f15-b8f1-a71826c8c1ca?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0814345 Sep 18 08:47:05.250487 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-dd7b54f2-3ad0-4fdf-afac-a93fdb0378a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd221b587-201f-4923-926d-02481e296d23', 'name': 'tempest-TestShelveInstance-734449530-router', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.84'}], 'enable_snat': True}, 'gw_port_id': 'bd096082-b42e-4e6d-a36f-afdc95ef9ae4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:39:48Z', 'updated_at': '2021-09-18T08:39:52Z', 'revision_number': 4, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'gw_port': {'id': 'bd096082-b42e-4e6d-a36f-afdc95ef9ae4', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:ed:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd221b587-201f-4923-926d-02481e296d23', 'device_owner': 'network:router_gateway', 'standard_attr_id': 303, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:49Z', 'updated_at': '2021-09-18T08:39:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '23821731-be27-4d6b-834b-f6953b4d873a', 'name': '', 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'mac_address': 'fa:16:3e:47:27:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd221b587-201f-4923-926d-02481e296d23', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': '58e9d53a-333d-4a2f-a575-92c9de3fb737', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:51Z', 'updated_at': '2021-09-18T08:39:58Z', 'revision_number': 5, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'subnets': [{'id': '58e9d53a-333d-4a2f-a575-92c9de3fb737', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:47:05.275999 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd7b54f2-3ad0-4fdf-afac-a93fdb0378a3 None None] The sync data for ids ['d221b587-201f-4923-926d-02481e296d23'] in dv-cinder-804470-6-iscsi is: [{'id': 'd221b587-201f-4923-926d-02481e296d23', 'name': 'tempest-TestShelveInstance-734449530-router', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.84'}], 'enable_snat': True}, 'gw_port_id': 'bd096082-b42e-4e6d-a36f-afdc95ef9ae4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:39:48Z', 'updated_at': '2021-09-18T08:39:52Z', 'revision_number': 4, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'gw_port': {'id': 'bd096082-b42e-4e6d-a36f-afdc95ef9ae4', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:ed:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd221b587-201f-4923-926d-02481e296d23', 'device_owner': 'network:router_gateway', 'standard_attr_id': 303, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:49Z', 'updated_at': '2021-09-18T08:39:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '23821731-be27-4d6b-834b-f6953b4d873a', 'name': '', 'network_id': 'c81b2232-3aba-4f15-b8f1-a71826c8c1ca', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'mac_address': 'fa:16:3e:47:27:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd221b587-201f-4923-926d-02481e296d23', 'device_owner': 'network:router_interface', 'standard_attr_id': 305, 'fixed_ips': [{'subnet_id': '58e9d53a-333d-4a2f-a575-92c9de3fb737', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:51Z', 'updated_at': '2021-09-18T08:39:58Z', 'revision_number': 5, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'subnets': [{'id': '58e9d53a-333d-4a2f-a575-92c9de3fb737', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:47:05.482607 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a86d0357-07ac-4fda-89f9-1f71cf2c7317 None None] New status for floating IP 5ba46ac2-2b32-4120-9e3c-946b63c051ee: DOWN {{(pid=94349) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 18 08:47:05.948129 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a521e78e-164e-4964-9866-901470474eb8 req-0fb62138-3a39-411b-ac12-bec6c5d71c14 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:05.949675 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a521e78e-164e-4964-9866-901470474eb8 req-0fb62138-3a39-411b-ac12-bec6c5d71c14 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 945 time: 0.0524819 Sep 18 08:47:05.987026 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a521e78e-164e-4964-9866-901470474eb8 req-4cf8acd3-bc33-4e91-bdee-435bbe97732a tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0311525 Sep 18 08:47:06.764143 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e820ceb4-67bd-45ef-a856-6952e9690391 req-e74f59b4-ff26-4bc5-bc0d-49e129d74850 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:06.765721 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e820ceb4-67bd-45ef-a856-6952e9690391 req-e74f59b4-ff26-4bc5-bc0d-49e129d74850 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.13 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 945 time: 0.0460660 Sep 18 08:47:06.853056 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-e820ceb4-67bd-45ef-a856-6952e9690391 req-49bda564-8e77-4b4e-99d9-2e61cc0f6643 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Deleting port 2f2f886e-b6d3-4d02-92de-a193d7d276f7 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:47:06.853428 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-e820ceb4-67bd-45ef-a856-6952e9690391 req-49bda564-8e77-4b4e-99d9-2e61cc0f6643 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:06.936158 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-e820ceb4-67bd-45ef-a856-6952e9690391 req-49bda564-8e77-4b4e-99d9-2e61cc0f6643 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] For port 2f2f886e-b6d3-4d02-92de-a193d7d276f7, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=2f2f886e-b6d3-4d02-92de-a193d7d276f7,segment=NetworkSegment(6dfc82da-1689-40bb-a749-6245f29bfd89),segment_id=6dfc82da-1689-40bb-a749-6245f29bfd89)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:47:06.936511 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-e820ceb4-67bd-45ef-a856-6952e9690391 req-49bda564-8e77-4b4e-99d9-2e61cc0f6643 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:06.949182 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-e820ceb4-67bd-45ef-a856-6952e9690391 req-49bda564-8e77-4b4e-99d9-2e61cc0f6643 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Calling delete_port for 2f2f886e-b6d3-4d02-92de-a193d7d276f7 owned by compute:nova {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:47:07.100409 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-e820ceb4-67bd-45ef-a856-6952e9690391 req-49bda564-8e77-4b4e-99d9-2e61cc0f6643 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:07.136477 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32f4b352-b73b-4e72-8b99-7ac3e65634d7 req-ea7f20f4-1249-424a-93b4-64e579fc557d tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:07.137899 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-32f4b352-b73b-4e72-8b99-7ac3e65634d7 req-ea7f20f4-1249-424a-93b4-64e579fc557d tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/ports?device_id=b6c407a6-4b6a-4479-911e-1c4620f28924 HTTP/1.1" status: 200 len: 867 time: 0.0841649 Sep 18 08:47:07.140614 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49bda564-8e77-4b4e-99d9-2e61cc0f6643 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Pushing event deleted for resources: {'Port': ['ID=2f2f886e-b6d3-4d02-92de-a193d7d276f7,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:47:07.199733 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-e820ceb4-67bd-45ef-a856-6952e9690391 req-49bda564-8e77-4b4e-99d9-2e61cc0f6643 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] No DVR routers for this DVR port 2f2f886e-b6d3-4d02-92de-a193d7d276f7 on host hv-cinder-80447 {{(pid=94347) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:47:07.206097 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-e820ceb4-67bd-45ef-a856-6952e9690391 req-49bda564-8e77-4b4e-99d9-2e61cc0f6643 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:07.208010 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e820ceb4-67bd-45ef-a856-6952e9690391 req-49bda564-8e77-4b4e-99d9-2e61cc0f6643 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.13 "DELETE /v2.0/ports/2f2f886e-b6d3-4d02-92de-a193d7d276f7 HTTP/1.1" status: 204 len: 173 time: 0.4368041 Sep 18 08:47:07.208435 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b6c407a6-4b6a-4479-911e-1c4620f28924', 'name': 'network-vif-deleted', 'tag': '2f2f886e-b6d3-4d02-92de-a193d7d276f7'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:47:07.210638 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-41d9a1cf-1d18-4eab-bd69-cd3edf802044" -d '{"events": [{"server_uuid": "b6c407a6-4b6a-4479-911e-1c4620f28924", "name": "network-vif-deleted", "tag": "2f2f886e-b6d3-4d02-92de-a193d7d276f7"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:47:07.221036 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-32f4b352-b73b-4e72-8b99-7ac3e65634d7 req-d8669e41-eb2c-41d8-aa79-1ce4d682e1ac tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "GET /v2.0/security-groups?id=4468335f-9dd9-4e13-b58c-f44e8d1615f2&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0769324 Sep 18 08:47:07.252406 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:47:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-07105334-75c5-4eac-b2ec-bc00b63d1c4d x-openstack-request-id: req-07105334-75c5-4eac-b2ec-bc00b63d1c4d {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:47:07.252696 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b6c407a6-4b6a-4479-911e-1c4620f28924", "name": "network-vif-deleted", "tag": "2f2f886e-b6d3-4d02-92de-a193d7d276f7", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:47:07.252948 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-07105334-75c5-4eac-b2ec-bc00b63d1c4d {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:47:07.253375 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b6c407a6-4b6a-4479-911e-1c4620f28924', 'name': 'network-vif-deleted', 'tag': '2f2f886e-b6d3-4d02-92de-a193d7d276f7', 'status': 'completed', 'code': 200} Sep 18 08:47:08.277029 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 37014) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:47:08.354772 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9dd831cc-5ab7-4896-bbb6-9d32e721dba5 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:08.379813 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9dd831cc-5ab7-4896-bbb6-9d32e721dba5 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:08.437226 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9dd831cc-5ab7-4896-bbb6-9d32e721dba5 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:08.439776 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9dd831cc-5ab7-4896-bbb6-9d32e721dba5 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:08.440927 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-9dd831cc-5ab7-4896-bbb6-9d32e721dba5 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] 10.222.0.35 "DELETE /v2.0/security-groups/4468335f-9dd9-4e13-b58c-f44e8d1615f2 HTTP/1.1" status: 204 len: 168 time: 0.1629069 Sep 18 08:47:08.450037 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dd831cc-5ab7-4896-bbb6-9d32e721dba5 tempest-TestShelveInstance-723673600 tempest-TestShelveInstance-723673600-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4468335f-9dd9-4e13-b58c-f44e8d1615f2,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:47:08.492942 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 37018) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:47:09.017264 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-cc8ae47b-13c5-4f8f-aa59-f7cc266ef91a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-783372'] for router_interface, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:09.247937 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-cc8ae47b-13c5-4f8f-aa59-f7cc266ef91a admin admin] Deleting port 23821731-be27-4d6b-834b-f6953b4d873a {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:47:09.248197 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-cc8ae47b-13c5-4f8f-aa59-f7cc266ef91a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:09.322615 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [None req-cc8ae47b-13c5-4f8f-aa59-f7cc266ef91a admin admin] For port 23821731-be27-4d6b-834b-f6953b4d873a, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=23821731-be27-4d6b-834b-f6953b4d873a,segment=NetworkSegment(6dfc82da-1689-40bb-a749-6245f29bfd89),segment_id=6dfc82da-1689-40bb-a749-6245f29bfd89)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:47:09.323284 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-cc8ae47b-13c5-4f8f-aa59-f7cc266ef91a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:09.334827 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-cc8ae47b-13c5-4f8f-aa59-f7cc266ef91a admin admin] Calling delete_port for 23821731-be27-4d6b-834b-f6953b4d873a owned by network:router_interface {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:47:09.507137 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-cc8ae47b-13c5-4f8f-aa59-f7cc266ef91a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:09.536563 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc8ae47b-13c5-4f8f-aa59-f7cc266ef91a admin admin] Pushing event deleted for resources: {'Port': ['ID=23821731-be27-4d6b-834b-f6953b4d873a,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:47:09.840066 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 2f2f886e-b6d3-4d02-92de-a193d7d276f7 no longer exists at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:47:09.860502 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] No Port match for: 2f2f886e-b6d3-4d02-92de-a193d7d276f7 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:47:09.860857 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 2f2f886e-b6d3-4d02-92de-a193d7d276f7 not bound to the agent host hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:47:09.947710 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-cc8ae47b-13c5-4f8f-aa59-f7cc266ef91a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-580042', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-785084'] for router_interface, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:10.156167 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cc8ae47b-13c5-4f8f-aa59-f7cc266ef91a admin admin] Router d221b587-201f-4923-926d-02481e296d23 has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94347) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:47:10.258709 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cc8ae47b-13c5-4f8f-aa59-f7cc266ef91a admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94347) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:47:10.264301 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-cc8ae47b-13c5-4f8f-aa59-f7cc266ef91a admin admin] 10.222.0.35 "PUT /v2.0/routers/d221b587-201f-4923-926d-02481e296d23/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7702291 Sep 18 08:47:10.266783 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 37026) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:47:10.269508 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-34188094-af3a-416f-82ae-f4e215d79cc1 None None] Sync routers for ids ['d221b587-201f-4923-926d-02481e296d23'] in dv-cinder-804470-6-iscsi {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:47:10.278762 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34188094-af3a-416f-82ae-f4e215d79cc1 None None] Routers {'d221b587-201f-4923-926d-02481e296d23'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:47:10.279375 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-34188094-af3a-416f-82ae-f4e215d79cc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:46:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['d221b587-201f-4923-926d-02481e296d23'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:47:10.366520 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-cdc1c3d9-2dd3-423c-baac-cde2daf9dd78 admin admin] Notify callbacks [] for router, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:10.383180 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-34188094-af3a-416f-82ae-f4e215d79cc1 None None] Set router d221b587-201f-4923-926d-02481e296d23 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:47:10.467247 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-cdc1c3d9-2dd3-423c-baac-cde2daf9dd78 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:10.521973 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-cdc1c3d9-2dd3-423c-baac-cde2daf9dd78 admin admin] Deleting port bd096082-b42e-4e6d-a36f-afdc95ef9ae4 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:47:10.522321 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-cdc1c3d9-2dd3-423c-baac-cde2daf9dd78 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:10.561900 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-34188094-af3a-416f-82ae-f4e215d79cc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd221b587-201f-4923-926d-02481e296d23', 'name': 'tempest-TestShelveInstance-734449530-router', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.84'}], 'enable_snat': True}, 'gw_port_id': 'bd096082-b42e-4e6d-a36f-afdc95ef9ae4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:39:48Z', 'updated_at': '2021-09-18T08:47:09Z', 'revision_number': 5, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'gw_port': {'id': 'bd096082-b42e-4e6d-a36f-afdc95ef9ae4', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:67:ed:13', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd221b587-201f-4923-926d-02481e296d23', 'device_owner': 'network:router_gateway', 'standard_attr_id': 303, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.84', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:49Z', 'updated_at': '2021-09-18T08:39:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:47:10.587324 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-34188094-af3a-416f-82ae-f4e215d79cc1 None None] Checking router: d221b587-201f-4923-926d-02481e296d23 for host: dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:47:10.595431 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34188094-af3a-416f-82ae-f4e215d79cc1 None None] Routers {'d221b587-201f-4923-926d-02481e296d23'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:47:10.596291 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-34188094-af3a-416f-82ae-f4e215d79cc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:46:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['d221b587-201f-4923-926d-02481e296d23'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:47:10.599253 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [None req-cdc1c3d9-2dd3-423c-baac-cde2daf9dd78 admin admin] For port bd096082-b42e-4e6d-a36f-afdc95ef9ae4, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=bd096082-b42e-4e6d-a36f-afdc95ef9ae4,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:47:10.599625 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-cdc1c3d9-2dd3-423c-baac-cde2daf9dd78 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:10.613279 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-cdc1c3d9-2dd3-423c-baac-cde2daf9dd78 admin admin] Calling delete_port for bd096082-b42e-4e6d-a36f-afdc95ef9ae4 owned by network:router_gateway {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:47:10.682098 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-34188094-af3a-416f-82ae-f4e215d79cc1 None None] Set router d221b587-201f-4923-926d-02481e296d23 gateway port host: None {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:47:10.735204 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-34188094-af3a-416f-82ae-f4e215d79cc1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd221b587-201f-4923-926d-02481e296d23', 'name': 'tempest-TestShelveInstance-734449530-router', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:39:48Z', 'updated_at': '2021-09-18T08:47:10Z', 'revision_number': 6, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'gw_port_host': None}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:47:10.763244 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-34188094-af3a-416f-82ae-f4e215d79cc1 None None] The sync data for ids ['d221b587-201f-4923-926d-02481e296d23'] in dv-cinder-804470-6-iscsi is: [{'id': 'd221b587-201f-4923-926d-02481e296d23', 'name': 'tempest-TestShelveInstance-734449530-router', 'tenant_id': '467aba0ce03e40a6927a5c05223dd512', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:39:48Z', 'updated_at': '2021-09-18T08:47:10Z', 'revision_number': 6, 'project_id': '467aba0ce03e40a6927a5c05223dd512', 'gw_port_host': None}] {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:47:10.773974 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-cdc1c3d9-2dd3-423c-baac-cde2daf9dd78 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:10.800674 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdc1c3d9-2dd3-423c-baac-cde2daf9dd78 admin admin] Pushing event deleted for resources: {'Port': ['ID=bd096082-b42e-4e6d-a36f-afdc95ef9ae4,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:47:10.862308 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-cdc1c3d9-2dd3-423c-baac-cde2daf9dd78 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-785018'] for router_gateway, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:10.947788 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-cdc1c3d9-2dd3-423c-baac-cde2daf9dd78 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-782379', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2977'] for router, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:10.949890 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-cdc1c3d9-2dd3-423c-baac-cde2daf9dd78 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:10.990647 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-cdc1c3d9-2dd3-423c-baac-cde2daf9dd78 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-782544'] for router, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:10.990950 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cdc1c3d9-2dd3-423c-baac-cde2daf9dd78 admin admin] Fanout notify agent at l3_agent the message router_deleted on router d221b587-201f-4923-926d-02481e296d23 {{(pid=94347) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 18 08:47:10.995142 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-cdc1c3d9-2dd3-423c-baac-cde2daf9dd78 admin admin] Notify callbacks [] for router, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:10.996279 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-cdc1c3d9-2dd3-423c-baac-cde2daf9dd78 admin admin] 10.222.0.35 "DELETE /v2.0/routers/d221b587-201f-4923-926d-02481e296d23 HTTP/1.1" status: 204 len: 168 time: 0.7285800 Sep 18 08:47:10.998824 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 37028) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:47:11.046066 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_v2 [None req-0fe19ef8-c78b-4088-83f3-41819e6ec9ab admin admin] Deleting subnet 58e9d53a-333d-4a2f-a575-92c9de3fb737 {{(pid=94347) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 18 08:47:11.048973 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0fe19ef8-c78b-4088-83f3-41819e6ec9ab admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:11.081841 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0fe19ef8-c78b-4088-83f3-41819e6ec9ab admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-13659316'] for subnet, precommit_delete_associations {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:11.160583 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0fe19ef8-c78b-4088-83f3-41819e6ec9ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1821528'] for subnet, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:11.218317 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0fe19ef8-c78b-4088-83f3-41819e6ec9ab admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1821519', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15069100', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-13996283'] for subnet, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:11.247447 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fe19ef8-c78b-4088-83f3-41819e6ec9ab admin admin] Pushing event deleted for resources: {'Subnet': ['ID=58e9d53a-333d-4a2f-a575-92c9de3fb737,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:47:11.251030 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0fe19ef8-c78b-4088-83f3-41819e6ec9ab admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for subnet, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:11.253006 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-0fe19ef8-c78b-4088-83f3-41819e6ec9ab admin admin] 10.222.0.35 "DELETE /v2.0/subnets/58e9d53a-333d-4a2f-a575-92c9de3fb737 HTTP/1.1" status: 204 len: 168 time: 0.2531257 Sep 18 08:47:11.255402 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 37032) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:47:11.257940 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e10108be-70c4-4d32-99ba-542613e3870e None None] Network c81b2232-3aba-4f15-b8f1-a71826c8c1ca requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:47:11.321186 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-867056da-df38-49fb-a19e-089e06e5ebc1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1861545'] for network, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:11.371875 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-867056da-df38-49fb-a19e-089e06e5ebc1 admin admin] Deleting port 401be85d-dae3-417c-b99c-d0561b3ff92b {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:47:11.372593 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-867056da-df38-49fb-a19e-089e06e5ebc1 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:11.437338 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [None req-867056da-df38-49fb-a19e-089e06e5ebc1 admin admin] For port 401be85d-dae3-417c-b99c-d0561b3ff92b, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=401be85d-dae3-417c-b99c-d0561b3ff92b,segment=NetworkSegment(6dfc82da-1689-40bb-a749-6245f29bfd89),segment_id=6dfc82da-1689-40bb-a749-6245f29bfd89)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:47:11.437702 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-867056da-df38-49fb-a19e-089e06e5ebc1 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:11.449871 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-867056da-df38-49fb-a19e-089e06e5ebc1 admin admin] Calling delete_port for 401be85d-dae3-417c-b99c-d0561b3ff92b owned by network:dhcp {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:47:11.528877 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-867056da-df38-49fb-a19e-089e06e5ebc1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:11.532057 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cbf93eea-a815-4f37-8a21-302fb5f95529 None None] DHCP port deletion for c81b2232-3aba-4f15-b8f1-a71826c8c1ca request from dv-cinder-804470-6-iscsi {{(pid=94348) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 18 08:47:11.560562 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-867056da-df38-49fb-a19e-089e06e5ebc1 admin admin] Pushing event deleted for resources: {'Port': ['ID=401be85d-dae3-417c-b99c-d0561b3ff92b,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:47:11.562517 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [None req-867056da-df38-49fb-a19e-089e06e5ebc1 admin admin] No DVR routers for this DVR port 401be85d-dae3-417c-b99c-d0561b3ff92b on host dv-cinder-804470-6-iscsi {{(pid=94347) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:47:11.616447 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device bd096082-b42e-4e6d-a36f-afdc95ef9ae4 no longer exists at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:47:11.633653 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-867056da-df38-49fb-a19e-089e06e5ebc1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1806559', 'neutron.services.segments.db._delete_segments_for_network-8732885752733'] for network, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:11.637906 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-536c997d-2873-442a-81bf-9fe918803742 None None] No Port match for: bd096082-b42e-4e6d-a36f-afdc95ef9ae4 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:47:11.638258 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device bd096082-b42e-4e6d-a36f-afdc95ef9ae4 not bound to the agent host dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:47:11.638692 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 401be85d-dae3-417c-b99c-d0561b3ff92b no longer exists at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:47:11.654428 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.services.segments.db [None req-867056da-df38-49fb-a19e-089e06e5ebc1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c81b2232-3aba-4f15-b8f1-a71826c8c1ca']}} {{(pid=94347) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:47:11.657133 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-536c997d-2873-442a-81bf-9fe918803742 None None] No Port match for: 401be85d-dae3-417c-b99c-d0561b3ff92b {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:47:11.657509 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 401be85d-dae3-417c-b99c-d0561b3ff92b not bound to the agent host dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:47:11.657924 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 23821731-be27-4d6b-834b-f6953b4d873a no longer exists at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:47:11.663667 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.services.segments.db [None req-867056da-df38-49fb-a19e-089e06e5ebc1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6dfc82da-1689-40bb-a749-6245f29bfd89') {'for_net_delete': True} {{(pid=94347) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:47:11.663964 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.services.segments.db [None req-867056da-df38-49fb-a19e-089e06e5ebc1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6dfc82da-1689-40bb-a749-6245f29bfd89') {} {{(pid=94347) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:47:11.673131 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-867056da-df38-49fb-a19e-089e06e5ebc1 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732885753254', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-13659327'] for segment, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:11.675949 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-536c997d-2873-442a-81bf-9fe918803742 None None] No Port match for: 23821731-be27-4d6b-834b-f6953b4d873a {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:47:11.676293 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 23821731-be27-4d6b-834b-f6953b4d873a not bound to the agent host dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:47:11.686760 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-867056da-df38-49fb-a19e-089e06e5ebc1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:11.692825 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-867056da-df38-49fb-a19e-089e06e5ebc1 admin admin] Releasing vlan 244 on physical network physnet1 to pool {{(pid=94347) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 18 08:47:11.693125 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-867056da-df38-49fb-a19e-089e06e5ebc1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15067250'] for segment, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: Traceback (most recent call last): Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: timer() Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: cb(*args, **kw) Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: return func(*args, **kwargs) Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: self._notify() Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: self.callback(batched_events) Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: event.method(event) Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: aggregate_uuid = self.p_client.list_aggregates( Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: return f(self, *a, **k) Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: return self._get(url).json() Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: return self.request(url, 'GET', **kwargs) Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: base_url = self.get_endpoint(auth, allow=allow, Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 18 08:47:11.694807 dv-cinder-804470-6-iscsi neutron-server[94347]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 18 08:47:11.751882 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-867056da-df38-49fb-a19e-089e06e5ebc1 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1806534', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-784926'] for network, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:11.758389 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-867056da-df38-49fb-a19e-089e06e5ebc1 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:11.760212 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-867056da-df38-49fb-a19e-089e06e5ebc1 admin admin] 10.222.0.35 "DELETE /v2.0/networks/c81b2232-3aba-4f15-b8f1-a71826c8c1ca HTTP/1.1" status: 204 len: 168 time: 0.5038855 Sep 18 08:47:11.763865 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 37034) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:47:11.773275 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-867056da-df38-49fb-a19e-089e06e5ebc1 admin admin] Pushing event deleted for resources: {'Network': ['ID=c81b2232-3aba-4f15-b8f1-a71826c8c1ca,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:47:12.152091 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f62b9ddd-2f13-452e-9b1c-d0d390f61238 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-783372'] for router_interface, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:12.641823 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.plugin [None req-f62b9ddd-2f13-452e-9b1c-d0d390f61238 admin admin] Deleting port 5fca4850-9dbe-4847-a121-123f4a9dc375 {{(pid=94346) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:47:12.642163 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f62b9ddd-2f13-452e-9b1c-d0d390f61238 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:12.717981 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.db [None req-f62b9ddd-2f13-452e-9b1c-d0d390f61238 admin admin] For port 5fca4850-9dbe-4847-a121-123f4a9dc375, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=5fca4850-9dbe-4847-a121-123f4a9dc375,segment=NetworkSegment(260fc424-2182-42ea-bfe3-fe4a03948384),segment_id=260fc424-2182-42ea-bfe3-fe4a03948384)] {{(pid=94346) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:47:12.718331 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f62b9ddd-2f13-452e-9b1c-d0d390f61238 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:12.730057 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.plugin [None req-f62b9ddd-2f13-452e-9b1c-d0d390f61238 admin admin] Calling delete_port for 5fca4850-9dbe-4847-a121-123f4a9dc375 owned by network:router_interface {{(pid=94346) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:47:12.898804 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f62b9ddd-2f13-452e-9b1c-d0d390f61238 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:12.921382 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f62b9ddd-2f13-452e-9b1c-d0d390f61238 admin admin] Pushing event deleted for resources: {'Port': ['ID=5fca4850-9dbe-4847-a121-123f4a9dc375,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:47:13.087173 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f62b9ddd-2f13-452e-9b1c-d0d390f61238 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-580042', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-785084'] for router_interface, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:13.291825 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f62b9ddd-2f13-452e-9b1c-d0d390f61238 admin admin] Router 11fd14b5-1378-4aa8-9fbb-a4577850589e has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94346) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:47:13.395467 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f62b9ddd-2f13-452e-9b1c-d0d390f61238 admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94346) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:47:13.401107 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-f62b9ddd-2f13-452e-9b1c-d0d390f61238 admin admin] 10.222.0.35 "PUT /v2.0/routers/11fd14b5-1378-4aa8-9fbb-a4577850589e/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6361639 Sep 18 08:47:13.403600 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 37040) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:47:13.406105 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-66a9a903-3449-42d0-8eb5-908d23ea67ae None None] Sync routers for ids ['11fd14b5-1378-4aa8-9fbb-a4577850589e'] in dv-cinder-804470-6-iscsi {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:47:13.418550 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-66a9a903-3449-42d0-8eb5-908d23ea67ae None None] Routers {'11fd14b5-1378-4aa8-9fbb-a4577850589e'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:47:13.419255 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-66a9a903-3449-42d0-8eb5-908d23ea67ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:46:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['11fd14b5-1378-4aa8-9fbb-a4577850589e'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:47:13.503347 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f7b27a4f-c234-499c-8927-3688e3e09b40 admin admin] Notify callbacks [] for router, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:13.517725 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-66a9a903-3449-42d0-8eb5-908d23ea67ae None None] Set router 11fd14b5-1378-4aa8-9fbb-a4577850589e gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:47:13.620969 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f7b27a4f-c234-499c-8927-3688e3e09b40 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:13.672924 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.plugin [None req-f7b27a4f-c234-499c-8927-3688e3e09b40 admin admin] Deleting port 629d0b34-445c-4313-b738-d9083c86fbce {{(pid=94346) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:47:13.673297 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f7b27a4f-c234-499c-8927-3688e3e09b40 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:13.699845 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-66a9a903-3449-42d0-8eb5-908d23ea67ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '11fd14b5-1378-4aa8-9fbb-a4577850589e', 'name': 'tempest-TestShelveInstance-608586296-router', 'tenant_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.125'}], 'enable_snat': True}, 'gw_port_id': '629d0b34-445c-4313-b738-d9083c86fbce', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:39:55Z', 'updated_at': '2021-09-18T08:47:12Z', 'revision_number': 5, 'project_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'gw_port': {'id': '629d0b34-445c-4313-b738-d9083c86fbce', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:3e:50:d2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '11fd14b5-1378-4aa8-9fbb-a4577850589e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 326, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.125', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:39:55Z', 'updated_at': '2021-09-18T08:40:03Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:47:13.725886 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-66a9a903-3449-42d0-8eb5-908d23ea67ae None None] Checking router: 11fd14b5-1378-4aa8-9fbb-a4577850589e for host: dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:47:13.734456 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-66a9a903-3449-42d0-8eb5-908d23ea67ae None None] Routers {'11fd14b5-1378-4aa8-9fbb-a4577850589e'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:47:13.735061 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-66a9a903-3449-42d0-8eb5-908d23ea67ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:46:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['11fd14b5-1378-4aa8-9fbb-a4577850589e'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:47:13.752903 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.db [None req-f7b27a4f-c234-499c-8927-3688e3e09b40 admin admin] For port 629d0b34-445c-4313-b738-d9083c86fbce, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=629d0b34-445c-4313-b738-d9083c86fbce,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94346) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:47:13.753301 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f7b27a4f-c234-499c-8927-3688e3e09b40 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:13.764664 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.plugin [None req-f7b27a4f-c234-499c-8927-3688e3e09b40 admin admin] Calling delete_port for 629d0b34-445c-4313-b738-d9083c86fbce owned by network:router_gateway {{(pid=94346) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:47:13.899980 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-66a9a903-3449-42d0-8eb5-908d23ea67ae None None] Set router 11fd14b5-1378-4aa8-9fbb-a4577850589e gateway port host: None {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:47:13.926401 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f7b27a4f-c234-499c-8927-3688e3e09b40 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:13.952442 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7b27a4f-c234-499c-8927-3688e3e09b40 admin admin] Pushing event deleted for resources: {'Port': ['ID=629d0b34-445c-4313-b738-d9083c86fbce,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:47:13.955531 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-66a9a903-3449-42d0-8eb5-908d23ea67ae None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '11fd14b5-1378-4aa8-9fbb-a4577850589e', 'name': 'tempest-TestShelveInstance-608586296-router', 'tenant_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:39:55Z', 'updated_at': '2021-09-18T08:47:13Z', 'revision_number': 6, 'project_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'gw_port_host': None}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:47:13.983422 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-66a9a903-3449-42d0-8eb5-908d23ea67ae None None] The sync data for ids ['11fd14b5-1378-4aa8-9fbb-a4577850589e'] in dv-cinder-804470-6-iscsi is: [{'id': '11fd14b5-1378-4aa8-9fbb-a4577850589e', 'name': 'tempest-TestShelveInstance-608586296-router', 'tenant_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:39:55Z', 'updated_at': '2021-09-18T08:47:13Z', 'revision_number': 6, 'project_id': '0f8143966f2943cb9a8e3ca19c244e1c', 'gw_port_host': None}] {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:47:14.013383 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f7b27a4f-c234-499c-8927-3688e3e09b40 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-785018'] for router_gateway, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:14.101929 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f7b27a4f-c234-499c-8927-3688e3e09b40 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-782379', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2977'] for router, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:14.103968 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f7b27a4f-c234-499c-8927-3688e3e09b40 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:14.145117 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f7b27a4f-c234-499c-8927-3688e3e09b40 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-782544'] for router, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:14.145654 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f7b27a4f-c234-499c-8927-3688e3e09b40 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 11fd14b5-1378-4aa8-9fbb-a4577850589e {{(pid=94346) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 18 08:47:14.150351 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-f7b27a4f-c234-499c-8927-3688e3e09b40 admin admin] Notify callbacks [] for router, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:14.152055 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-f7b27a4f-c234-499c-8927-3688e3e09b40 admin admin] 10.222.0.35 "DELETE /v2.0/routers/11fd14b5-1378-4aa8-9fbb-a4577850589e HTTP/1.1" status: 204 len: 168 time: 0.7475536 Sep 18 08:47:14.154594 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 37044) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:47:14.195602 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_v2 [None req-b828b6b3-32f4-4e05-9a20-26e17f7650ee admin admin] Deleting subnet 979e5af3-22a3-4c66-a051-2000dea384e9 {{(pid=94346) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 18 08:47:14.199043 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b828b6b3-32f4-4e05-9a20-26e17f7650ee admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:14.234978 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b828b6b3-32f4-4e05-9a20-26e17f7650ee admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14122726'] for subnet, precommit_delete_associations {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:14.335595 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b828b6b3-32f4-4e05-9a20-26e17f7650ee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1821528'] for subnet, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:14.390147 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b828b6b3-32f4-4e05-9a20-26e17f7650ee admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1821519', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14290141', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14198653'] for subnet, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:14.418454 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b828b6b3-32f4-4e05-9a20-26e17f7650ee admin admin] Pushing event deleted for resources: {'Subnet': ['ID=979e5af3-22a3-4c66-a051-2000dea384e9,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:47:14.424117 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b828b6b3-32f4-4e05-9a20-26e17f7650ee admin admin] Notify callbacks [] for subnet, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:14.428432 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-b828b6b3-32f4-4e05-9a20-26e17f7650ee admin admin] 10.222.0.35 "DELETE /v2.0/subnets/979e5af3-22a3-4c66-a051-2000dea384e9 HTTP/1.1" status: 204 len: 168 time: 0.2705176 Sep 18 08:47:14.428528 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 37048) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:47:14.429797 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d32b5e66-6c7c-4e91-862f-40968b0ed15b None None] Network 71ee8a3f-e7a5-4917-924c-07e7cffbbf9f requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:47:14.493922 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dc689813-1c10-4968-8cbe-d496afb7275a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1861545'] for network, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:14.546087 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.plugin [None req-dc689813-1c10-4968-8cbe-d496afb7275a admin admin] Deleting port 0c4aad35-0f98-4e28-8018-c199999da418 {{(pid=94346) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:47:14.546441 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dc689813-1c10-4968-8cbe-d496afb7275a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:14.611927 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.db [None req-dc689813-1c10-4968-8cbe-d496afb7275a admin admin] For port 0c4aad35-0f98-4e28-8018-c199999da418, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=0c4aad35-0f98-4e28-8018-c199999da418,segment=NetworkSegment(260fc424-2182-42ea-bfe3-fe4a03948384),segment_id=260fc424-2182-42ea-bfe3-fe4a03948384)] {{(pid=94346) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:47:14.612290 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dc689813-1c10-4968-8cbe-d496afb7275a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:14.624527 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.plugin [None req-dc689813-1c10-4968-8cbe-d496afb7275a admin admin] Calling delete_port for 0c4aad35-0f98-4e28-8018-c199999da418 owned by network:dhcp {{(pid=94346) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:47:14.700483 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dc689813-1c10-4968-8cbe-d496afb7275a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:14.723155 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-68050025-71c8-4e9d-a2f2-f0ad975a0eb5 None None] DHCP port deletion for 71ee8a3f-e7a5-4917-924c-07e7cffbbf9f request from dv-cinder-804470-6-iscsi {{(pid=94348) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 18 08:47:14.727835 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc689813-1c10-4968-8cbe-d496afb7275a admin admin] Pushing event deleted for resources: {'Port': ['ID=0c4aad35-0f98-4e28-8018-c199999da418,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:47:14.738306 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc689813-1c10-4968-8cbe-d496afb7275a admin admin] No DVR routers for this DVR port 0c4aad35-0f98-4e28-8018-c199999da418 on host dv-cinder-804470-6-iscsi {{(pid=94346) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:47:14.807009 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dc689813-1c10-4968-8cbe-d496afb7275a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1806559', 'neutron.services.segments.db._delete_segments_for_network-8732885752733'] for network, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:14.827407 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-dc689813-1c10-4968-8cbe-d496afb7275a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['71ee8a3f-e7a5-4917-924c-07e7cffbbf9f']}} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:47:14.836845 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-dc689813-1c10-4968-8cbe-d496afb7275a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '260fc424-2182-42ea-bfe3-fe4a03948384') {'for_net_delete': True} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:47:14.837144 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-dc689813-1c10-4968-8cbe-d496afb7275a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '260fc424-2182-42ea-bfe3-fe4a03948384') {} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:47:14.849500 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dc689813-1c10-4968-8cbe-d496afb7275a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732885753254', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14122733'] for segment, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:14.862769 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dc689813-1c10-4968-8cbe-d496afb7275a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:14.868681 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-dc689813-1c10-4968-8cbe-d496afb7275a admin admin] Releasing vlan 225 on physical network physnet1 to pool {{(pid=94346) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 18 08:47:14.869146 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dc689813-1c10-4968-8cbe-d496afb7275a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14289667'] for segment, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: Traceback (most recent call last): Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: timer() Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: cb(*args, **kw) Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: return func(*args, **kwargs) Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: self._notify() Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: self.callback(batched_events) Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: event.method(event) Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: aggregate_uuid = self.p_client.list_aggregates( Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: return f(self, *a, **k) Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: return self._get(url).json() Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: return self.request(url, 'GET', **kwargs) Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: base_url = self.get_endpoint(auth, allow=allow, Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 18 08:47:14.871350 dv-cinder-804470-6-iscsi neutron-server[94346]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 18 08:47:14.927490 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dc689813-1c10-4968-8cbe-d496afb7275a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1806534', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-784926'] for network, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:14.933641 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dc689813-1c10-4968-8cbe-d496afb7275a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:14.935491 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-dc689813-1c10-4968-8cbe-d496afb7275a admin admin] 10.222.0.35 "DELETE /v2.0/networks/71ee8a3f-e7a5-4917-924c-07e7cffbbf9f HTTP/1.1" status: 204 len: 168 time: 0.5060885 Sep 18 08:47:14.946371 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc689813-1c10-4968-8cbe-d496afb7275a admin admin] Pushing event deleted for resources: {'Network': ['ID=71ee8a3f-e7a5-4917-924c-07e7cffbbf9f,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:47:15.052013 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 37052) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:47:15.090032 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-1b6673dd-2fde-4da9-a917-2f35c5130cff admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=467aba0ce03e40a6927a5c05223dd512&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0368640 Sep 18 08:47:15.092315 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 37054) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:47:15.137838 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c8743a03-6bd5-47de-822a-53809f97877a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:15.157597 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c8743a03-6bd5-47de-822a-53809f97877a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:15.206268 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c8743a03-6bd5-47de-822a-53809f97877a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:15.209032 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c8743a03-6bd5-47de-822a-53809f97877a admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:15.210262 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-c8743a03-6bd5-47de-822a-53809f97877a admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/834c9d2a-6a0b-468c-9d3e-0ea7294a2f55 HTTP/1.1" status: 204 len: 168 time: 0.1170657 Sep 18 08:47:15.219334 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8743a03-6bd5-47de-822a-53809f97877a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=834c9d2a-6a0b-468c-9d3e-0ea7294a2f55,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:47:15.508586 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 37060) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:47:15.548300 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-05fd8282-5ae0-45c0-bbd5-fbb29747c808 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=0f8143966f2943cb9a8e3ca19c244e1c&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0385351 Sep 18 08:47:15.550823 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 37064) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:47:15.599076 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3c0fb028-dd30-4880-954f-6b946db45ba1 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:15.619469 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3c0fb028-dd30-4880-954f-6b946db45ba1 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:15.624168 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 0c4aad35-0f98-4e28-8018-c199999da418 no longer exists at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:47:15.644339 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-536c997d-2873-442a-81bf-9fe918803742 None None] No Port match for: 0c4aad35-0f98-4e28-8018-c199999da418 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:47:15.644692 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 0c4aad35-0f98-4e28-8018-c199999da418 not bound to the agent host dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:47:15.645116 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 629d0b34-445c-4313-b738-d9083c86fbce no longer exists at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:47:15.663815 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-536c997d-2873-442a-81bf-9fe918803742 None None] No Port match for: 629d0b34-445c-4313-b738-d9083c86fbce {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:47:15.664164 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 629d0b34-445c-4313-b738-d9083c86fbce not bound to the agent host dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:47:15.664577 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 5fca4850-9dbe-4847-a121-123f4a9dc375 no longer exists at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:47:15.673020 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3c0fb028-dd30-4880-954f-6b946db45ba1 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:15.675720 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3c0fb028-dd30-4880-954f-6b946db45ba1 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:15.676895 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-3c0fb028-dd30-4880-954f-6b946db45ba1 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/18ee65c3-e785-4945-9d63-aa18c99b7a22 HTTP/1.1" status: 204 len: 168 time: 0.1251853 Sep 18 08:47:15.684468 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c0fb028-dd30-4880-954f-6b946db45ba1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=18ee65c3-e785-4945-9d63-aa18c99b7a22,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:47:15.686583 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-536c997d-2873-442a-81bf-9fe918803742 None None] No Port match for: 5fca4850-9dbe-4847-a121-123f4a9dc375 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:47:15.686933 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 5fca4850-9dbe-4847-a121-123f4a9dc375 not bound to the agent host dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:47:19.620410 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-32631fcf-46df-4959-88e7-dccad22e2cba None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:20.059744 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:20.703717 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:47:22.406393 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-7b732e5d-5344-4f8f-8e81-d7619511e195 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:23.219898 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:23.364888 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:24.884745 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:32.666565 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08a0c499-5bf6-49fe-88a5-d6309a0dd3e7 req-c79d4ce9-c7fd-437f-8fcc-0d6b8518b35a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:32.668606 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-08a0c499-5bf6-49fe-88a5-d6309a0dd3e7 req-c79d4ce9-c7fd-437f-8fcc-0d6b8518b35a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0477309 Sep 18 08:47:32.704732 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-08a0c499-5bf6-49fe-88a5-d6309a0dd3e7 req-b0736589-ada6-4c87-8985-3936dff1d85d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0302653 Sep 18 08:47:33.821876 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d0667c3-7436-48dd-9eee-cb530b78c22e req-c8738abc-99c0-4e4c-8ecf-67501004fa68 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:33.823324 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5d0667c3-7436-48dd-9eee-cb530b78c22e req-c8738abc-99c0-4e4c-8ecf-67501004fa68 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0468221 Sep 18 08:47:33.859383 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5d0667c3-7436-48dd-9eee-cb530b78c22e req-88fe773f-4ea0-438e-8009-1fa1f2045d02 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0303402 Sep 18 08:47:34.977412 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91a4dcfd-2aa3-4870-a4fe-ef5778283266 req-f541d662-fc5d-420d-9f41-b8937faa18d1 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:34.978874 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-91a4dcfd-2aa3-4870-a4fe-ef5778283266 req-f541d662-fc5d-420d-9f41-b8937faa18d1 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0502679 Sep 18 08:47:35.015650 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-91a4dcfd-2aa3-4870-a4fe-ef5778283266 req-113006c3-beb0-464f-ac19-7d782d80c095 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0310578 Sep 18 08:47:36.129904 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2cc2dbcb-0e7e-44d5-a172-af4cbcbbfea8 req-c10abc51-283a-4e88-aac0-30c1de0e7676 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:36.131380 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2cc2dbcb-0e7e-44d5-a172-af4cbcbbfea8 req-c10abc51-283a-4e88-aac0-30c1de0e7676 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0469635 Sep 18 08:47:36.169381 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2cc2dbcb-0e7e-44d5-a172-af4cbcbbfea8 req-e280f11c-6b27-4121-8907-e9c0f5da3015 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0316927 Sep 18 08:47:37.285527 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c284edf2-9695-4462-8833-68f6fa1ecb46 req-fa55722b-498d-428f-825f-f8140f5b0584 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:37.286922 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c284edf2-9695-4462-8833-68f6fa1ecb46 req-fa55722b-498d-428f-825f-f8140f5b0584 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0489321 Sep 18 08:47:37.323489 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c284edf2-9695-4462-8833-68f6fa1ecb46 req-daa4b1a1-767c-4e99-9f7e-845f1d7e522c tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0306253 Sep 18 08:47:38.442082 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbe3e0d0-f994-47ff-bc6e-e168a52bef71 req-663f4421-822d-4b5a-a774-bceff54cc0d2 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:38.443539 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cbe3e0d0-f994-47ff-bc6e-e168a52bef71 req-663f4421-822d-4b5a-a774-bceff54cc0d2 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0505805 Sep 18 08:47:38.480532 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cbe3e0d0-f994-47ff-bc6e-e168a52bef71 req-7e5c2682-2168-48b9-9d77-3ef436d3f790 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0306344 Sep 18 08:47:39.597343 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30bcf393-9a94-4d66-b173-ef16cb887c06 req-c21e845b-bc10-4912-871f-bd025d2916dc tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:39.598853 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-30bcf393-9a94-4d66-b173-ef16cb887c06 req-c21e845b-bc10-4912-871f-bd025d2916dc tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0493937 Sep 18 08:47:39.636430 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-30bcf393-9a94-4d66-b173-ef16cb887c06 req-a232299b-b08c-4186-8936-546bf1bdb329 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0316958 Sep 18 08:47:40.752045 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83f8a2e1-6248-49dc-9f80-1fb39960ef88 req-199783ad-7297-41b5-8664-eac7bbc36295 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:40.753520 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-83f8a2e1-6248-49dc-9f80-1fb39960ef88 req-199783ad-7297-41b5-8664-eac7bbc36295 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0467751 Sep 18 08:47:40.790131 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-83f8a2e1-6248-49dc-9f80-1fb39960ef88 req-f9e3e072-e8c7-46d1-bf2d-a62cee738f90 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0308502 Sep 18 08:47:41.908126 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8e9562c-7db4-44f6-bd66-ae9c25bca348 req-52803a85-1fe3-437b-aaa2-7de006dacec8 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:41.909589 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f8e9562c-7db4-44f6-bd66-ae9c25bca348 req-52803a85-1fe3-437b-aaa2-7de006dacec8 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0499973 Sep 18 08:47:41.946003 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f8e9562c-7db4-44f6-bd66-ae9c25bca348 req-3897757b-d5a7-4675-ae64-ff83e8181e34 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0306978 Sep 18 08:47:43.061651 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3349999-60fc-4fb0-bd4a-580ffc9d99e4 req-4db23d9c-668a-43d8-9115-1a9ecb866658 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:43.063108 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c3349999-60fc-4fb0-bd4a-580ffc9d99e4 req-4db23d9c-668a-43d8-9115-1a9ecb866658 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0472169 Sep 18 08:47:43.099420 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c3349999-60fc-4fb0-bd4a-580ffc9d99e4 req-38a65997-19fe-45e8-a705-fc7eefb38b4c tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0306199 Sep 18 08:47:43.993204 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device fb17b7f6-af82-4371-b33a-e2a9b265ea42 details requested by agent hyperv_hv-cinder-80447 with host hv-cinder-80447 {{(pid=94348) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 18 08:47:44.087113 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port fb17b7f6-af82-4371-b33a-e2a9b265ea42, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=fb17b7f6-af82-4371-b33a-e2a9b265ea42,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:47:44.097856 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Returning: {'device': 'fb17b7f6-af82-4371-b33a-e2a9b265ea42', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'port_id': 'fb17b7f6-af82-4371-b33a-e2a9b265ea42', 'mac_address': 'fa:16:3e:21:d8:84', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 214, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94348) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 18 08:47:44.133856 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:44.146377 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id fb17b7f6-af82-4371-b33a-e2a9b265ea42 {{(pid=94348) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:47:44.164656 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port fb17b7f6-af82-4371-b33a-e2a9b265ea42, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=fb17b7f6-af82-4371-b33a-e2a9b265ea42,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:47:44.170181 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:44.218213 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fa3695c-56fa-4c08-9e72-1134fcda3a50 req-849813b4-70db-4c31-9fe2-9f9584b1b82d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:44.219717 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2fa3695c-56fa-4c08-9e72-1134fcda3a50 req-849813b4-70db-4c31-9fe2-9f9584b1b82d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 944 time: 0.0495679 Sep 18 08:47:44.223859 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=fb17b7f6-af82-4371-b33a-e2a9b265ea42,revision_number=6']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:47:44.237873 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:47:44.238226 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:47:44.238573 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:47:44.238916 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:47:44.239249 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:47:44.239582 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:47:44.239911 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:47:44.240237 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:47:44.240590 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:47:44.240920 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:47:44.241262 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:47:44.241598 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:47:44.258696 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2fa3695c-56fa-4c08-9e72-1134fcda3a50 req-bbc72e0d-9c7a-4066-9221-8d06713892b0 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0327468 Sep 18 08:47:44.333724 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['fb17b7f6-af82-4371-b33a-e2a9b265ea42'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:47:45.379615 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-285324d7-e865-44c1-8e3d-26399e9df106 req-0b16420e-a24b-4555-8199-caff348d04b5 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:45.381141 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-285324d7-e865-44c1-8e3d-26399e9df106 req-0b16420e-a24b-4555-8199-caff348d04b5 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 944 time: 0.0520086 Sep 18 08:47:45.417955 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-285324d7-e865-44c1-8e3d-26399e9df106 req-f80b17ca-dfac-4fe5-9d5f-35c276cdb74a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0303469 Sep 18 08:47:45.992498 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device fb17b7f6-af82-4371-b33a-e2a9b265ea42 up at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:47:46.199132 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning complete for port fb17b7f6-af82-4371-b33a-e2a9b265ea42 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:47:46.199425 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:46.283462 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:46.304947 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a40b16b8-10f1-416c-933c-1f01dd483851', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fb17b7f6-af82-4371-b33a-e2a9b265ea42'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:47:46.307194 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-37932e55-484e-452f-a8cf-9fdab0116c23" -d '{"events": [{"server_uuid": "a40b16b8-10f1-416c-933c-1f01dd483851", "name": "network-vif-plugged", "status": "completed", "tag": "fb17b7f6-af82-4371-b33a-e2a9b265ea42"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:47:46.319390 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port fb17b7f6-af82-4371-b33a-e2a9b265ea42, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=fb17b7f6-af82-4371-b33a-e2a9b265ea42,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:47:46.322816 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:46.346386 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:47:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b38852ab-f0bd-4e22-9e5d-2d83b6fa8fa3 x-openstack-request-id: req-b38852ab-f0bd-4e22-9e5d-2d83b6fa8fa3 {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:47:46.346677 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a40b16b8-10f1-416c-933c-1f01dd483851", "name": "network-vif-plugged", "status": "completed", "tag": "fb17b7f6-af82-4371-b33a-e2a9b265ea42", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:47:46.346931 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-b38852ab-f0bd-4e22-9e5d-2d83b6fa8fa3 {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:47:46.347316 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a40b16b8-10f1-416c-933c-1f01dd483851', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fb17b7f6-af82-4371-b33a-e2a9b265ea42', 'code': 200} Sep 18 08:47:46.371452 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=fb17b7f6-af82-4371-b33a-e2a9b265ea42,revision_number=7']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:47:46.533420 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1581bbb-a42a-4b93-83fd-81e1a7435189 req-7d925924-06e0-4643-b50f-919c8ddb4dfa tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:46.534915 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f1581bbb-a42a-4b93-83fd-81e1a7435189 req-7d925924-06e0-4643-b50f-919c8ddb4dfa tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0485516 Sep 18 08:47:46.571666 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f1581bbb-a42a-4b93-83fd-81e1a7435189 req-812f2041-749c-480a-90a6-ca85370f80a5 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0309589 Sep 18 08:47:47.691714 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee1d695b-c225-4c5b-b638-edaecee314dc req-10ed4292-e36c-4a3b-a409-cdccd5cc3cf8 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:47.693175 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ee1d695b-c225-4c5b-b638-edaecee314dc req-10ed4292-e36c-4a3b-a409-cdccd5cc3cf8 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0471745 Sep 18 08:47:47.728824 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ee1d695b-c225-4c5b-b638-edaecee314dc req-25f39931-77e8-437e-83b8-21a057246ebb tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0299821 Sep 18 08:47:48.847002 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4630967c-78f2-4c70-967d-f1f74ecf0446 req-8a066875-124d-41f2-a039-e1247921503c tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:48.848440 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4630967c-78f2-4c70-967d-f1f74ecf0446 req-8a066875-124d-41f2-a039-e1247921503c tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0504537 Sep 18 08:47:48.885277 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4630967c-78f2-4c70-967d-f1f74ecf0446 req-66d82f59-d5ce-4d42-89d4-943ac22340e0 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0308969 Sep 18 08:47:49.621452 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-c973d7a5-9a3c-4e4c-949a-afb9f5a4b396 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:50.078903 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:50.166120 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dad5bc2f-a4de-4c67-a5db-4f15ce15570a req-5a0f29e4-a360-48ec-8b07-384ba2ce8a6d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:50.168121 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dad5bc2f-a4de-4c67-a5db-4f15ce15570a req-5a0f29e4-a360-48ec-8b07-384ba2ce8a6d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0480485 Sep 18 08:47:50.207808 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dad5bc2f-a4de-4c67-a5db-4f15ce15570a req-701c0e78-3fee-4f42-8306-43e3ce18de07 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0332727 Sep 18 08:47:51.330986 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eddc3d73-6d5a-48b6-b49c-b81f6bd06e5a req-d5da0ebe-eb49-4e06-a95d-45ed97b150d6 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:51.333420 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-eddc3d73-6d5a-48b6-b49c-b81f6bd06e5a req-d5da0ebe-eb49-4e06-a95d-45ed97b150d6 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0520792 Sep 18 08:47:51.374904 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-eddc3d73-6d5a-48b6-b49c-b81f6bd06e5a req-bd33aa0d-bcf4-41a7-bfe8-e07fd6d8a4e4 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0352144 Sep 18 08:47:52.410521 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-f9f398df-eba4-488e-b237-d7070c26b4e0 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:52.507496 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53276bf8-c8b6-45df-87d6-3ad59d6c42bd req-c9a70d20-149b-49dd-9462-10e86aac207c tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:52.508961 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-53276bf8-c8b6-45df-87d6-3ad59d6c42bd req-c9a70d20-149b-49dd-9462-10e86aac207c tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0564096 Sep 18 08:47:52.549082 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-53276bf8-c8b6-45df-87d6-3ad59d6c42bd req-3078c4c2-bfee-4de6-8b0d-7c91d1bc14e2 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0331855 Sep 18 08:47:53.227873 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:53.371601 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:53.674112 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03c890dc-2fe0-4589-ae7c-e758e539f24e req-ecbbfeb3-f4ed-4fec-a446-11658f56a435 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:53.677707 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-03c890dc-2fe0-4589-ae7c-e758e539f24e req-ecbbfeb3-f4ed-4fec-a446-11658f56a435 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0521629 Sep 18 08:47:53.714868 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-03c890dc-2fe0-4589-ae7c-e758e539f24e req-01549170-3f7f-4654-bfcc-4730a292346f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0333145 Sep 18 08:47:54.837025 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b91e4ad-5e32-4387-8822-8d6ca1959b38 req-563d6942-a3e4-4451-9732-e2c1d5ff0f91 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:54.844928 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8b91e4ad-5e32-4387-8822-8d6ca1959b38 req-563d6942-a3e4-4451-9732-e2c1d5ff0f91 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0545630 Sep 18 08:47:54.888529 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:47:54.891979 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8b91e4ad-5e32-4387-8822-8d6ca1959b38 req-6d18d3c1-b6b6-4e26-81bc-74faea9dba84 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460753 Sep 18 08:47:56.012152 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3391c482-726d-46db-b469-86b7cb0612dd req-65771833-d212-4087-abd9-e1b1a69682f3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:56.015263 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3391c482-726d-46db-b469-86b7cb0612dd req-65771833-d212-4087-abd9-e1b1a69682f3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0566864 Sep 18 08:47:56.051943 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3391c482-726d-46db-b469-86b7cb0612dd req-89a9eef0-7975-4f2f-bb4f-e582db9af59c tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0322237 Sep 18 08:47:57.174768 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ec1085f-e9bd-4ef4-8047-d5124e8ef70b req-1beac441-09af-476d-8b50-3228f7eb0243 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:57.176259 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7ec1085f-e9bd-4ef4-8047-d5124e8ef70b req-1beac441-09af-476d-8b50-3228f7eb0243 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0499198 Sep 18 08:47:57.219014 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7ec1085f-e9bd-4ef4-8047-d5124e8ef70b req-df99f312-6b86-4de7-9e97-2f4028d81f8e tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0364184 Sep 18 08:47:57.703872 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:47:58.341507 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-340503f4-98af-42d4-b79c-b464c62d5f04 req-ff99bb80-db73-4208-a84a-68f0cfccb143 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:58.343003 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-340503f4-98af-42d4-b79c-b464c62d5f04 req-ff99bb80-db73-4208-a84a-68f0cfccb143 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0532489 Sep 18 08:47:58.388860 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-340503f4-98af-42d4-b79c-b464c62d5f04 req-4852f6ec-26a6-4289-87cb-10ec295345d2 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0393188 Sep 18 08:47:59.512842 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ac266a9-23ef-4e50-8b50-95faacbc5cd3 req-07265156-5bd4-429b-a7be-c801003b8ca8 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:47:59.514614 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9ac266a9-23ef-4e50-8b50-95faacbc5cd3 req-07265156-5bd4-429b-a7be-c801003b8ca8 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0526712 Sep 18 08:47:59.554583 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9ac266a9-23ef-4e50-8b50-95faacbc5cd3 req-af6803a9-e5c9-4c72-a5f0-c4ade5a6c3e8 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0333123 Sep 18 08:48:00.675588 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea79d437-3fba-4267-8bf5-09f15e4871db req-fc37196b-f860-4740-8030-74aa00d43733 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:00.677044 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ea79d437-3fba-4267-8bf5-09f15e4871db req-fc37196b-f860-4740-8030-74aa00d43733 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0471203 Sep 18 08:48:00.713072 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ea79d437-3fba-4267-8bf5-09f15e4871db req-977b3407-25c2-4a52-bdf2-fdbad8e9d4b1 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0302546 Sep 18 08:48:00.813705 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fcd6941-485a-4beb-ae44-7ad23b8fa033 req-9ecb869a-a451-4b37-b450-4723461de77c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:00.815152 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3fcd6941-485a-4beb-ae44-7ad23b8fa033 req-9ecb869a-a451-4b37-b450-4723461de77c service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0700a96e9b3f48e8b6bcdd75b820b813&device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 1098 time: 0.0376835 Sep 18 08:48:00.905129 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fcd6941-485a-4beb-ae44-7ad23b8fa033 req-fc965ef1-5e7f-4f3a-875d-f3c5e99f6f83 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:00.906557 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3fcd6941-485a-4beb-ae44-7ad23b8fa033 req-fc965ef1-5e7f-4f3a-875d-f3c5e99f6f83 service neutron] 10.222.0.13 "GET /v2.0/networks?id=f430397d-03a8-4da2-bd1d-25890a3a0727 HTTP/1.1" status: 200 len: 917 time: 0.0842056 Sep 18 08:48:00.969845 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3fcd6941-485a-4beb-ae44-7ad23b8fa033 req-5fc4608c-68fe-4225-b9b6-f410c5bcc48d service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=fb17b7f6-af82-4371-b33a-e2a9b265ea42 HTTP/1.1" status: 200 len: 1001 time: 0.0553181 Sep 18 08:48:01.021298 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fcd6941-485a-4beb-ae44-7ad23b8fa033 req-367df20f-f1a3-4b99-97fe-7c0c33a46438 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:01.022725 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3fcd6941-485a-4beb-ae44-7ad23b8fa033 req-367df20f-f1a3-4b99-97fe-7c0c33a46438 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=acdeb8a1-5de9-425f-ae0a-890d310246e9 HTTP/1.1" status: 200 len: 855 time: 0.0452797 Sep 18 08:48:01.066205 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fcd6941-485a-4beb-ae44-7ad23b8fa033 req-80bb95e3-8744-4ba1-962d-2b27f3a9f297 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:01.067690 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3fcd6941-485a-4beb-ae44-7ad23b8fa033 req-80bb95e3-8744-4ba1-962d-2b27f3a9f297 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=f430397d-03a8-4da2-bd1d-25890a3a0727&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0371473 Sep 18 08:48:01.156328 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3fcd6941-485a-4beb-ae44-7ad23b8fa033 req-b6abd9a0-6d05-4a50-afc1-24953117e7f6 service neutron] 10.222.0.13 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0784831 Sep 18 08:48:01.245534 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3fcd6941-485a-4beb-ae44-7ad23b8fa033 req-f8c763cf-59a6-48c5-80db-ec9a98deac1c service neutron] 10.222.0.13 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0815158 Sep 18 08:48:01.828056 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1090d15c-25ea-4082-9edb-d50c678a7eb1 req-6d1eea70-43e7-440d-b4ee-b2563346f02d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:01.829441 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1090d15c-25ea-4082-9edb-d50c678a7eb1 req-6d1eea70-43e7-440d-b4ee-b2563346f02d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0468128 Sep 18 08:48:01.864858 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1090d15c-25ea-4082-9edb-d50c678a7eb1 req-70510147-b655-4c41-8606-cec8a7639e11 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0296962 Sep 18 08:48:02.979837 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3757ed89-8fc9-4d1e-bb50-a74c92d7ac88 req-9063971c-672e-468d-9b62-ed728aeb8813 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:02.981326 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3757ed89-8fc9-4d1e-bb50-a74c92d7ac88 req-9063971c-672e-468d-9b62-ed728aeb8813 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0474050 Sep 18 08:48:03.021432 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3757ed89-8fc9-4d1e-bb50-a74c92d7ac88 req-6ef9b276-1242-4352-8e5d-babc6ca9bbae tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0342758 Sep 18 08:48:04.054712 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device fb17b7f6-af82-4371-b33a-e2a9b265ea42 no longer exists at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:48:04.129972 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:04.139910 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9896cebd-7e79-424e-875e-f1486d24c26d req-d375217f-ea16-4c48-95cc-9c5a2b5d268e tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:04.141000 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9896cebd-7e79-424e-875e-f1486d24c26d req-d375217f-ea16-4c48-95cc-9c5a2b5d268e tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 945 time: 0.0474136 Sep 18 08:48:04.152508 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a40b16b8-10f1-416c-933c-1f01dd483851', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'fb17b7f6-af82-4371-b33a-e2a9b265ea42'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:48:04.154721 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a8aae454-4001-4189-936e-fd432b22ecbd" -d '{"events": [{"server_uuid": "a40b16b8-10f1-416c-933c-1f01dd483851", "name": "network-vif-unplugged", "status": "completed", "tag": "fb17b7f6-af82-4371-b33a-e2a9b265ea42"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:48:04.167733 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port fb17b7f6-af82-4371-b33a-e2a9b265ea42, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=fb17b7f6-af82-4371-b33a-e2a9b265ea42,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:48:04.173144 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:04.183901 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9896cebd-7e79-424e-875e-f1486d24c26d req-97e01e11-213d-4ed1-8a43-778df1ec06e6 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0368993 Sep 18 08:48:04.195552 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Sat, 18 Sep 2021 08:48:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d1ecff10-15ba-4a3c-8c3e-d2b8b2c3ac5d x-openstack-request-id: req-d1ecff10-15ba-4a3c-8c3e-d2b8b2c3ac5d {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:48:04.195845 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a40b16b8-10f1-416c-933c-1f01dd483851", "name": "network-vif-unplugged", "status": "failed", "tag": "fb17b7f6-af82-4371-b33a-e2a9b265ea42", "code": 422}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:48:04.196098 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-d1ecff10-15ba-4a3c-8c3e-d2b8b2c3ac5d {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:48:04.196504 dv-cinder-804470-6-iscsi neutron-server[94348]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'a40b16b8-10f1-416c-933c-1f01dd483851', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'fb17b7f6-af82-4371-b33a-e2a9b265ea42', 'code': 422} returned with failed status Sep 18 08:48:04.229813 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=fb17b7f6-af82-4371-b33a-e2a9b265ea42,revision_number=8']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:48:04.939778 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [req-9a2da30f-01f8-4f01-9b5a-e7797b957849 req-b1936bba-7c35-4e06-b3a4-8a03350410c8 service neutron] http://10.222.0.35:9696/v2.0/extensions returned with HTTP 200 {{(pid=94347) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 18 08:48:04.940774 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9a2da30f-01f8-4f01-9b5a-e7797b957849 req-b1936bba-7c35-4e06-b3a4-8a03350410c8 service neutron] 10.222.0.35 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0054264 Sep 18 08:48:05.090219 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1109c4a2-1b9d-44cc-b391-a8b77bb9fa0b req-1f7812ab-d70b-4c77-a707-29e15492a377 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:05.091740 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1109c4a2-1b9d-44cc-b391-a8b77bb9fa0b req-1f7812ab-d70b-4c77-a707-29e15492a377 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 943 time: 0.0483351 Sep 18 08:48:05.136288 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1109c4a2-1b9d-44cc-b391-a8b77bb9fa0b req-246a7a65-4965-42cf-bd32-67546a3e7ce3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0380170 Sep 18 08:48:05.360424 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [req-bfff480b-5bf5-41d4-868c-77ccc1d49a97 req-a8d99610-e0b6-4473-9f78-a0746832075b service neutron] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1256382 Sep 18 08:48:06.157647 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfff480b-5bf5-41d4-868c-77ccc1d49a97 req-d2700309-8520-4083-8958-9cacc9a54f31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:06.159564 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bfff480b-5bf5-41d4-868c-77ccc1d49a97 req-d2700309-8520-4083-8958-9cacc9a54f31 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851&tenant_id=0700a96e9b3f48e8b6bcdd75b820b813 HTTP/1.1" status: 200 len: 1096 time: 0.0392227 Sep 18 08:48:06.238270 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfff480b-5bf5-41d4-868c-77ccc1d49a97 req-31a6a949-18dc-4f36-98fa-85d9b57b4ead service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:06.239766 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bfff480b-5bf5-41d4-868c-77ccc1d49a97 req-31a6a949-18dc-4f36-98fa-85d9b57b4ead service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0700a96e9b3f48e8b6bcdd75b820b813&device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 1096 time: 0.0461550 Sep 18 08:48:06.363892 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa42af7f-8f55-4dba-b47a-16c8af5876cd req-7e1bad75-e30c-4454-8c91-0b8546dd3034 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:06.365365 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-aa42af7f-8f55-4dba-b47a-16c8af5876cd req-7e1bad75-e30c-4454-8c91-0b8546dd3034 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 943 time: 0.1459584 Sep 18 08:48:06.366672 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfff480b-5bf5-41d4-868c-77ccc1d49a97 req-04529a88-e201-44e7-81a2-a379818f47d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:06.367969 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bfff480b-5bf5-41d4-868c-77ccc1d49a97 req-04529a88-e201-44e7-81a2-a379818f47d1 service neutron] 10.222.0.13 "GET /v2.0/networks?id=f430397d-03a8-4da2-bd1d-25890a3a0727 HTTP/1.1" status: 200 len: 917 time: 0.1211228 Sep 18 08:48:06.690855 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-aa42af7f-8f55-4dba-b47a-16c8af5876cd req-3e0ba343-e3a4-44bd-be76-654e25099a73 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3191128 Sep 18 08:48:06.703077 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bfff480b-5bf5-41d4-868c-77ccc1d49a97 req-fb26f9d8-447d-4c15-8d2a-20684505b35b service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=fb17b7f6-af82-4371-b33a-e2a9b265ea42 HTTP/1.1" status: 200 len: 999 time: 0.3258090 Sep 18 08:48:06.751980 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfff480b-5bf5-41d4-868c-77ccc1d49a97 req-96d0bc02-180a-42cc-a8f5-532e4f6d7de1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:06.753387 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bfff480b-5bf5-41d4-868c-77ccc1d49a97 req-96d0bc02-180a-42cc-a8f5-532e4f6d7de1 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=acdeb8a1-5de9-425f-ae0a-890d310246e9 HTTP/1.1" status: 200 len: 855 time: 0.0431759 Sep 18 08:48:06.798486 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfff480b-5bf5-41d4-868c-77ccc1d49a97 req-9e528bcb-af58-4dff-89a9-704201b968de service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:06.799887 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bfff480b-5bf5-41d4-868c-77ccc1d49a97 req-9e528bcb-af58-4dff-89a9-704201b968de service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=f430397d-03a8-4da2-bd1d-25890a3a0727&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0398681 Sep 18 08:48:06.885684 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bfff480b-5bf5-41d4-868c-77ccc1d49a97 req-8a90eb0f-9fd9-412b-8e7d-80660900058e service neutron] 10.222.0.13 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0789738 Sep 18 08:48:06.976156 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bfff480b-5bf5-41d4-868c-77ccc1d49a97 req-bc3c03f2-1dd8-4163-bb1a-36eb951d8454 service neutron] 10.222.0.13 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0829115 Sep 18 08:48:07.817997 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95c2a27e-f5bb-46fd-a01f-c2e22004f0f9 req-964a7304-6b72-4904-82fd-a3bcc052e836 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:07.819481 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-95c2a27e-f5bb-46fd-a01f-c2e22004f0f9 req-964a7304-6b72-4904-82fd-a3bcc052e836 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 943 time: 0.0483022 Sep 18 08:48:07.859003 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-95c2a27e-f5bb-46fd-a01f-c2e22004f0f9 req-34b8bc22-beda-4ffb-970d-547f465a2f3c tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0335543 Sep 18 08:48:08.085653 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device fb17b7f6-af82-4371-b33a-e2a9b265ea42 no longer exists at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:48:08.985410 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a91abbf1-8ba5-4dc3-80e2-87d1d0b23258 req-c8d0dc77-a115-4932-8d26-4bcb8bf19daa tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:08.986928 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a91abbf1-8ba5-4dc3-80e2-87d1d0b23258 req-c8d0dc77-a115-4932-8d26-4bcb8bf19daa tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 943 time: 0.0479069 Sep 18 08:48:09.028648 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a91abbf1-8ba5-4dc3-80e2-87d1d0b23258 req-070dca35-70e4-4db5-bc80-cebc5bfceffa tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0357015 Sep 18 08:48:10.204848 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4e1bbc3-bdac-4769-925a-996e8dacf9e3 req-61469025-a24c-4012-a0d6-cad4731764d9 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:10.206348 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b4e1bbc3-bdac-4769-925a-996e8dacf9e3 req-61469025-a24c-4012-a0d6-cad4731764d9 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 943 time: 0.1039250 Sep 18 08:48:10.244808 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b4e1bbc3-bdac-4769-925a-996e8dacf9e3 req-a43b81c1-8f16-472c-a9fc-bbdfd2dbd6b9 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0324221 Sep 18 08:48:11.363002 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8c5ae9a-62b0-4a75-80c8-6350b6b642fb req-3e3ec927-d68b-4c3b-ad33-27f1019e65a5 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:11.364462 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8c5ae9a-62b0-4a75-80c8-6350b6b642fb req-3e3ec927-d68b-4c3b-ad33-27f1019e65a5 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 943 time: 0.0471344 Sep 18 08:48:11.400386 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d8c5ae9a-62b0-4a75-80c8-6350b6b642fb req-709b612a-2b30-4816-ab1e-92fd30520b1d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0301111 Sep 18 08:48:12.521257 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d9ab423-fbf5-41d8-8504-40d9bcedafdd req-8a94b79e-2b1b-4895-a65b-f33542a3edbb tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:12.522719 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4d9ab423-fbf5-41d8-8504-40d9bcedafdd req-8a94b79e-2b1b-4895-a65b-f33542a3edbb tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 943 time: 0.0469704 Sep 18 08:48:12.569731 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4d9ab423-fbf5-41d8-8504-40d9bcedafdd req-430b182a-19b1-40c5-8846-547d371dfc9f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411012 Sep 18 08:48:13.688565 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a598c5a7-d035-4cb7-a8c0-33ae4b37f0d0 req-1952e227-1b2f-4a2c-ab45-04f4b50a595d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:13.690141 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a598c5a7-d035-4cb7-a8c0-33ae4b37f0d0 req-1952e227-1b2f-4a2c-ab45-04f4b50a595d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 943 time: 0.0487497 Sep 18 08:48:13.728682 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a598c5a7-d035-4cb7-a8c0-33ae4b37f0d0 req-18ec61eb-00be-4f9c-8c60-b42fd8719095 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0326033 Sep 18 08:48:15.003748 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d14a373b-826e-4220-a7b5-d22cfd271cad req-a0a37f99-1986-4d8a-9ff2-4d7865d2b226 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:15.008651 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d14a373b-826e-4220-a7b5-d22cfd271cad req-a0a37f99-1986-4d8a-9ff2-4d7865d2b226 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 943 time: 0.0729790 Sep 18 08:48:15.044920 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d14a373b-826e-4220-a7b5-d22cfd271cad req-6ddeccc7-0537-4b1e-aa95-2c89277e3c9d tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0354428 Sep 18 08:48:16.160612 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c4202e6-877c-4e27-b648-15d9af291866 req-64ea680a-79a3-421d-8c08-4b4f81303c8f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:16.162178 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1c4202e6-877c-4e27-b648-15d9af291866 req-64ea680a-79a3-421d-8c08-4b4f81303c8f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 943 time: 0.0474362 Sep 18 08:48:16.202979 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1c4202e6-877c-4e27-b648-15d9af291866 req-e6520a48-c36d-4468-8ffd-ae8bc2da1f5e tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0349956 Sep 18 08:48:17.335408 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45dcdcfb-f508-49f7-9060-b9d486cefe31 req-f44b4630-e6f1-4dba-bc3a-5c791b4a6795 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:17.336887 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-45dcdcfb-f508-49f7-9060-b9d486cefe31 req-f44b4630-e6f1-4dba-bc3a-5c791b4a6795 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 943 time: 0.0476105 Sep 18 08:48:17.373928 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-45dcdcfb-f508-49f7-9060-b9d486cefe31 req-3072b884-7cbb-4e5d-94fb-b52d8653d224 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0311682 Sep 18 08:48:18.488791 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5708ec6f-5db5-476b-bdfd-e444c708ecf9 req-94842420-0f5d-47ce-90c8-94c166b2a09b tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:18.490279 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5708ec6f-5db5-476b-bdfd-e444c708ecf9 req-94842420-0f5d-47ce-90c8-94c166b2a09b tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 943 time: 0.0471189 Sep 18 08:48:18.526774 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5708ec6f-5db5-476b-bdfd-e444c708ecf9 req-398e1992-b554-456b-8a0c-eac4623ace23 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0308464 Sep 18 08:48:19.622850 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-faf54138-3826-4f33-9f55-b84e56264af3 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:19.643273 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2d7eead-cb82-4325-ac37-a248c5e2a6ce req-7a8cb748-77f8-4418-b770-c98d06b93d4a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:19.644761 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a2d7eead-cb82-4325-ac37-a248c5e2a6ce req-7a8cb748-77f8-4418-b770-c98d06b93d4a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 943 time: 0.0489845 Sep 18 08:48:19.685231 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a2d7eead-cb82-4325-ac37-a248c5e2a6ce req-bf3cdfcf-80f3-41da-bb72-b59ffc507bdd tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0344718 Sep 18 08:48:20.105739 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:20.798873 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6bdfc98-b0ea-45a5-be88-20c68e3e536b req-bcd1bc8f-f920-404d-b8bf-2d27ec4c6244 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:20.800317 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c6bdfc98-b0ea-45a5-be88-20c68e3e536b req-bcd1bc8f-f920-404d-b8bf-2d27ec4c6244 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 943 time: 0.0468855 Sep 18 08:48:20.836215 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c6bdfc98-b0ea-45a5-be88-20c68e3e536b req-7619ed99-57fb-461f-a480-a8f5f9dc0762 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0301547 Sep 18 08:48:21.952325 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2529e591-f802-4c2a-95d2-7f0c6f23e95a req-18a10810-4307-405a-8501-46a0c218aeac tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:21.954117 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2529e591-f802-4c2a-95d2-7f0c6f23e95a req-18a10810-4307-405a-8501-46a0c218aeac tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 943 time: 0.0487511 Sep 18 08:48:21.990290 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2529e591-f802-4c2a-95d2-7f0c6f23e95a req-2a202243-4a7a-4339-ae4c-0c12ba8169b9 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0304215 Sep 18 08:48:22.402493 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-64016109-3574-47d8-bdf9-0e8b74818bb2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:23.106372 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af2b5379-db75-472d-910a-8c66525ced09 req-3127d8e7-ead3-4184-b8f8-174e30e3c58a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:23.107842 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-af2b5379-db75-472d-910a-8c66525ced09 req-3127d8e7-ead3-4184-b8f8-174e30e3c58a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 943 time: 0.0478141 Sep 18 08:48:23.147721 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-af2b5379-db75-472d-910a-8c66525ced09 req-03ac5ddb-ff56-4114-bb01-c94584427b38 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0341139 Sep 18 08:48:23.219451 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:23.370583 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:23.476959 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bde00e0-6288-440e-b3aa-a3c24da3d61a req-cbfb4f3d-4810-4133-b6de-0417975b1e76 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:23.478559 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1bde00e0-6288-440e-b3aa-a3c24da3d61a req-cbfb4f3d-4810-4133-b6de-0417975b1e76 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0700a96e9b3f48e8b6bcdd75b820b813&device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 1096 time: 0.0411122 Sep 18 08:48:23.590491 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bde00e0-6288-440e-b3aa-a3c24da3d61a req-a4ad65d9-f012-47db-8df2-62f79bbf888c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:23.591971 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1bde00e0-6288-440e-b3aa-a3c24da3d61a req-a4ad65d9-f012-47db-8df2-62f79bbf888c service neutron] 10.222.0.13 "GET /v2.0/networks?id=f430397d-03a8-4da2-bd1d-25890a3a0727 HTTP/1.1" status: 200 len: 917 time: 0.0900021 Sep 18 08:48:23.659129 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1bde00e0-6288-440e-b3aa-a3c24da3d61a req-08adcbdf-db03-4732-aebb-768c40fdb080 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=fb17b7f6-af82-4371-b33a-e2a9b265ea42 HTTP/1.1" status: 200 len: 999 time: 0.0594702 Sep 18 08:48:23.706207 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bde00e0-6288-440e-b3aa-a3c24da3d61a req-38a0dfdc-649f-4689-9066-c701ee620e9d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:23.707689 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1bde00e0-6288-440e-b3aa-a3c24da3d61a req-38a0dfdc-649f-4689-9066-c701ee620e9d service neutron] 10.222.0.13 "GET /v2.0/subnets?id=acdeb8a1-5de9-425f-ae0a-890d310246e9 HTTP/1.1" status: 200 len: 855 time: 0.0418775 Sep 18 08:48:23.750141 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bde00e0-6288-440e-b3aa-a3c24da3d61a req-87d9c6cf-82f9-4b41-b78e-221fc04580bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:23.751570 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1bde00e0-6288-440e-b3aa-a3c24da3d61a req-87d9c6cf-82f9-4b41-b78e-221fc04580bd service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=f430397d-03a8-4da2-bd1d-25890a3a0727&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0370336 Sep 18 08:48:23.840715 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1bde00e0-6288-440e-b3aa-a3c24da3d61a req-7ef57141-8da9-441f-80cd-faccced5a7dd service neutron] 10.222.0.13 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0820789 Sep 18 08:48:23.926518 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1bde00e0-6288-440e-b3aa-a3c24da3d61a req-6cf61c1f-8f23-4033-826b-ecd0f1daf236 service neutron] 10.222.0.13 "GET /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0790763 Sep 18 08:48:24.194544 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device fb17b7f6-af82-4371-b33a-e2a9b265ea42 details requested by agent hyperv_hv-cinder-80447 with host hv-cinder-80447 {{(pid=94348) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 18 08:48:24.267809 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a061857-dd9e-4db2-8535-cb3e9581ab83 req-2789b9a7-8dd0-4f8b-96d5-8d8cb7e9cff3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:24.269350 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5a061857-dd9e-4db2-8535-cb3e9581ab83 req-2789b9a7-8dd0-4f8b-96d5-8d8cb7e9cff3 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 943 time: 0.0517359 Sep 18 08:48:24.288390 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port fb17b7f6-af82-4371-b33a-e2a9b265ea42, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=fb17b7f6-af82-4371-b33a-e2a9b265ea42,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:48:24.299457 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Returning: {'device': 'fb17b7f6-af82-4371-b33a-e2a9b265ea42', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'port_id': 'fb17b7f6-af82-4371-b33a-e2a9b265ea42', 'mac_address': 'fa:16:3e:21:d8:84', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 214, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94348) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 18 08:48:24.306833 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5a061857-dd9e-4db2-8535-cb3e9581ab83 req-10a3ed21-9a34-4e18-8225-25b11dc6f688 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0315182 Sep 18 08:48:24.334618 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:24.347354 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fb17b7f6-af82-4371-b33a-e2a9b265ea42 {{(pid=94348) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:48:24.366940 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port fb17b7f6-af82-4371-b33a-e2a9b265ea42, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=fb17b7f6-af82-4371-b33a-e2a9b265ea42,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:48:24.370961 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:24.418883 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=fb17b7f6-af82-4371-b33a-e2a9b265ea42,revision_number=9']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:48:24.798747 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['fb17b7f6-af82-4371-b33a-e2a9b265ea42'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:48:24.898064 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:25.421506 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29559ad8-aaaa-44a5-9ce7-2537073cdcec req-f78b9ebc-3583-44d0-bde1-77ba53fef462 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:25.423000 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-29559ad8-aaaa-44a5-9ce7-2537073cdcec req-f78b9ebc-3583-44d0-bde1-77ba53fef462 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 944 time: 0.0465298 Sep 18 08:48:25.459143 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-29559ad8-aaaa-44a5-9ce7-2537073cdcec req-9a234e7c-d3bf-4df0-b230-eb137c28f7fb tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0304410 Sep 18 08:48:26.209265 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device fb17b7f6-af82-4371-b33a-e2a9b265ea42 up at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:48:26.254988 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning complete for port fb17b7f6-af82-4371-b33a-e2a9b265ea42 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:48:26.255358 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:26.330304 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:26.352298 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a40b16b8-10f1-416c-933c-1f01dd483851', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fb17b7f6-af82-4371-b33a-e2a9b265ea42'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:48:26.354578 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-267f3d72-c143-4bb9-8e59-28d8718994be" -d '{"events": [{"server_uuid": "a40b16b8-10f1-416c-933c-1f01dd483851", "name": "network-vif-plugged", "status": "completed", "tag": "fb17b7f6-af82-4371-b33a-e2a9b265ea42"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:48:26.367938 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port fb17b7f6-af82-4371-b33a-e2a9b265ea42, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=fb17b7f6-af82-4371-b33a-e2a9b265ea42,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:48:26.372785 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:26.394844 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:48:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6837fc14-058a-4287-a164-8fe841fab77a x-openstack-request-id: req-6837fc14-058a-4287-a164-8fe841fab77a {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:48:26.395144 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a40b16b8-10f1-416c-933c-1f01dd483851", "name": "network-vif-plugged", "status": "completed", "tag": "fb17b7f6-af82-4371-b33a-e2a9b265ea42", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:48:26.395394 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-6837fc14-058a-4287-a164-8fe841fab77a {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:48:26.395776 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a40b16b8-10f1-416c-933c-1f01dd483851', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fb17b7f6-af82-4371-b33a-e2a9b265ea42', 'code': 200} Sep 18 08:48:26.420592 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=fb17b7f6-af82-4371-b33a-e2a9b265ea42,revision_number=10']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:48:26.577878 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1268cd58-ca64-4d6b-b35d-bf3db19e821e req-5ed113a9-d9bb-4732-9b49-a0c3fd1042ca tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:26.579381 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1268cd58-ca64-4d6b-b35d-bf3db19e821e req-5ed113a9-d9bb-4732-9b49-a0c3fd1042ca tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 946 time: 0.0480142 Sep 18 08:48:26.642368 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56ee3c00-ce28-4b56-ac60-f246e668ab75 req-e2da26b4-8c08-4933-b931-11026f0b88d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:26.643784 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-56ee3c00-ce28-4b56-ac60-f246e668ab75 req-e2da26b4-8c08-4933-b931-11026f0b88d3 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 1099 time: 0.0635505 Sep 18 08:48:26.646585 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1268cd58-ca64-4d6b-b35d-bf3db19e821e req-b41ffaa3-b3e5-434a-9f55-95de78efd73e tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0594141 Sep 18 08:48:26.678437 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-56ee3c00-ce28-4b56-ac60-f246e668ab75 req-9c21418d-8bde-4a99-9351-fc1c83682056 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0277872 Sep 18 08:48:27.763490 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8515ec81-ea22-4eaa-8e71-9a814ffe1109 req-da910329-9dcc-4a28-a381-6fdadcbf4db0 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:27.764961 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8515ec81-ea22-4eaa-8e71-9a814ffe1109 req-da910329-9dcc-4a28-a381-6fdadcbf4db0 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 946 time: 0.0473237 Sep 18 08:48:27.801167 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8515ec81-ea22-4eaa-8e71-9a814ffe1109 req-ecff288f-5d0d-49af-ad84-37d9509abd22 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0304430 Sep 18 08:48:28.914513 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0268254-e51a-497d-9b1b-9f1431ddc453 req-bec85c22-6e48-42d1-8ac3-3b89364a4b50 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:28.916010 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f0268254-e51a-497d-9b1b-9f1431ddc453 req-bec85c22-6e48-42d1-8ac3-3b89364a4b50 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 946 time: 0.0471320 Sep 18 08:48:28.952648 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f0268254-e51a-497d-9b1b-9f1431ddc453 req-5f3cee89-c7dd-47d1-854e-a6f3706c4bc5 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0308492 Sep 18 08:48:34.703110 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:48:49.622362 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-87e74203-9570-4641-b83b-5c6532193a7a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:50.106449 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:52.405268 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-28a2b7eb-d4ae-47a2-901c-2f39bfb270b8 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:53.228707 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:53.372658 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:54.222381 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-a80938a7-c841-4b45-9bc3-f96538758ddc tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-143517560&fields=id&tenant_id=0c7c58787ad549afa94b716f4c2f187b HTTP/1.1" status: 200 len: 267 time: 0.0353954 Sep 18 08:48:54.324911 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-1641feca-32f4-4fa1-95ca-a5d54f23657e tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:54.326427 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-1641feca-32f4-4fa1-95ca-a5d54f23657e tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/networks?id=000f3583-b7de-458d-9146-0010cd28b00d HTTP/1.1" status: 200 len: 812 time: 0.0976131 Sep 18 08:48:54.340752 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-d1ee068f-2f2a-4fbc-bf01-fe4795ff7401 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/quotas/0c7c58787ad549afa94b716f4c2f187b HTTP/1.1" status: 200 len: 375 time: 0.0088766 Sep 18 08:48:54.395685 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-59c30c7a-8789-4c63-a938-21e0eb34b03b tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?tenant_id=0c7c58787ad549afa94b716f4c2f187b&fields=id HTTP/1.1" status: 200 len: 440 time: 0.0495033 Sep 18 08:48:54.410703 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-1e62e92e-9943-4b06-9b2a-c619d31ed037 service neutron] http://10.222.0.35:9696/v2.0/extensions returned with HTTP 200 {{(pid=94347) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 18 08:48:54.411767 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-1e62e92e-9943-4b06-9b2a-c619d31ed037 service neutron] 10.222.0.35 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0050435 Sep 18 08:48:54.501958 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-0fae8aae-2a1b-4fea-a18d-67627ba87b40 service neutron] 10.222.0.35 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0847867 Sep 18 08:48:54.593809 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-5b0ad541-a7c2-4bc4-b19f-144a6acd3c75 service neutron] 10.222.0.35 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0858111 Sep 18 08:48:54.861306 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ebb321dd-4dbe-46ed-ae29-d059037eb17f req-e5fff3b9-c106-40d4-af5d-3bcc6292d319 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 210 time: 0.0250335 Sep 18 08:48:54.891844 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:55.837734 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-058ed033-40a2-4a57-91f8-37f63b66ddec tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:55.839226 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-058ed033-40a2-4a57-91f8-37f63b66ddec tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.13 "GET /v2.0/networks?id=000f3583-b7de-458d-9146-0010cd28b00d HTTP/1.1" status: 200 len: 812 time: 0.1051655 Sep 18 08:48:55.887979 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-3621bd4f-6bde-433c-84b9-777b1dc298fc tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.13 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=0c7c58787ad549afa94b716f4c2f187b HTTP/1.1" status: 200 len: 379 time: 0.0340905 Sep 18 08:48:55.912785 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-01f220eb-5872-41a4-a6ee-c11cb6d1ccce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Request body: {'port': {'device_id': '5cd061b1-4698-4997-bbd8-942ec6f21bcd', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'admin_state_up': True, 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'security_groups': ['c480fa62-0ee8-4f20-8da2-07bbb721cd7c']}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:48:55.968494 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c6339cf7-b02b-4bc6-8e4f-1b2fb5b75d82 req-6e876da5-822f-43eb-b60e-01b1e35fb152 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 210 time: 0.0333741 Sep 18 08:48:56.045292 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-01f220eb-5872-41a4-a6ee-c11cb6d1ccce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Made reservation on behalf of 0c7c58787ad549afa94b716f4c2f187b for: {'port': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:48:56.048910 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-01f220eb-5872-41a4-a6ee-c11cb6d1ccce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:56.171827 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_common [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-01f220eb-5872-41a4-a6ee-c11cb6d1ccce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Allocated IP 172.20.0.11 (000f3583-b7de-458d-9146-0010cd28b00d/a4c047cf-cba6-4b94-8339-59469f96c92a/7ef8778e-5f0c-468d-903e-2a37683f22bf) {{(pid=94347) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:48:56.303304 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-01f220eb-5872-41a4-a6ee-c11cb6d1ccce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for port, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:56.341020 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-01f220eb-5872-41a4-a6ee-c11cb6d1ccce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:56.382740 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-01f220eb-5872-41a4-a6ee-c11cb6d1ccce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Network 000f3583-b7de-458d-9146-0010cd28b00d is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:48:56.385806 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-01f220eb-5872-41a4-a6ee-c11cb6d1ccce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:48:56.392124 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-01f220eb-5872-41a4-a6ee-c11cb6d1ccce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Received port after_create {{(pid=94347) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:48:56.416355 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01f220eb-5872-41a4-a6ee-c11cb6d1ccce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Pushing event updated for resources: {'Port': ['ID=7ef8778e-5f0c-468d-903e-2a37683f22bf,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:48:56.431124 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01f220eb-5872-41a4-a6ee-c11cb6d1ccce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:48:56.431473 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01f220eb-5872-41a4-a6ee-c11cb6d1ccce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:48:56.431824 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01f220eb-5872-41a4-a6ee-c11cb6d1ccce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:48:56.432157 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01f220eb-5872-41a4-a6ee-c11cb6d1ccce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:48:56.432487 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01f220eb-5872-41a4-a6ee-c11cb6d1ccce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:48:56.432818 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01f220eb-5872-41a4-a6ee-c11cb6d1ccce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:48:56.433279 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01f220eb-5872-41a4-a6ee-c11cb6d1ccce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:48:56.433493 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01f220eb-5872-41a4-a6ee-c11cb6d1ccce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:48:56.433826 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01f220eb-5872-41a4-a6ee-c11cb6d1ccce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:48:56.434147 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01f220eb-5872-41a4-a6ee-c11cb6d1ccce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:48:56.434467 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01f220eb-5872-41a4-a6ee-c11cb6d1ccce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:48:56.434786 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-01f220eb-5872-41a4-a6ee-c11cb6d1ccce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:48:56.456153 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-01f220eb-5872-41a4-a6ee-c11cb6d1ccce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:56.456800 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-01f220eb-5872-41a4-a6ee-c11cb6d1ccce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:56.481704 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-01f220eb-5872-41a4-a6ee-c11cb6d1ccce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5726829 Sep 18 08:48:56.503673 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-404b6313-ac85-4a4e-ba2b-3bd91a58a139 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] http://10.222.0.35:9696/v2.0/extensions returned with HTTP 200 {{(pid=94347) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 18 08:48:56.505024 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-404b6313-ac85-4a4e-ba2b-3bd91a58a139 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.13 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0055370 Sep 18 08:48:56.534212 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-b00a012c-2f70-47ac-8080-0dd0e8cb4087 service neutron] Request body: {'port': {'device_id': '5cd061b1-4698-4997-bbd8-942ec6f21bcd', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80447'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:48:56.593807 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-b00a012c-2f70-47ac-8080-0dd0e8cb4087 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:56.677999 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-9e4d2d8b-7cf9-4b61-9191-3c1ec65de51f None None] Provisioning complete for port 7ef8778e-5f0c-468d-903e-2a37683f22bf triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:48:56.678565 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-9e4d2d8b-7cf9-4b61-9191-3c1ec65de51f None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:56.711503 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-9e4d2d8b-7cf9-4b61-9191-3c1ec65de51f None None] Port 7ef8778e-5f0c-468d-903e-2a37683f22bf cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:48:56.847366 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-b00a012c-2f70-47ac-8080-0dd0e8cb4087 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7ef8778e-5f0c-468d-903e-2a37683f22bf {{(pid=94347) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:48:56.854528 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-b00a012c-2f70-47ac-8080-0dd0e8cb4087 service neutron] Notify callbacks [] for port, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:56.866170 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.provisioning_blocks [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-b00a012c-2f70-47ac-8080-0dd0e8cb4087 service neutron] Transition to ACTIVE for port object 7ef8778e-5f0c-468d-903e-2a37683f22bf will not be triggered until provisioned by entity L2. {{(pid=94347) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 18 08:48:56.869967 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-b00a012c-2f70-47ac-8080-0dd0e8cb4087 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:56.917779 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b00a012c-2f70-47ac-8080-0dd0e8cb4087 service neutron] Pushing event updated for resources: {'Port': ['ID=7ef8778e-5f0c-468d-903e-2a37683f22bf,revision_number=2']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:48:56.987539 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-b00a012c-2f70-47ac-8080-0dd0e8cb4087 service neutron] Attempting to bind port 7ef8778e-5f0c-468d-903e-2a37683f22bf on host hv-cinder-80447 for vnic_type normal with profile {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:48:56.987866 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-b00a012c-2f70-47ac-8080-0dd0e8cb4087 service neutron] Attempting to bind port 7ef8778e-5f0c-468d-903e-2a37683f22bf by drivers openvswitch,hyperv on host hv-cinder-80447 at level 0 using segments [{'id': 'c215153d-2878-4c82-8dc0-2a92b453bf12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 200, 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d'}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:48:56.988204 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-b00a012c-2f70-47ac-8080-0dd0e8cb4087 service neutron] Attempting to bind port 7ef8778e-5f0c-468d-903e-2a37683f22bf on network 000f3583-b7de-458d-9146-0010cd28b00d {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:48:56.996169 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-b00a012c-2f70-47ac-8080-0dd0e8cb4087 service neutron] Port 7ef8778e-5f0c-468d-903e-2a37683f22bf on network 000f3583-b7de-458d-9146-0010cd28b00d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80447 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 18 08:48:57.001084 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-b00a012c-2f70-47ac-8080-0dd0e8cb4087 service neutron] Attempting to bind port 7ef8778e-5f0c-468d-903e-2a37683f22bf on network 000f3583-b7de-458d-9146-0010cd28b00d {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:48:57.003376 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-b00a012c-2f70-47ac-8080-0dd0e8cb4087 service neutron] Checking agent: {'id': '8d51fdc4-974b-4200-9c3f-5dddea60a869', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80447', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'started_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 48, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:48:57.003667 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-b00a012c-2f70-47ac-8080-0dd0e8cb4087 service neutron] Checking segment: {'id': 'c215153d-2878-4c82-8dc0-2a92b453bf12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 200, 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94347) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:48:57.004074 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-b00a012c-2f70-47ac-8080-0dd0e8cb4087 service neutron] Bound using segment: {'id': 'c215153d-2878-4c82-8dc0-2a92b453bf12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 200, 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d'} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:48:57.004473 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-b00a012c-2f70-47ac-8080-0dd0e8cb4087 service neutron] Bound port: 7ef8778e-5f0c-468d-903e-2a37683f22bf, host: hv-cinder-80447, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c215153d-2878-4c82-8dc0-2a92b453bf12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 200, 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d'}}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:48:57.004848 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-b00a012c-2f70-47ac-8080-0dd0e8cb4087 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:57.101859 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-b00a012c-2f70-47ac-8080-0dd0e8cb4087 service neutron] For port 7ef8778e-5f0c-468d-903e-2a37683f22bf, host hv-cinder-80447, cleared binding levels {{(pid=94347) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:48:57.107386 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-b00a012c-2f70-47ac-8080-0dd0e8cb4087 service neutron] For port 7ef8778e-5f0c-468d-903e-2a37683f22bf, host hv-cinder-80447, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=7ef8778e-5f0c-468d-903e-2a37683f22bf,segment=NetworkSegment(c215153d-2878-4c82-8dc0-2a92b453bf12),segment_id=c215153d-2878-4c82-8dc0-2a92b453bf12)] {{(pid=94347) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:48:57.112740 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-b00a012c-2f70-47ac-8080-0dd0e8cb4087 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:57.127560 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a956a992-35b1-48aa-a78f-7719cbbc36b0 req-6d69e2aa-1a5f-429e-96c7-4c16c59e6eed tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:57.129055 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a956a992-35b1-48aa-a78f-7719cbbc36b0 req-6d69e2aa-1a5f-429e-96c7-4c16c59e6eed tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 944 time: 0.0859215 Sep 18 08:48:57.166115 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-b00a012c-2f70-47ac-8080-0dd0e8cb4087 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:57.166670 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-b00a012c-2f70-47ac-8080-0dd0e8cb4087 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:48:57.168031 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-b00a012c-2f70-47ac-8080-0dd0e8cb4087 service neutron] 10.222.0.13 "PUT /v2.0/ports/7ef8778e-5f0c-468d-903e-2a37683f22bf HTTP/1.1" status: 200 len: 1094 time: 0.6382630 Sep 18 08:48:57.168507 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5cd061b1-4698-4997-bbd8-942ec6f21bcd', 'tag': '7ef8778e-5f0c-468d-903e-2a37683f22bf'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:48:57.171407 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-436be4c2-13ba-453e-9df3-16728fa632ed" -d '{"events": [{"name": "network-changed", "server_uuid": "5cd061b1-4698-4997-bbd8-942ec6f21bcd", "tag": "7ef8778e-5f0c-468d-903e-2a37683f22bf"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:48:57.214911 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b00a012c-2f70-47ac-8080-0dd0e8cb4087 service neutron] Pushing event updated for resources: {'Port': ['ID=7ef8778e-5f0c-468d-903e-2a37683f22bf,revision_number=3']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:48:57.220717 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a956a992-35b1-48aa-a78f-7719cbbc36b0 req-9db79c6c-443b-4e0f-8d2a-3608f3d85c18 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0715518 Sep 18 08:48:57.230741 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:48:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f727e20b-7bef-4417-8320-a9ace7e593d1 x-openstack-request-id: req-f727e20b-7bef-4417-8320-a9ace7e593d1 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:48:57.231104 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5cd061b1-4698-4997-bbd8-942ec6f21bcd", "tag": "7ef8778e-5f0c-468d-903e-2a37683f22bf", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:48:57.231425 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-f727e20b-7bef-4417-8320-a9ace7e593d1 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:48:57.231891 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5cd061b1-4698-4997-bbd8-942ec6f21bcd', 'tag': '7ef8778e-5f0c-468d-903e-2a37683f22bf', 'status': 'completed', 'code': 200} Sep 18 08:48:57.280542 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-a82e1012-4a2c-46c5-8954-234f50a66021 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:57.282100 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-a82e1012-4a2c-46c5-8954-234f50a66021 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0c7c58787ad549afa94b716f4c2f187b&device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 1097 time: 0.0410657 Sep 18 08:48:57.329304 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-5fdd6b92-7644-4bc6-a9ee-c84a7d11c5ee service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=7ef8778e-5f0c-468d-903e-2a37683f22bf HTTP/1.1" status: 200 len: 217 time: 0.0337820 Sep 18 08:48:57.380591 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-fcf99bc4-cd5d-459d-b124-7a3c8ddbacef service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:57.382048 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-fcf99bc4-cd5d-459d-b124-7a3c8ddbacef service neutron] 10.222.0.13 "GET /v2.0/subnets?id=a4c047cf-cba6-4b94-8339-59469f96c92a HTTP/1.1" status: 200 len: 851 time: 0.0460632 Sep 18 08:48:57.427277 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-764126df-2055-439d-85c2-bdcd60f91d15 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:57.428849 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-764126df-2055-439d-85c2-bdcd60f91d15 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=000f3583-b7de-458d-9146-0010cd28b00d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0395970 Sep 18 08:48:57.514587 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-55613244-1dd3-48cb-9cb6-5e2a3ff82481 service neutron] 10.222.0.13 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0781219 Sep 18 08:48:57.604730 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-14f42066-eda3-44bf-ab8c-18e13ca72dbb req-a5a3f5c9-6d6a-4b56-a497-4efb58610c4c service neutron] 10.222.0.13 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0824816 Sep 18 08:48:57.746610 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-436be4c2-13ba-453e-9df3-16728fa632ed req-6a15324f-f603-455b-9d71-10aee3cf04e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:57.748042 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-436be4c2-13ba-453e-9df3-16728fa632ed req-6a15324f-f603-455b-9d71-10aee3cf04e6 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0c7c58787ad549afa94b716f4c2f187b&device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 1097 time: 0.0386941 Sep 18 08:48:57.838496 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-436be4c2-13ba-453e-9df3-16728fa632ed req-0e481331-bf91-4715-b5f7-8f8c8d43db36 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:57.839908 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-436be4c2-13ba-453e-9df3-16728fa632ed req-0e481331-bf91-4715-b5f7-8f8c8d43db36 service neutron] 10.222.0.13 "GET /v2.0/networks?id=000f3583-b7de-458d-9146-0010cd28b00d HTTP/1.1" status: 200 len: 913 time: 0.0836620 Sep 18 08:48:57.879473 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-436be4c2-13ba-453e-9df3-16728fa632ed req-e86899a9-a26a-4aab-a364-35de482192ad service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=7ef8778e-5f0c-468d-903e-2a37683f22bf HTTP/1.1" status: 200 len: 217 time: 0.0320585 Sep 18 08:48:57.928795 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-436be4c2-13ba-453e-9df3-16728fa632ed req-11cd04dc-22cc-4c38-affa-48518bac238f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:57.930209 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-436be4c2-13ba-453e-9df3-16728fa632ed req-11cd04dc-22cc-4c38-affa-48518bac238f service neutron] 10.222.0.13 "GET /v2.0/subnets?id=a4c047cf-cba6-4b94-8339-59469f96c92a HTTP/1.1" status: 200 len: 851 time: 0.0438924 Sep 18 08:48:57.972924 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-436be4c2-13ba-453e-9df3-16728fa632ed req-e45751f4-67b1-4b1b-81b2-5200008ead47 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:57.974352 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-436be4c2-13ba-453e-9df3-16728fa632ed req-e45751f4-67b1-4b1b-81b2-5200008ead47 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=000f3583-b7de-458d-9146-0010cd28b00d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0371041 Sep 18 08:48:58.059921 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-436be4c2-13ba-453e-9df3-16728fa632ed req-b367e238-3af2-480b-8c3f-0a882fe4cdad service neutron] 10.222.0.13 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0780799 Sep 18 08:48:58.147878 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-436be4c2-13ba-453e-9df3-16728fa632ed req-95252a39-7d19-46fa-9ec0-b66dce1b102a service neutron] 10.222.0.13 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0812643 Sep 18 08:48:58.334803 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a264795b-a4f8-42e5-9fcd-6f555d027549 req-be12bb18-aad7-4221-86c7-37ef118c0b0c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:58.336261 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a264795b-a4f8-42e5-9fcd-6f555d027549 req-be12bb18-aad7-4221-86c7-37ef118c0b0c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 944 time: 0.0472741 Sep 18 08:48:58.372745 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a264795b-a4f8-42e5-9fcd-6f555d027549 req-0f7a019e-d805-44b8-a683-7ea675b6bc09 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0306900 Sep 18 08:48:59.481854 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5b12bd6-1d71-4430-a924-7bae9027b9bd req-4d819557-2e5f-44db-9d3c-eed03cdad1bd tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:48:59.483294 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d5b12bd6-1d71-4430-a924-7bae9027b9bd req-4d819557-2e5f-44db-9d3c-eed03cdad1bd tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 944 time: 0.0468080 Sep 18 08:48:59.523692 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d5b12bd6-1d71-4430-a924-7bae9027b9bd req-8e0dbe52-8646-4940-b747-917fc11403af tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0346134 Sep 18 08:49:00.633246 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-093aef3d-99a7-40ac-ac54-b46dd6d592a4 req-3eebd395-3498-4a46-8e16-fbb5a767afed tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:00.634733 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-093aef3d-99a7-40ac-ac54-b46dd6d592a4 req-3eebd395-3498-4a46-8e16-fbb5a767afed tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 944 time: 0.0466690 Sep 18 08:49:00.671788 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-093aef3d-99a7-40ac-ac54-b46dd6d592a4 req-e22840a5-653c-4710-a176-8d47199723cf tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0306182 Sep 18 08:49:01.780467 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1974f4ea-dab0-4c27-8515-9e9b5fd31c1b req-1040a814-c1f1-48ae-856f-e63a083166fb tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:01.782460 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1974f4ea-dab0-4c27-8515-9e9b5fd31c1b req-1040a814-c1f1-48ae-856f-e63a083166fb tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 944 time: 0.0460899 Sep 18 08:49:01.818188 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1974f4ea-dab0-4c27-8515-9e9b5fd31c1b req-0d465d93-ca2a-4350-b0d3-a8cf7d4310d1 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0300415 Sep 18 08:49:02.927907 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c2a8b37-9ab8-48e6-ab76-deed5e5427fd req-786e49a8-104b-494c-ab62-8c66ed70ddb7 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:02.929388 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9c2a8b37-9ab8-48e6-ab76-deed5e5427fd req-786e49a8-104b-494c-ab62-8c66ed70ddb7 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 944 time: 0.0463841 Sep 18 08:49:02.969166 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9c2a8b37-9ab8-48e6-ab76-deed5e5427fd req-e6977b43-6579-4ff0-8917-703158c9f081 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0338438 Sep 18 08:49:04.079324 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36c7e5f6-3dba-4136-8b33-7e3237555791 req-1e55774f-dc28-4fef-9cdd-f418f5c974ac tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:04.080790 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-36c7e5f6-3dba-4136-8b33-7e3237555791 req-1e55774f-dc28-4fef-9cdd-f418f5c974ac tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 944 time: 0.0466869 Sep 18 08:49:04.117638 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-36c7e5f6-3dba-4136-8b33-7e3237555791 req-3066ad0e-5f4d-4ed6-93cb-5354b883d208 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0310125 Sep 18 08:49:05.232990 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f425eecb-7793-4524-b029-fca6e9a6dc1e req-f72bf4cc-242a-41a7-a12e-f7d31d0370b3 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:05.234481 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f425eecb-7793-4524-b029-fca6e9a6dc1e req-f72bf4cc-242a-41a7-a12e-f7d31d0370b3 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 944 time: 0.0472918 Sep 18 08:49:05.270615 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f425eecb-7793-4524-b029-fca6e9a6dc1e req-7cd67fd8-3d37-4fa2-b1d1-985fbb4ca327 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0303209 Sep 18 08:49:06.381537 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d8a0a39-a052-415f-997e-bfa02bbbb901 req-a29b4e3d-3862-4bd5-93ff-d08ceeccc760 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:06.383003 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7d8a0a39-a052-415f-997e-bfa02bbbb901 req-a29b4e3d-3862-4bd5-93ff-d08ceeccc760 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 944 time: 0.0471997 Sep 18 08:49:06.422582 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7d8a0a39-a052-415f-997e-bfa02bbbb901 req-ef6943b3-1948-47e7-b0a1-e743141b73d9 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0338249 Sep 18 08:49:06.484844 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 7ef8778e-5f0c-468d-903e-2a37683f22bf details requested by agent hyperv_hv-cinder-80447 with host hv-cinder-80447 {{(pid=94348) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 18 08:49:06.579732 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 7ef8778e-5f0c-468d-903e-2a37683f22bf, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=7ef8778e-5f0c-468d-903e-2a37683f22bf,segment=NetworkSegment(c215153d-2878-4c82-8dc0-2a92b453bf12),segment_id=c215153d-2878-4c82-8dc0-2a92b453bf12)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:49:06.590271 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Returning: {'device': '7ef8778e-5f0c-468d-903e-2a37683f22bf', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'port_id': '7ef8778e-5f0c-468d-903e-2a37683f22bf', 'mac_address': 'fa:16:3e:48:05:8b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 200, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94348) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 18 08:49:06.625719 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:06.637738 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7ef8778e-5f0c-468d-903e-2a37683f22bf {{(pid=94348) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:49:06.656861 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 7ef8778e-5f0c-468d-903e-2a37683f22bf, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=7ef8778e-5f0c-468d-903e-2a37683f22bf,segment=NetworkSegment(c215153d-2878-4c82-8dc0-2a92b453bf12),segment_id=c215153d-2878-4c82-8dc0-2a92b453bf12)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:49:06.660212 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:06.704617 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=7ef8778e-5f0c-468d-903e-2a37683f22bf,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:06.711304 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:06.711659 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:06.712007 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:06.712346 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:06.712682 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:06.713018 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:06.713381 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:06.713719 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:06.714050 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:06.714385 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:06.714710 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:06.715035 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:07.061476 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['7ef8778e-5f0c-468d-903e-2a37683f22bf'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:49:07.532488 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74d8ab61-0ce6-4477-9c0e-785acb933323 req-54616e7a-0e0f-4762-a5b7-f361eb650583 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:07.533987 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-74d8ab61-0ce6-4477-9c0e-785acb933323 req-54616e7a-0e0f-4762-a5b7-f361eb650583 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 945 time: 0.0474360 Sep 18 08:49:07.570925 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-74d8ab61-0ce6-4477-9c0e-785acb933323 req-6ce093b4-00c3-4564-8849-1034c692ad63 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0311251 Sep 18 08:49:08.513445 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 7ef8778e-5f0c-468d-903e-2a37683f22bf up at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:49:08.560191 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning for port 7ef8778e-5f0c-468d-903e-2a37683f22bf completed by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 18 08:49:08.564933 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning complete for port 7ef8778e-5f0c-468d-903e-2a37683f22bf triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:49:08.565385 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:08.646145 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:08.668736 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5cd061b1-4698-4997-bbd8-942ec6f21bcd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7ef8778e-5f0c-468d-903e-2a37683f22bf'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:49:08.670967 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-478bee0c-1717-4488-b30d-c967e0e33296" -d '{"events": [{"server_uuid": "5cd061b1-4698-4997-bbd8-942ec6f21bcd", "name": "network-vif-plugged", "status": "completed", "tag": "7ef8778e-5f0c-468d-903e-2a37683f22bf"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:49:08.683685 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 7ef8778e-5f0c-468d-903e-2a37683f22bf, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=7ef8778e-5f0c-468d-903e-2a37683f22bf,segment=NetworkSegment(c215153d-2878-4c82-8dc0-2a92b453bf12),segment_id=c215153d-2878-4c82-8dc0-2a92b453bf12)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:49:08.683817 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98613182-21a3-4334-a126-4f657568bdf4 req-118a24d0-1b6a-4058-9d15-369e2b519e32 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:08.685517 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-98613182-21a3-4334-a126-4f657568bdf4 req-118a24d0-1b6a-4058-9d15-369e2b519e32 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 945 time: 0.0495770 Sep 18 08:49:08.688925 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:08.711495 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:49:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-55d1ca37-60dc-46d3-9d50-3a15a445fdf8 x-openstack-request-id: req-55d1ca37-60dc-46d3-9d50-3a15a445fdf8 {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:49:08.711782 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5cd061b1-4698-4997-bbd8-942ec6f21bcd", "name": "network-vif-plugged", "status": "completed", "tag": "7ef8778e-5f0c-468d-903e-2a37683f22bf", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:49:08.712034 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-55d1ca37-60dc-46d3-9d50-3a15a445fdf8 {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:49:08.712421 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5cd061b1-4698-4997-bbd8-942ec6f21bcd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7ef8778e-5f0c-468d-903e-2a37683f22bf', 'code': 200} Sep 18 08:49:08.728222 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-98613182-21a3-4334-a126-4f657568bdf4 req-47aa57fa-4728-4edf-b9f0-1a1b01cd8469 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0354466 Sep 18 08:49:08.737254 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=7ef8778e-5f0c-468d-903e-2a37683f22bf,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:08.958128 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-345b5fa7-88e3-4ef3-a57f-94ff059a50da req-dd03cbc7-7234-4350-9c7c-9afbd388a831 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:08.959619 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-345b5fa7-88e3-4ef3-a57f-94ff059a50da req-dd03cbc7-7234-4350-9c7c-9afbd388a831 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 1099 time: 0.0393040 Sep 18 08:49:08.996096 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-345b5fa7-88e3-4ef3-a57f-94ff059a50da req-4a353e9b-36fc-49b8-9930-6317464a741b service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0295866 Sep 18 08:49:09.841182 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1101d4f5-5858-4a6c-8fb0-69a7972b77ae req-c525a9f5-29a6-4c82-b4ea-5dc7d00463b0 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:09.842683 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1101d4f5-5858-4a6c-8fb0-69a7972b77ae req-c525a9f5-29a6-4c82-b4ea-5dc7d00463b0 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 946 time: 0.0475008 Sep 18 08:49:09.880414 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1101d4f5-5858-4a6c-8fb0-69a7972b77ae req-3df83b78-b6e0-4094-bfb0-4f77fd304389 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0315034 Sep 18 08:49:10.990837 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-328fc766-a695-4fbf-95ba-040ec9d92941 req-df31a721-5622-40ff-87f2-9a602cfae813 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:10.992279 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-328fc766-a695-4fbf-95ba-040ec9d92941 req-df31a721-5622-40ff-87f2-9a602cfae813 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 946 time: 0.0470817 Sep 18 08:49:11.028603 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-328fc766-a695-4fbf-95ba-040ec9d92941 req-0c2c7ee9-154f-4e8d-b741-090741e5db4e tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0305462 Sep 18 08:49:11.146605 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d41c0f0-3982-45f9-9548-ccfba0329315 req-98e62163-e2f8-483d-a6a5-57c42b2c5cb6 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:11.148084 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9d41c0f0-3982-45f9-9548-ccfba0329315 req-98e62163-e2f8-483d-a6a5-57c42b2c5cb6 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 946 time: 0.0483682 Sep 18 08:49:11.188399 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9d41c0f0-3982-45f9-9548-ccfba0329315 req-6f35788d-e4d4-4888-909d-410e06fcd7e0 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0342476 Sep 18 08:49:11.209789 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 37494) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:49:11.340292 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99cd468e-1634-4985-99b4-d48e64338749 tempest-TestVolumeBootPattern-848168784 tempest-TestVolumeBootPattern-848168784-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:11.341835 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-99cd468e-1634-4985-99b4-d48e64338749 tempest-TestVolumeBootPattern-848168784 tempest-TestVolumeBootPattern-848168784-project-admin] 10.222.0.35 "GET /v2.0/ports?device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 1094 time: 0.1310771 Sep 18 08:49:11.344505 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 37498) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:49:11.348993 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-10e66739-5b00-4eac-a75f-c1474c5444d8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Request body: {'floatingip': {'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'port_id': '7ef8778e-5f0c-468d-903e-2a37683f22bf', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'fixed_ip_address': '172.20.0.11'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:49:11.369650 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-10e66739-5b00-4eac-a75f-c1474c5444d8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for floatingip, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:11.463989 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-10e66739-5b00-4eac-a75f-c1474c5444d8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:11.567677 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_common [None req-10e66739-5b00-4eac-a75f-c1474c5444d8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Allocated IP 172.27.1.64 (2e3b3f85-63e4-4380-917a-8c90c80b3e38/cd525bb9-7f93-490c-a5d6-a08911817e54/b521b7d1-1888-4a30-96d7-f160b17bbed3) {{(pid=94347) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:49:11.666726 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-10e66739-5b00-4eac-a75f-c1474c5444d8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for port, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:11.701969 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:49:11.703124 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-10e66739-5b00-4eac-a75f-c1474c5444d8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:11.741784 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10e66739-5b00-4eac-a75f-c1474c5444d8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:49:11.746766 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [None req-10e66739-5b00-4eac-a75f-c1474c5444d8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:49:11.752549 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10e66739-5b00-4eac-a75f-c1474c5444d8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Received port after_create {{(pid=94347) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:49:11.755583 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10e66739-5b00-4eac-a75f-c1474c5444d8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Pushing event updated for resources: {'Port': ['ID=b521b7d1-1888-4a30-96d7-f160b17bbed3,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:12.096081 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-10e66739-5b00-4eac-a75f-c1474c5444d8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for floatingip, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:12.161182 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-10e66739-5b00-4eac-a75f-c1474c5444d8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:12.305450 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-10e66739-5b00-4eac-a75f-c1474c5444d8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for port, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:12.309566 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-10e66739-5b00-4eac-a75f-c1474c5444d8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:12.375812 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10e66739-5b00-4eac-a75f-c1474c5444d8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Pushing event updated for resources: {'Port': ['ID=b521b7d1-1888-4a30-96d7-f160b17bbed3,revision_number=2']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:12.385511 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-10e66739-5b00-4eac-a75f-c1474c5444d8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-784908'] for floatingip, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:12.482213 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.db.l3_db [None req-10e66739-5b00-4eac-a75f-c1474c5444d8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Floating IP b938f6f2-607a-406e-9114-2dbeb65db4af associated. External IP: 172.27.1.64, port: 7ef8778e-5f0c-468d-903e-2a37683f22bf. Sep 18 08:49:12.680511 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-10e66739-5b00-4eac-a75f-c1474c5444d8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Router 4922fc58-f2eb-480a-878f-2bc3f212b4da has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94347) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:49:13.034816 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-10e66739-5b00-4eac-a75f-c1474c5444d8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94347) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:49:13.044571 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec5c0a60-fedd-4049-9a6f-c9909229f587 None None] Sync routers for ids ['4922fc58-f2eb-480a-878f-2bc3f212b4da'] in dv-cinder-804470-6-iscsi {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:49:13.049709 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-10e66739-5b00-4eac-a75f-c1474c5444d8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for floatingip, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:13.055527 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec5c0a60-fedd-4049-9a6f-c9909229f587 None None] Routers {'4922fc58-f2eb-480a-878f-2bc3f212b4da'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:49:13.056160 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-ec5c0a60-fedd-4049-9a6f-c9909229f587 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:48:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['4922fc58-f2eb-480a-878f-2bc3f212b4da'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:49:13.076167 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-10e66739-5b00-4eac-a75f-c1474c5444d8 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.7305894 Sep 18 08:49:13.076753 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5cd061b1-4698-4997-bbd8-942ec6f21bcd', 'tag': '7ef8778e-5f0c-468d-903e-2a37683f22bf'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:49:13.079631 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c6f9f056-8c6e-4137-851c-598af4ade667" -d '{"events": [{"name": "network-changed", "server_uuid": "5cd061b1-4698-4997-bbd8-942ec6f21bcd", "tag": "7ef8778e-5f0c-468d-903e-2a37683f22bf"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:49:13.114466 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:49:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-291d429c-58a4-408b-9ba2-a0aabb174a9a x-openstack-request-id: req-291d429c-58a4-408b-9ba2-a0aabb174a9a {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:49:13.115065 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5cd061b1-4698-4997-bbd8-942ec6f21bcd", "tag": "7ef8778e-5f0c-468d-903e-2a37683f22bf", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:49:13.115065 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-291d429c-58a4-408b-9ba2-a0aabb174a9a {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:49:13.115367 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5cd061b1-4698-4997-bbd8-942ec6f21bcd', 'tag': '7ef8778e-5f0c-468d-903e-2a37683f22bf', 'status': 'completed', 'code': 200} Sep 18 08:49:13.164258 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-ec5c0a60-fedd-4049-9a6f-c9909229f587 None None] Set router 4922fc58-f2eb-480a-878f-2bc3f212b4da gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:49:13.202876 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6f9f056-8c6e-4137-851c-598af4ade667 req-412bc115-1103-4969-8864-0593f2d3f42b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:13.204466 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c6f9f056-8c6e-4137-851c-598af4ade667 req-412bc115-1103-4969-8864-0593f2d3f42b service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0c7c58787ad549afa94b716f4c2f187b&device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 1099 time: 0.0391812 Sep 18 08:49:13.294168 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6f9f056-8c6e-4137-851c-598af4ade667 req-d95b06a7-6f44-4847-b10e-307de19b6bb6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:13.295524 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c6f9f056-8c6e-4137-851c-598af4ade667 req-d95b06a7-6f44-4847-b10e-307de19b6bb6 service neutron] 10.222.0.13 "GET /v2.0/networks?id=000f3583-b7de-458d-9146-0010cd28b00d HTTP/1.1" status: 200 len: 913 time: 0.0841475 Sep 18 08:49:13.359118 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c6f9f056-8c6e-4137-851c-598af4ade667 req-ac319e94-3812-4560-b009-18f13094fbd6 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=7ef8778e-5f0c-468d-903e-2a37683f22bf HTTP/1.1" status: 200 len: 999 time: 0.0551322 Sep 18 08:49:13.388294 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-ec5c0a60-fedd-4049-9a6f-c9909229f587 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 4, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port': {'id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ad:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 474, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:54Z', 'updated_at': '2021-09-18T08:41:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': '82381b73-8875-486b-bf4a-c647dafc0cbe', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'floating_ip_address': '172.27.1.105', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'port_id': '068a71a1-cf8a-4759-a743-216fe1a17a75', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'mac_address': 'fa:16:3e:ee:92:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '825bdf32-25b4-4b50-a9b5-ed2f13f19319', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:46:52Z', 'updated_at': '2021-09-18T08:46:54Z', 'revision_number': 1, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'fixed_ip_address_scope': None}, {'id': 'b938f6f2-607a-406e-9114-2dbeb65db4af', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'floating_ip_address': '172.27.1.64', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'port_id': '7ef8778e-5f0c-468d-903e-2a37683f22bf', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 634, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'mac_address': 'fa:16:3e:48:05:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cd061b1-4698-4997-bbd8-942ec6f21bcd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:49:11Z', 'updated_at': '2021-09-18T08:49:11Z', 'revision_number': 0, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4eb6aada-4647-4cc0-b357-a3113e1607e9', 'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'mac_address': 'fa:16:3e:49:34:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_interface', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:56Z', 'updated_at': '2021-09-18T08:42:01Z', 'revision_number': 5, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'subnets': [{'id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:49:13.409510 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6f9f056-8c6e-4137-851c-598af4ade667 req-549126fa-d274-4840-a883-f5cfe66ce296 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:13.410941 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c6f9f056-8c6e-4137-851c-598af4ade667 req-549126fa-d274-4840-a883-f5cfe66ce296 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=a4c047cf-cba6-4b94-8339-59469f96c92a HTTP/1.1" status: 200 len: 851 time: 0.0449190 Sep 18 08:49:13.413855 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec5c0a60-fedd-4049-9a6f-c9909229f587 None None] Checking router: 4922fc58-f2eb-480a-878f-2bc3f212b4da for host: dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:49:13.422576 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec5c0a60-fedd-4049-9a6f-c9909229f587 None None] Routers {'4922fc58-f2eb-480a-878f-2bc3f212b4da'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:49:13.423184 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-ec5c0a60-fedd-4049-9a6f-c9909229f587 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:48:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['4922fc58-f2eb-480a-878f-2bc3f212b4da'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:49:13.455026 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6f9f056-8c6e-4137-851c-598af4ade667 req-b42e8244-a4a6-40a6-b922-ec17c37268e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:13.456486 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c6f9f056-8c6e-4137-851c-598af4ade667 req-b42e8244-a4a6-40a6-b922-ec17c37268e0 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=000f3583-b7de-458d-9146-0010cd28b00d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0379999 Sep 18 08:49:13.527404 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-ec5c0a60-fedd-4049-9a6f-c9909229f587 None None] Set router 4922fc58-f2eb-480a-878f-2bc3f212b4da gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:49:13.543768 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c6f9f056-8c6e-4137-851c-598af4ade667 req-cd241455-8632-4977-9f68-3d43297c778f service neutron] 10.222.0.13 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0800066 Sep 18 08:49:13.636443 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c6f9f056-8c6e-4137-851c-598af4ade667 req-c6b5f20d-014b-4c7f-af0c-ea8a65dbb866 service neutron] 10.222.0.13 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0845487 Sep 18 08:49:13.753175 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-ec5c0a60-fedd-4049-9a6f-c9909229f587 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 4, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port': {'id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ad:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 474, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:54Z', 'updated_at': '2021-09-18T08:41:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': '82381b73-8875-486b-bf4a-c647dafc0cbe', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'floating_ip_address': '172.27.1.105', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'port_id': '068a71a1-cf8a-4759-a743-216fe1a17a75', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'mac_address': 'fa:16:3e:ee:92:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '825bdf32-25b4-4b50-a9b5-ed2f13f19319', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:46:52Z', 'updated_at': '2021-09-18T08:46:54Z', 'revision_number': 1, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'fixed_ip_address_scope': None}, {'id': 'b938f6f2-607a-406e-9114-2dbeb65db4af', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'floating_ip_address': '172.27.1.64', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'port_id': '7ef8778e-5f0c-468d-903e-2a37683f22bf', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 634, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'mac_address': 'fa:16:3e:48:05:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cd061b1-4698-4997-bbd8-942ec6f21bcd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:49:11Z', 'updated_at': '2021-09-18T08:49:11Z', 'revision_number': 0, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4eb6aada-4647-4cc0-b357-a3113e1607e9', 'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'mac_address': 'fa:16:3e:49:34:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_interface', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:56Z', 'updated_at': '2021-09-18T08:42:01Z', 'revision_number': 5, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'subnets': [{'id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:49:13.778666 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ec5c0a60-fedd-4049-9a6f-c9909229f587 None None] The sync data for ids ['4922fc58-f2eb-480a-878f-2bc3f212b4da'] in dv-cinder-804470-6-iscsi is: [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 4, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port': {'id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ad:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 474, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:54Z', 'updated_at': '2021-09-18T08:41:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': '82381b73-8875-486b-bf4a-c647dafc0cbe', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'floating_ip_address': '172.27.1.105', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'port_id': '068a71a1-cf8a-4759-a743-216fe1a17a75', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'mac_address': 'fa:16:3e:ee:92:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '825bdf32-25b4-4b50-a9b5-ed2f13f19319', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:46:52Z', 'updated_at': '2021-09-18T08:46:54Z', 'revision_number': 1, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'fixed_ip_address_scope': None}, {'id': 'b938f6f2-607a-406e-9114-2dbeb65db4af', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'floating_ip_address': '172.27.1.64', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'port_id': '7ef8778e-5f0c-468d-903e-2a37683f22bf', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 634, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'mac_address': 'fa:16:3e:48:05:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cd061b1-4698-4997-bbd8-942ec6f21bcd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:49:11Z', 'updated_at': '2021-09-18T08:49:11Z', 'revision_number': 0, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4eb6aada-4647-4cc0-b357-a3113e1607e9', 'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'mac_address': 'fa:16:3e:49:34:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_interface', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:56Z', 'updated_at': '2021-09-18T08:42:01Z', 'revision_number': 5, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'subnets': [{'id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:49:13.957473 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a24f34ce-ed1f-4a7a-aae7-2392c046b029 None None] New status for floating IP b938f6f2-607a-406e-9114-2dbeb65db4af: ACTIVE {{(pid=94349) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 18 08:49:19.623720 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-df0ce4b6-5b02-4bfd-b49a-2570b062d12e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:20.112597 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:22.406697 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-7de11ebd-f322-4ee5-b171-b4aad80c0d3e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:23.220034 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:23.374563 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:24.790855 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b27afbe3-f95e-441f-b06d-0723d47b2f37 req-ea5f258f-dc20-45d2-80a7-739492d6761c service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0789506 Sep 18 08:49:24.867777 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b27afbe3-f95e-441f-b06d-0723d47b2f37 req-ae4d7881-7497-4a8f-8843-5c142682fd26 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:24.869225 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b27afbe3-f95e-441f-b06d-0723d47b2f37 req-ae4d7881-7497-4a8f-8843-5c142682fd26 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0c7c58787ad549afa94b716f4c2f187b&device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 1099 time: 0.0415533 Sep 18 08:49:24.893786 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:24.969162 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b27afbe3-f95e-441f-b06d-0723d47b2f37 req-4b08cca1-dfaf-4c92-8365-3f518c8e3650 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:24.970592 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b27afbe3-f95e-441f-b06d-0723d47b2f37 req-4b08cca1-dfaf-4c92-8365-3f518c8e3650 service neutron] 10.222.0.13 "GET /v2.0/networks?id=000f3583-b7de-458d-9146-0010cd28b00d HTTP/1.1" status: 200 len: 913 time: 0.0822766 Sep 18 08:49:25.037918 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b27afbe3-f95e-441f-b06d-0723d47b2f37 req-e9bcf9d7-18c4-4976-953c-99624b4a37b6 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=068a71a1-cf8a-4759-a743-216fe1a17a75 HTTP/1.1" status: 200 len: 1002 time: 0.0593696 Sep 18 08:49:25.085015 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b27afbe3-f95e-441f-b06d-0723d47b2f37 req-1d20a1fc-d338-4982-aa3e-f90c7c2af88c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:25.086430 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b27afbe3-f95e-441f-b06d-0723d47b2f37 req-1d20a1fc-d338-4982-aa3e-f90c7c2af88c service neutron] 10.222.0.13 "GET /v2.0/subnets?id=a4c047cf-cba6-4b94-8339-59469f96c92a HTTP/1.1" status: 200 len: 851 time: 0.0416219 Sep 18 08:49:25.130384 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b27afbe3-f95e-441f-b06d-0723d47b2f37 req-b34aa3fb-7016-4573-9042-5eb943b77022 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:25.131794 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b27afbe3-f95e-441f-b06d-0723d47b2f37 req-b34aa3fb-7016-4573-9042-5eb943b77022 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=000f3583-b7de-458d-9146-0010cd28b00d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0371964 Sep 18 08:49:25.225201 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b27afbe3-f95e-441f-b06d-0723d47b2f37 req-fb556c1c-dd1c-4736-9c77-1cb13cb77e86 service neutron] 10.222.0.13 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0835497 Sep 18 08:49:25.311627 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b27afbe3-f95e-441f-b06d-0723d47b2f37 req-5cce9716-c268-44e6-a5de-da0508493e31 service neutron] 10.222.0.13 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0774548 Sep 18 08:49:36.451877 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d5981cf-9531-4188-825e-f7ef7b32e2da req-dc174562-93cd-4b86-943b-55305809f56f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:36.453835 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4d5981cf-9531-4188-825e-f7ef7b32e2da req-dc174562-93cd-4b86-943b-55305809f56f tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 946 time: 0.0510128 Sep 18 08:49:36.490472 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-4d5981cf-9531-4188-825e-f7ef7b32e2da req-8bb619b8-962b-4cd4-96db-a0839da9184a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0307553 Sep 18 08:49:37.606858 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eff9215e-2e6c-4c44-9817-a3fd05372beb req-16e18a01-06c3-4986-9a4b-771ef2fc804a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:37.608306 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-eff9215e-2e6c-4c44-9817-a3fd05372beb req-16e18a01-06c3-4986-9a4b-771ef2fc804a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 946 time: 0.0471292 Sep 18 08:49:37.644563 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-eff9215e-2e6c-4c44-9817-a3fd05372beb req-f2781c81-f722-4ed3-9d81-8555b137fd94 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0298724 Sep 18 08:49:38.335634 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9db0cd5-a571-46e9-b4a2-75b594125b30 req-bf5594d6-38b9-4818-b1a3-439f9c7c457e tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:38.337081 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f9db0cd5-a571-46e9-b4a2-75b594125b30 req-bf5594d6-38b9-4818-b1a3-439f9c7c457e tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.13 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 946 time: 0.0466731 Sep 18 08:49:38.426717 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-f9db0cd5-a571-46e9-b4a2-75b594125b30 req-60b734e8-5c3d-4dec-b3e6-329ef8be0d0a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Deleting port fb17b7f6-af82-4371-b33a-e2a9b265ea42 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:49:38.427061 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-f9db0cd5-a571-46e9-b4a2-75b594125b30 req-60b734e8-5c3d-4dec-b3e6-329ef8be0d0a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:38.511222 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-f9db0cd5-a571-46e9-b4a2-75b594125b30 req-60b734e8-5c3d-4dec-b3e6-329ef8be0d0a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] For port fb17b7f6-af82-4371-b33a-e2a9b265ea42, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=fb17b7f6-af82-4371-b33a-e2a9b265ea42,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:49:38.511579 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-f9db0cd5-a571-46e9-b4a2-75b594125b30 req-60b734e8-5c3d-4dec-b3e6-329ef8be0d0a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:38.675206 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-f9db0cd5-a571-46e9-b4a2-75b594125b30 req-60b734e8-5c3d-4dec-b3e6-329ef8be0d0a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for floatingip, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:38.675831 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-f9db0cd5-a571-46e9-b4a2-75b594125b30 req-60b734e8-5c3d-4dec-b3e6-329ef8be0d0a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-784908'] for floatingip, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:38.675831 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.db.l3_db [req-f9db0cd5-a571-46e9-b4a2-75b594125b30 req-60b734e8-5c3d-4dec-b3e6-329ef8be0d0a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Floating IP 5c658964-1086-4b4a-a459-5019e1da8dc0 disassociated. External IP: 172.27.1.181, port: fb17b7f6-af82-4371-b33a-e2a9b265ea42. Sep 18 08:49:38.676458 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-f9db0cd5-a571-46e9-b4a2-75b594125b30 req-60b734e8-5c3d-4dec-b3e6-329ef8be0d0a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Calling delete_port for fb17b7f6-af82-4371-b33a-e2a9b265ea42 owned by compute:nova {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:49:38.785837 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd5afc93-9c4f-41da-ae96-470fc09645c1 req-85c22d83-e793-4548-b0c9-c5980642fec7 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:38.787335 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bd5afc93-9c4f-41da-ae96-470fc09645c1 req-85c22d83-e793-4548-b0c9-c5980642fec7 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/ports?device_id=a40b16b8-10f1-416c-933c-1f01dd483851 HTTP/1.1" status: 200 len: 946 time: 0.0669210 Sep 18 08:49:38.863700 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bd5afc93-9c4f-41da-ae96-470fc09645c1 req-dd028c22-1f99-450c-aa91-dd8b159fe062 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups?id=e7f06e93-d80d-42c8-881f-6fdba5709870&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0698049 Sep 18 08:49:38.864729 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-f9db0cd5-a571-46e9-b4a2-75b594125b30 req-60b734e8-5c3d-4dec-b3e6-329ef8be0d0a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:38.891215 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60b734e8-5c3d-4dec-b3e6-329ef8be0d0a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Pushing event deleted for resources: {'Port': ['ID=fb17b7f6-af82-4371-b33a-e2a9b265ea42,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:39.003136 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.l3_agent_scheduler [req-f9db0cd5-a571-46e9-b4a2-75b594125b30 req-60b734e8-5c3d-4dec-b3e6-329ef8be0d0a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Router 73ec8685-1119-4d34-a85d-af65c74d9e25 has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94347) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:49:39.106873 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-f9db0cd5-a571-46e9-b4a2-75b594125b30 req-60b734e8-5c3d-4dec-b3e6-329ef8be0d0a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94347) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:49:39.117085 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-38e4bd2f-3c0b-4383-afcf-b0d7ad5b9c58 None None] Sync routers for ids ['73ec8685-1119-4d34-a85d-af65c74d9e25'] in dv-cinder-804470-6-iscsi {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:49:39.126069 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38e4bd2f-3c0b-4383-afcf-b0d7ad5b9c58 None None] Routers {'73ec8685-1119-4d34-a85d-af65c74d9e25'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:49:39.126747 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-38e4bd2f-3c0b-4383-afcf-b0d7ad5b9c58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:49:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['73ec8685-1119-4d34-a85d-af65c74d9e25'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:49:39.143050 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-f9db0cd5-a571-46e9-b4a2-75b594125b30 req-60b734e8-5c3d-4dec-b3e6-329ef8be0d0a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] No DVR routers for this DVR port fb17b7f6-af82-4371-b33a-e2a9b265ea42 on host hv-cinder-80447 {{(pid=94347) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:49:39.145570 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-f9db0cd5-a571-46e9-b4a2-75b594125b30 req-60b734e8-5c3d-4dec-b3e6-329ef8be0d0a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:39.147528 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f9db0cd5-a571-46e9-b4a2-75b594125b30 req-60b734e8-5c3d-4dec-b3e6-329ef8be0d0a tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.13 "DELETE /v2.0/ports/fb17b7f6-af82-4371-b33a-e2a9b265ea42 HTTP/1.1" status: 204 len: 173 time: 0.8032286 Sep 18 08:49:39.147978 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a40b16b8-10f1-416c-933c-1f01dd483851', 'name': 'network-vif-deleted', 'tag': 'fb17b7f6-af82-4371-b33a-e2a9b265ea42'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:49:39.150210 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-acc789a4-2ab4-49b6-b00d-5fb80f82a4c6" -d '{"events": [{"server_uuid": "a40b16b8-10f1-416c-933c-1f01dd483851", "name": "network-vif-deleted", "tag": "fb17b7f6-af82-4371-b33a-e2a9b265ea42"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:49:39.246773 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-38e4bd2f-3c0b-4383-afcf-b0d7ad5b9c58 None None] Set router 73ec8685-1119-4d34-a85d-af65c74d9e25 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:49:39.246989 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:49:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4e381cd7-049a-47db-ae58-7d8d9b116e54 x-openstack-request-id: req-4e381cd7-049a-47db-ae58-7d8d9b116e54 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:49:39.247250 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a40b16b8-10f1-416c-933c-1f01dd483851", "name": "network-vif-deleted", "tag": "fb17b7f6-af82-4371-b33a-e2a9b265ea42", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:49:39.247507 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-4e381cd7-049a-47db-ae58-7d8d9b116e54 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:49:39.247910 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a40b16b8-10f1-416c-933c-1f01dd483851', 'name': 'network-vif-deleted', 'tag': 'fb17b7f6-af82-4371-b33a-e2a9b265ea42', 'status': 'completed', 'code': 200} Sep 18 08:49:39.575118 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-38e4bd2f-3c0b-4383-afcf-b0d7ad5b9c58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'name': 'tempest-AttachVolumeShelveTestJSON-230900396-router', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12'}], 'enable_snat': True}, 'gw_port_id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:04Z', 'updated_at': '2021-09-18T08:38:12Z', 'revision_number': 4, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'gw_port': {'id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:ed:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:05Z', 'updated_at': '2021-09-18T08:38:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '09652b84-a3b3-476f-815f-f0c78f8543ba', 'name': '', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'mac_address': 'fa:16:3e:20:cb:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:10Z', 'updated_at': '2021-09-18T08:38:18Z', 'revision_number': 5, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'subnets': [{'id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:49:39.600945 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-38e4bd2f-3c0b-4383-afcf-b0d7ad5b9c58 None None] Checking router: 73ec8685-1119-4d34-a85d-af65c74d9e25 for host: dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:49:39.610107 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-38e4bd2f-3c0b-4383-afcf-b0d7ad5b9c58 None None] Routers {'73ec8685-1119-4d34-a85d-af65c74d9e25'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:49:39.610832 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-38e4bd2f-3c0b-4383-afcf-b0d7ad5b9c58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:49:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['73ec8685-1119-4d34-a85d-af65c74d9e25'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:49:39.715486 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-38e4bd2f-3c0b-4383-afcf-b0d7ad5b9c58 None None] Set router 73ec8685-1119-4d34-a85d-af65c74d9e25 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:49:39.907699 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-38e4bd2f-3c0b-4383-afcf-b0d7ad5b9c58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'name': 'tempest-AttachVolumeShelveTestJSON-230900396-router', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12'}], 'enable_snat': True}, 'gw_port_id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:04Z', 'updated_at': '2021-09-18T08:38:12Z', 'revision_number': 4, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'gw_port': {'id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:ed:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:05Z', 'updated_at': '2021-09-18T08:38:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '09652b84-a3b3-476f-815f-f0c78f8543ba', 'name': '', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'mac_address': 'fa:16:3e:20:cb:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:10Z', 'updated_at': '2021-09-18T08:38:18Z', 'revision_number': 5, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'subnets': [{'id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:49:39.938404 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-38e4bd2f-3c0b-4383-afcf-b0d7ad5b9c58 None None] The sync data for ids ['73ec8685-1119-4d34-a85d-af65c74d9e25'] in dv-cinder-804470-6-iscsi is: [{'id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'name': 'tempest-AttachVolumeShelveTestJSON-230900396-router', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12'}], 'enable_snat': True}, 'gw_port_id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:04Z', 'updated_at': '2021-09-18T08:38:12Z', 'revision_number': 4, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'gw_port': {'id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:ed:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:05Z', 'updated_at': '2021-09-18T08:38:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '09652b84-a3b3-476f-815f-f0c78f8543ba', 'name': '', 'network_id': 'f430397d-03a8-4da2-bd1d-25890a3a0727', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'mac_address': 'fa:16:3e:20:cb:6e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_interface', 'standard_attr_id': 78, 'fixed_ips': [{'subnet_id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:10Z', 'updated_at': '2021-09-18T08:38:18Z', 'revision_number': 5, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'subnets': [{'id': 'acdeb8a1-5de9-425f-ae0a-890d310246e9', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:49:39.953747 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 37542) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:49:40.010882 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-27bfdf8e-3855-4ec9-93f3-09c010f0a0f4 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:40.034601 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-27bfdf8e-3855-4ec9-93f3-09c010f0a0f4 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:40.081572 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-27bfdf8e-3855-4ec9-93f3-09c010f0a0f4 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:40.083934 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-27bfdf8e-3855-4ec9-93f3-09c010f0a0f4 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:40.087628 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-27bfdf8e-3855-4ec9-93f3-09c010f0a0f4 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "DELETE /v2.0/security-groups/e7f06e93-d80d-42c8-881f-6fdba5709870 HTTP/1.1" status: 204 len: 168 time: 0.1303513 Sep 18 08:49:40.087969 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 37546) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:49:40.095283 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27bfdf8e-3855-4ec9-93f3-09c010f0a0f4 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=e7f06e93-d80d-42c8-881f-6fdba5709870,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:40.102418 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.api.v2.resource [None req-584ff531-b22a-4abe-a2a0-e58033d7d93c tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] show failed (client error): The resource could not be found. Sep 18 08:49:40.103050 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27bfdf8e-3855-4ec9-93f3-09c010f0a0f4 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:40.103410 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27bfdf8e-3855-4ec9-93f3-09c010f0a0f4 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:40.103543 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-584ff531-b22a-4abe-a2a0-e58033d7d93c tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "GET /v2.0/security-groups/e7f06e93-d80d-42c8-881f-6fdba5709870 HTTP/1.1" status: 404 len: 347 time: 0.0145206 Sep 18 08:49:40.103760 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27bfdf8e-3855-4ec9-93f3-09c010f0a0f4 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:40.104113 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27bfdf8e-3855-4ec9-93f3-09c010f0a0f4 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:40.104452 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27bfdf8e-3855-4ec9-93f3-09c010f0a0f4 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:40.104792 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27bfdf8e-3855-4ec9-93f3-09c010f0a0f4 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:40.105129 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27bfdf8e-3855-4ec9-93f3-09c010f0a0f4 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:40.105485 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27bfdf8e-3855-4ec9-93f3-09c010f0a0f4 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:40.105948 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27bfdf8e-3855-4ec9-93f3-09c010f0a0f4 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:40.106283 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27bfdf8e-3855-4ec9-93f3-09c010f0a0f4 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:40.106428 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 37548) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:49:40.106913 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27bfdf8e-3855-4ec9-93f3-09c010f0a0f4 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:40.107246 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27bfdf8e-3855-4ec9-93f3-09c010f0a0f4 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:40.185514 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe35e3a3-f609-492d-a968-426a74ea0b1c None None] New status for floating IP 5c658964-1086-4b4a-a459-5019e1da8dc0: DOWN {{(pid=94349) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 18 08:49:40.232164 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-eb326165-d31d-4776-8039-77a9019aa502 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Deleting port 10b805c8-108c-465a-b611-eda31f7e98fc {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:49:40.232605 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-eb326165-d31d-4776-8039-77a9019aa502 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:40.311252 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-eb326165-d31d-4776-8039-77a9019aa502 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:40.311583 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-eb326165-d31d-4776-8039-77a9019aa502 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:40.327440 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-eb326165-d31d-4776-8039-77a9019aa502 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Calling delete_port for 10b805c8-108c-465a-b611-eda31f7e98fc owned by network:floatingip {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:49:40.472126 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-eb326165-d31d-4776-8039-77a9019aa502 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:40.496420 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb326165-d31d-4776-8039-77a9019aa502 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Pushing event deleted for resources: {'Port': ['ID=10b805c8-108c-465a-b611-eda31f7e98fc,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:40.554145 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-eb326165-d31d-4776-8039-77a9019aa502 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks [] for floatingip, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:40.556599 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-eb326165-d31d-4776-8039-77a9019aa502 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for floatingip, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:40.557778 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-eb326165-d31d-4776-8039-77a9019aa502 tempest-AttachVolumeShelveTestJSON-706008024 tempest-AttachVolumeShelveTestJSON-706008024-project] 10.222.0.35 "DELETE /v2.0/floatingips/5c658964-1086-4b4a-a459-5019e1da8dc0 HTTP/1.1" status: 204 len: 168 time: 0.4504678 Sep 18 08:49:42.647189 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device fb17b7f6-af82-4371-b33a-e2a9b265ea42 no longer exists at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:49:42.667171 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] No Port match for: fb17b7f6-af82-4371-b33a-e2a9b265ea42 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:49:42.667520 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device fb17b7f6-af82-4371-b33a-e2a9b265ea42 not bound to the agent host hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:49:43.003905 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 37574) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:49:43.429276 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-40e27ff1-6c25-4099-afca-1445b3fac77b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-783372'] for router_interface, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:43.662818 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-40e27ff1-6c25-4099-afca-1445b3fac77b admin admin] Deleting port 09652b84-a3b3-476f-815f-f0c78f8543ba {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:49:43.663165 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-40e27ff1-6c25-4099-afca-1445b3fac77b admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:43.738763 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [None req-40e27ff1-6c25-4099-afca-1445b3fac77b admin admin] For port 09652b84-a3b3-476f-815f-f0c78f8543ba, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=09652b84-a3b3-476f-815f-f0c78f8543ba,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:49:43.739041 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-40e27ff1-6c25-4099-afca-1445b3fac77b admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:43.750929 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-40e27ff1-6c25-4099-afca-1445b3fac77b admin admin] Calling delete_port for 09652b84-a3b3-476f-815f-f0c78f8543ba owned by network:router_interface {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:49:43.926821 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-40e27ff1-6c25-4099-afca-1445b3fac77b admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:43.952687 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40e27ff1-6c25-4099-afca-1445b3fac77b admin admin] Pushing event deleted for resources: {'Port': ['ID=09652b84-a3b3-476f-815f-f0c78f8543ba,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:44.113804 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-40e27ff1-6c25-4099-afca-1445b3fac77b admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-580042', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-785084'] for router_interface, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:44.319172 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-40e27ff1-6c25-4099-afca-1445b3fac77b admin admin] Router 73ec8685-1119-4d34-a85d-af65c74d9e25 has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94347) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:49:44.674750 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-40e27ff1-6c25-4099-afca-1445b3fac77b admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94347) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:49:44.681007 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-40e27ff1-6c25-4099-afca-1445b3fac77b admin admin] 10.222.0.35 "PUT /v2.0/routers/73ec8685-1119-4d34-a85d-af65c74d9e25/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6759999 Sep 18 08:49:44.682094 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 37578) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:49:44.683747 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7df16f48-4c97-4737-9daf-7b430d2b4b9a None None] Sync routers for ids ['73ec8685-1119-4d34-a85d-af65c74d9e25'] in dv-cinder-804470-6-iscsi {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:49:44.693351 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7df16f48-4c97-4737-9daf-7b430d2b4b9a None None] Routers {'73ec8685-1119-4d34-a85d-af65c74d9e25'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:49:44.693959 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-7df16f48-4c97-4737-9daf-7b430d2b4b9a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:49:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['73ec8685-1119-4d34-a85d-af65c74d9e25'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:49:44.782606 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-53d6da4f-6cec-495c-a142-7e9f41f1fc7c admin admin] Notify callbacks [] for router, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:44.795518 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-7df16f48-4c97-4737-9daf-7b430d2b4b9a None None] Set router 73ec8685-1119-4d34-a85d-af65c74d9e25 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:49:44.879473 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-53d6da4f-6cec-495c-a142-7e9f41f1fc7c admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:44.933655 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-53d6da4f-6cec-495c-a142-7e9f41f1fc7c admin admin] Deleting port f6caa699-4d13-4268-b93e-c89e1dbaffb6 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:49:44.933915 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-53d6da4f-6cec-495c-a142-7e9f41f1fc7c admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:44.967770 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-7df16f48-4c97-4737-9daf-7b430d2b4b9a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'name': 'tempest-AttachVolumeShelveTestJSON-230900396-router', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12'}], 'enable_snat': True}, 'gw_port_id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:04Z', 'updated_at': '2021-09-18T08:49:43Z', 'revision_number': 5, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'gw_port': {'id': 'f6caa699-4d13-4268-b93e-c89e1dbaffb6', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:88:ed:50', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'device_owner': 'network:router_gateway', 'standard_attr_id': 63, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.12', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:38:05Z', 'updated_at': '2021-09-18T08:38:13Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:49:44.997932 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7df16f48-4c97-4737-9daf-7b430d2b4b9a None None] Checking router: 73ec8685-1119-4d34-a85d-af65c74d9e25 for host: dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:49:45.010253 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7df16f48-4c97-4737-9daf-7b430d2b4b9a None None] Routers {'73ec8685-1119-4d34-a85d-af65c74d9e25'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:49:45.010863 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-7df16f48-4c97-4737-9daf-7b430d2b4b9a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:49:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['73ec8685-1119-4d34-a85d-af65c74d9e25'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:49:45.013002 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [None req-53d6da4f-6cec-495c-a142-7e9f41f1fc7c admin admin] For port f6caa699-4d13-4268-b93e-c89e1dbaffb6, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=f6caa699-4d13-4268-b93e-c89e1dbaffb6,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:49:45.013409 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-53d6da4f-6cec-495c-a142-7e9f41f1fc7c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:45.025747 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-53d6da4f-6cec-495c-a142-7e9f41f1fc7c admin admin] Calling delete_port for f6caa699-4d13-4268-b93e-c89e1dbaffb6 owned by network:router_gateway {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:49:45.094774 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-7df16f48-4c97-4737-9daf-7b430d2b4b9a None None] Set router 73ec8685-1119-4d34-a85d-af65c74d9e25 gateway port host: None {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:49:45.145125 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-7df16f48-4c97-4737-9daf-7b430d2b4b9a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'name': 'tempest-AttachVolumeShelveTestJSON-230900396-router', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:04Z', 'updated_at': '2021-09-18T08:49:44Z', 'revision_number': 6, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'gw_port_host': None}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:49:45.174541 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7df16f48-4c97-4737-9daf-7b430d2b4b9a None None] The sync data for ids ['73ec8685-1119-4d34-a85d-af65c74d9e25'] in dv-cinder-804470-6-iscsi is: [{'id': '73ec8685-1119-4d34-a85d-af65c74d9e25', 'name': 'tempest-AttachVolumeShelveTestJSON-230900396-router', 'tenant_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:38:04Z', 'updated_at': '2021-09-18T08:49:44Z', 'revision_number': 6, 'project_id': '0700a96e9b3f48e8b6bcdd75b820b813', 'gw_port_host': None}] {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:49:45.188828 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-53d6da4f-6cec-495c-a142-7e9f41f1fc7c admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:45.222861 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53d6da4f-6cec-495c-a142-7e9f41f1fc7c admin admin] Pushing event deleted for resources: {'Port': ['ID=f6caa699-4d13-4268-b93e-c89e1dbaffb6,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:45.284902 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-53d6da4f-6cec-495c-a142-7e9f41f1fc7c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-785018'] for router_gateway, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:45.371727 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-53d6da4f-6cec-495c-a142-7e9f41f1fc7c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-782379', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2977'] for router, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:45.373774 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-53d6da4f-6cec-495c-a142-7e9f41f1fc7c admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:45.415467 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-53d6da4f-6cec-495c-a142-7e9f41f1fc7c admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-782544'] for router, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:45.416173 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-53d6da4f-6cec-495c-a142-7e9f41f1fc7c admin admin] Fanout notify agent at l3_agent the message router_deleted on router 73ec8685-1119-4d34-a85d-af65c74d9e25 {{(pid=94347) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 18 08:49:45.421022 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-53d6da4f-6cec-495c-a142-7e9f41f1fc7c admin admin] Notify callbacks [] for router, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:45.422219 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-53d6da4f-6cec-495c-a142-7e9f41f1fc7c admin admin] 10.222.0.35 "DELETE /v2.0/routers/73ec8685-1119-4d34-a85d-af65c74d9e25 HTTP/1.1" status: 204 len: 168 time: 0.7392051 Sep 18 08:49:45.424617 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 37580) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:49:45.467068 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_v2 [None req-60466532-b69d-40f7-88a8-6b2842d18dfa admin admin] Deleting subnet acdeb8a1-5de9-425f-ae0a-890d310246e9 {{(pid=94347) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 18 08:49:45.470577 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-60466532-b69d-40f7-88a8-6b2842d18dfa admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:45.506656 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-60466532-b69d-40f7-88a8-6b2842d18dfa admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-13659316'] for subnet, precommit_delete_associations {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:45.583371 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-60466532-b69d-40f7-88a8-6b2842d18dfa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1821528'] for subnet, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:45.647579 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-60466532-b69d-40f7-88a8-6b2842d18dfa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1821519', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15069100', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-13996283'] for subnet, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:45.671328 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60466532-b69d-40f7-88a8-6b2842d18dfa admin admin] Pushing event deleted for resources: {'Subnet': ['ID=acdeb8a1-5de9-425f-ae0a-890d310246e9,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:45.676963 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-60466532-b69d-40f7-88a8-6b2842d18dfa admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for subnet, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:45.678993 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-60466532-b69d-40f7-88a8-6b2842d18dfa admin admin] 10.222.0.35 "DELETE /v2.0/subnets/acdeb8a1-5de9-425f-ae0a-890d310246e9 HTTP/1.1" status: 204 len: 168 time: 0.2533228 Sep 18 08:49:45.681315 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 37582) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:49:45.682721 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d5d66b79-c68f-4ca0-8972-210c170741ff None None] Network f430397d-03a8-4da2-bd1d-25890a3a0727 requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:49:45.752612 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3f16257c-ec92-4bef-be63-b574e4826e9a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1861545'] for network, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:45.803292 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-3f16257c-ec92-4bef-be63-b574e4826e9a admin admin] Deleting port f64a2ad2-4079-4e29-8c07-3f9846a145a8 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:49:45.803635 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3f16257c-ec92-4bef-be63-b574e4826e9a admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:45.868395 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [None req-3f16257c-ec92-4bef-be63-b574e4826e9a admin admin] For port f64a2ad2-4079-4e29-8c07-3f9846a145a8, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=f64a2ad2-4079-4e29-8c07-3f9846a145a8,segment=NetworkSegment(34c1fb08-1711-4a8c-a899-35eb41628d5a),segment_id=34c1fb08-1711-4a8c-a899-35eb41628d5a)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:49:45.868756 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3f16257c-ec92-4bef-be63-b574e4826e9a admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:45.881342 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-3f16257c-ec92-4bef-be63-b574e4826e9a admin admin] Calling delete_port for f64a2ad2-4079-4e29-8c07-3f9846a145a8 owned by network:dhcp {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:49:45.970493 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3f16257c-ec92-4bef-be63-b574e4826e9a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:45.985382 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6f8c068e-2740-4445-9fd3-bea4f48fc50d None None] DHCP port deletion for f430397d-03a8-4da2-bd1d-25890a3a0727 request from dv-cinder-804470-6-iscsi {{(pid=94348) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 18 08:49:46.000342 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f16257c-ec92-4bef-be63-b574e4826e9a admin admin] Pushing event deleted for resources: {'Port': ['ID=f64a2ad2-4079-4e29-8c07-3f9846a145a8,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:46.014327 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3f16257c-ec92-4bef-be63-b574e4826e9a admin admin] No DVR routers for this DVR port f64a2ad2-4079-4e29-8c07-3f9846a145a8 on host dv-cinder-804470-6-iscsi {{(pid=94347) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:49:46.089536 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3f16257c-ec92-4bef-be63-b574e4826e9a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1806559', 'neutron.services.segments.db._delete_segments_for_network-8732885752733'] for network, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:46.098108 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 09652b84-a3b3-476f-815f-f0c78f8543ba no longer exists at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:49:46.110882 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.services.segments.db [None req-3f16257c-ec92-4bef-be63-b574e4826e9a admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f430397d-03a8-4da2-bd1d-25890a3a0727']}} {{(pid=94347) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:49:46.119940 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.services.segments.db [None req-3f16257c-ec92-4bef-be63-b574e4826e9a admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '34c1fb08-1711-4a8c-a899-35eb41628d5a') {'for_net_delete': True} {{(pid=94347) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:49:46.120242 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.services.segments.db [None req-3f16257c-ec92-4bef-be63-b574e4826e9a admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '34c1fb08-1711-4a8c-a899-35eb41628d5a') {} {{(pid=94347) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:49:46.122390 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-536c997d-2873-442a-81bf-9fe918803742 None None] No Port match for: 09652b84-a3b3-476f-815f-f0c78f8543ba {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:49:46.122879 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 09652b84-a3b3-476f-815f-f0c78f8543ba not bound to the agent host dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:49:46.132369 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3f16257c-ec92-4bef-be63-b574e4826e9a admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732885753254', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-13659327'] for segment, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:46.145994 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3f16257c-ec92-4bef-be63-b574e4826e9a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:46.151659 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3f16257c-ec92-4bef-be63-b574e4826e9a admin admin] Releasing vlan 214 on physical network physnet1 to pool {{(pid=94347) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 18 08:49:46.152044 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3f16257c-ec92-4bef-be63-b574e4826e9a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15067250'] for segment, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: Traceback (most recent call last): Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: timer() Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: cb(*args, **kw) Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: return func(*args, **kwargs) Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: self._notify() Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: self.callback(batched_events) Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: event.method(event) Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: aggregate_uuid = self.p_client.list_aggregates( Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: return f(self, *a, **k) Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: return self._get(url).json() Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: return self.request(url, 'GET', **kwargs) Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: base_url = self.get_endpoint(auth, allow=allow, Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 18 08:49:46.153674 dv-cinder-804470-6-iscsi neutron-server[94347]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 18 08:49:46.210995 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3f16257c-ec92-4bef-be63-b574e4826e9a admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1806534', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-784926'] for network, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:46.216556 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3f16257c-ec92-4bef-be63-b574e4826e9a admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:46.218689 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-3f16257c-ec92-4bef-be63-b574e4826e9a admin admin] 10.222.0.35 "DELETE /v2.0/networks/f430397d-03a8-4da2-bd1d-25890a3a0727 HTTP/1.1" status: 204 len: 168 time: 0.5362835 Sep 18 08:49:46.230014 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f16257c-ec92-4bef-be63-b574e4826e9a admin admin] Pushing event deleted for resources: {'Network': ['ID=f430397d-03a8-4da2-bd1d-25890a3a0727,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:46.335081 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 37586) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:49:46.374563 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-fdf39b1e-aee4-4630-b8a2-4fdfa1d18d0d admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=0700a96e9b3f48e8b6bcdd75b820b813&name=default HTTP/1.1" status: 200 len: 2975 time: 0.0383394 Sep 18 08:49:46.377484 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 37588) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:49:46.423453 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c0166eb4-388b-492f-bc3d-31226370f01c admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:46.444111 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c0166eb4-388b-492f-bc3d-31226370f01c admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:46.489426 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c0166eb4-388b-492f-bc3d-31226370f01c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:46.491962 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c0166eb4-388b-492f-bc3d-31226370f01c admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:46.493123 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-c0166eb4-388b-492f-bc3d-31226370f01c admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/91efed16-e97b-4fc5-854f-b61aadeda6c3 HTTP/1.1" status: 204 len: 168 time: 0.1147554 Sep 18 08:49:46.501505 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0166eb4-388b-492f-bc3d-31226370f01c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=91efed16-e97b-4fc5-854f-b61aadeda6c3,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:47.137647 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 37610) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:49:47.230706 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-08467ee2-1b0a-4c2a-a323-dc3578a331cb admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-468473020-network', 'tenant_id': '334211ea09044272868662e38cb1a4ad'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:49:47.251645 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-08467ee2-1b0a-4c2a-a323-dc3578a331cb admin admin] Made reservation on behalf of 334211ea09044272868662e38cb1a4ad for: {'network': 1} {{(pid=94346) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:49:47.253893 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-08467ee2-1b0a-4c2a-a323-dc3578a331cb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for network, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:47.261834 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-08467ee2-1b0a-4c2a-a323-dc3578a331cb admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:47.348053 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-08467ee2-1b0a-4c2a-a323-dc3578a331cb admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:47.351403 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-08467ee2-1b0a-4c2a-a323-dc3578a331cb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:47.374103 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-08467ee2-1b0a-4c2a-a323-dc3578a331cb admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 230} {{(pid=94346) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Sep 18 08:49:47.382902 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08467ee2-1b0a-4c2a-a323-dc3578a331cb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8370a86f-c71c-4df6-92f2-cce70abb1a4f,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:47.388593 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-08467ee2-1b0a-4c2a-a323-dc3578a331cb admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:47.388942 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.db.segments_db [None req-08467ee2-1b0a-4c2a-a323-dc3578a331cb admin admin] Added segment 71fc0c51-8d26-4812-8dcb-f2ed141a03d2 of type vlan for network 22bf7558-e572-4c3e-b191-f1edcd47c9f2 Sep 18 08:49:47.427973 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-08467ee2-1b0a-4c2a-a323-dc3578a331cb admin admin] Notify callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8732885226527'] for network, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:47.451242 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-08467ee2-1b0a-4c2a-a323-dc3578a331cb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385'] for network, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:47.452237 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-08467ee2-1b0a-4c2a-a323-dc3578a331cb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94346) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:47.453495 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-08467ee2-1b0a-4c2a-a323-dc3578a331cb admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:47.482249 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-08467ee2-1b0a-4c2a-a323-dc3578a331cb admin admin] 10.222.0.35 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.3435123 Sep 18 08:49:47.485333 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 37614) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:49:47.490260 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-d7981f66-b603-4b78-9aa5-42be13523a81 admin admin] Request body: {'subnet': {'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-468473020-subnet', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:49:47.510805 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d7981f66-b603-4b78-9aa5-42be13523a81 admin admin] Made reservation on behalf of 334211ea09044272868662e38cb1a4ad for: {'subnet': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:49:47.513159 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08467ee2-1b0a-4c2a-a323-dc3578a331cb admin admin] Pushing event updated for resources: {'Network': ['ID=22bf7558-e572-4c3e-b191-f1edcd47c9f2,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:47.513338 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d7981f66-b603-4b78-9aa5-42be13523a81 admin admin] Notify callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-13996252'] for subnet, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:47.523124 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Network 22bf7558-e572-4c3e-b191-f1edcd47c9f2 details requested by agent ovs-agent-dv-cinder-804470-6-iscsi with host dv-cinder-804470-6-iscsi {{(pid=94348) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Sep 18 08:49:47.679903 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device f64a2ad2-4079-4e29-8c07-3f9846a145a8 no longer exists at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:49:47.684710 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d7981f66-b603-4b78-9aa5-42be13523a81 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-15069167', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-13996274'] for subnet, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:47.704009 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-536c997d-2873-442a-81bf-9fe918803742 None None] No Port match for: f64a2ad2-4079-4e29-8c07-3f9846a145a8 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:49:47.704362 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device f64a2ad2-4079-4e29-8c07-3f9846a145a8 not bound to the agent host dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:49:47.704785 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device f6caa699-4d13-4268-b93e-c89e1dbaffb6 no longer exists at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:49:47.723563 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-536c997d-2873-442a-81bf-9fe918803742 None None] No Port match for: f6caa699-4d13-4268-b93e-c89e1dbaffb6 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:49:47.723917 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device f6caa699-4d13-4268-b93e-c89e1dbaffb6 not bound to the agent host dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:49:47.744091 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7981f66-b603-4b78-9aa5-42be13523a81 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e900aa03-4504-4ae5-a8a2-0da036634ce2,revision_number=0']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:47.753073 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7981f66-b603-4b78-9aa5-42be13523a81 admin admin] Checking segment: {'id': '71fc0c51-8d26-4812-8dcb-f2ed141a03d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 230, 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94347) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:49:47.753464 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7981f66-b603-4b78-9aa5-42be13523a81 admin admin] Network hostable DHCP agents. Network: 22bf7558-e572-4c3e-b191-f1edcd47c9f2, hostable agents: ['6aaa6222-6d04-44a7-b807-bfc2cbd3e99f'], hosted agents: [] {{(pid=94347) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Sep 18 08:49:47.769131 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d7981f66-b603-4b78-9aa5-42be13523a81 admin admin] Network 22bf7558-e572-4c3e-b191-f1edcd47c9f2 is scheduled to be hosted by DHCP agent 6aaa6222-6d04-44a7-b807-bfc2cbd3e99f with binding_index 1 {{(pid=94347) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Sep 18 08:49:47.776657 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [None req-d7981f66-b603-4b78-9aa5-42be13523a81 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-804470-6-iscsi, 22bf7558-e572-4c3e-b191-f1edcd47c9f2) {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:49:47.780575 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d7981f66-b603-4b78-9aa5-42be13523a81 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:47.781204 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d7981f66-b603-4b78-9aa5-42be13523a81 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for subnet, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:47.786723 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e0aaa392-701f-4dbc-b9ab-bcd7028839be None None] Network 22bf7558-e572-4c3e-b191-f1edcd47c9f2 requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:49:47.794681 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-d7981f66-b603-4b78-9aa5-42be13523a81 admin admin] 10.222.0.35 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.3082619 Sep 18 08:49:47.797959 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 37616) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:49:47.802146 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-79cba5ec-b92a-4b68-9771-827bafabe378 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-468473020-router', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:49:47.822438 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-79cba5ec-b92a-4b68-9771-827bafabe378 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-784001', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-2995'] for router, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:47.823516 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-79cba5ec-b92a-4b68-9771-827bafabe378 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-782353', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-784513', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-710924', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-2984'] for router, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:47.876634 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-79cba5ec-b92a-4b68-9771-827bafabe378 admin admin] Notify callbacks [] for router_controller, precommit_add_association {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:47.937963 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ca285673-c7ba-4e32-ba7c-a3960fdfe44f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp22fa9bf9-2738-5c16-87a3-3f58ee5e2dc2-22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'fixed_ips': [{'subnet_id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2'}]}} from dv-cinder-804470-6-iscsi. {{(pid=94348) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Sep 18 08:49:47.938923 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-ca285673-c7ba-4e32-ba7c-a3960fdfe44f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:48.024832 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-79cba5ec-b92a-4b68-9771-827bafabe378 admin admin] Notify callbacks [] for router_gateway, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:48.082539 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.db_base_plugin_common [None req-ca285673-c7ba-4e32-ba7c-a3960fdfe44f None None] Allocated IP 172.20.0.2 (22bf7558-e572-4c3e-b191-f1edcd47c9f2/e900aa03-4504-4ae5-a8a2-0da036634ce2/9da4beeb-9bbe-49ad-adc9-a7799514dc47) {{(pid=94348) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:49:48.231350 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-79cba5ec-b92a-4b68-9771-827bafabe378 admin admin] Notify callbacks [] for router_gateway, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:48.251179 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-79cba5ec-b92a-4b68-9771-827bafabe378 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:48.347584 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-ca285673-c7ba-4e32-ba7c-a3960fdfe44f None None] Notify callbacks [] for port, precommit_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:48.352057 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_common [None req-79cba5ec-b92a-4b68-9771-827bafabe378 admin admin] Allocated IP 172.27.1.100 (2e3b3f85-63e4-4380-917a-8c90c80b3e38/cd525bb9-7f93-490c-a5d6-a08911817e54/9456ac74-11c9-4299-be6b-0fdce79ecd45) {{(pid=94347) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:49:48.353808 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-ca285673-c7ba-4e32-ba7c-a3960fdfe44f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528'] for port, after_create {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:48.392098 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca285673-c7ba-4e32-ba7c-a3960fdfe44f None None] Network 22bf7558-e572-4c3e-b191-f1edcd47c9f2 is already hosted by enough agents. {{(pid=94348) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:49:48.395079 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.scheduler.base_scheduler [None req-ca285673-c7ba-4e32-ba7c-a3960fdfe44f None None] Resources bound (agent type, host, resource id): {{(pid=94348) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:49:48.400558 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ca285673-c7ba-4e32-ba7c-a3960fdfe44f None None] Received port after_create {{(pid=94348) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:49:48.408158 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca285673-c7ba-4e32-ba7c-a3960fdfe44f None None] Pushing event updated for resources: {'Port': ['ID=9da4beeb-9bbe-49ad-adc9-a7799514dc47,revision_number=1']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:48.458180 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-79cba5ec-b92a-4b68-9771-827bafabe378 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:48.458748 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-ca285673-c7ba-4e32-ba7c-a3960fdfe44f None None] Attempting to bind port 9da4beeb-9bbe-49ad-adc9-a7799514dc47 on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:49:48.459133 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-ca285673-c7ba-4e32-ba7c-a3960fdfe44f None None] Attempting to bind port 9da4beeb-9bbe-49ad-adc9-a7799514dc47 by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': '71fc0c51-8d26-4812-8dcb-f2ed141a03d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 230, 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2'}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:49:48.459500 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca285673-c7ba-4e32-ba7c-a3960fdfe44f None None] Attempting to bind port 9da4beeb-9bbe-49ad-adc9-a7799514dc47 on network 22bf7558-e572-4c3e-b191-f1edcd47c9f2 {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:49:48.464528 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca285673-c7ba-4e32-ba7c-a3960fdfe44f None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 49, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:49:48.464900 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca285673-c7ba-4e32-ba7c-a3960fdfe44f None None] Checking segment: {'id': '71fc0c51-8d26-4812-8dcb-f2ed141a03d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 230, 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94348) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:49:48.465339 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-ca285673-c7ba-4e32-ba7c-a3960fdfe44f None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:48.465760 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca285673-c7ba-4e32-ba7c-a3960fdfe44f None None] Bound using segment: {'id': '71fc0c51-8d26-4812-8dcb-f2ed141a03d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 230, 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2'} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:49:48.466219 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-ca285673-c7ba-4e32-ba7c-a3960fdfe44f None None] Bound port: 9da4beeb-9bbe-49ad-adc9-a7799514dc47, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71fc0c51-8d26-4812-8dcb-f2ed141a03d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 230, 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2'}}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:49:48.466596 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-ca285673-c7ba-4e32-ba7c-a3960fdfe44f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:48.491087 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-79cba5ec-b92a-4b68-9771-827bafabe378 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:48.525810 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-79cba5ec-b92a-4b68-9771-827bafabe378 admin admin] Network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:49:48.528067 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-ca285673-c7ba-4e32-ba7c-a3960fdfe44f None None] For port 9da4beeb-9bbe-49ad-adc9-a7799514dc47, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94348) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:49:48.528555 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [None req-79cba5ec-b92a-4b68-9771-827bafabe378 admin admin] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:49:48.531852 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-ca285673-c7ba-4e32-ba7c-a3960fdfe44f None None] For port 9da4beeb-9bbe-49ad-adc9-a7799514dc47, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=9da4beeb-9bbe-49ad-adc9-a7799514dc47,segment=NetworkSegment(71fc0c51-8d26-4812-8dcb-f2ed141a03d2),segment_id=71fc0c51-8d26-4812-8dcb-f2ed141a03d2)] {{(pid=94348) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:49:48.532638 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79cba5ec-b92a-4b68-9771-827bafabe378 admin admin] Received port after_create {{(pid=94347) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:49:48.536525 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-ca285673-c7ba-4e32-ba7c-a3960fdfe44f None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:48.559235 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79cba5ec-b92a-4b68-9771-827bafabe378 admin admin] Pushing event updated for resources: {'Port': ['ID=9456ac74-11c9-4299-be6b-0fdce79ecd45,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:48.598988 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca285673-c7ba-4e32-ba7c-a3960fdfe44f None None] Pushing event updated for resources: {'Port': ['ID=9da4beeb-9bbe-49ad-adc9-a7799514dc47,revision_number=2']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:48.700568 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:49:48.802406 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-79cba5ec-b92a-4b68-9771-827bafabe378 admin admin] Notify callbacks [] for router_gateway, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:48.991017 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-79cba5ec-b92a-4b68-9771-827bafabe378 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-782366', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-784982'] for router, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:49.114499 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-79cba5ec-b92a-4b68-9771-827bafabe378 admin admin] Router 7ffeaad5-a677-409b-ba64-09886084c459 is scheduled to L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a with binding_index 1 {{(pid=94347) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Sep 18 08:49:49.218809 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-79cba5ec-b92a-4b68-9771-827bafabe378 admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94347) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:49:49.228208 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] Sync routers for ids ['7ffeaad5-a677-409b-ba64-09886084c459'] in dv-cinder-804470-6-iscsi {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:49:49.236961 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-79cba5ec-b92a-4b68-9771-827bafabe378 admin admin] Notify callbacks [] for router, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:49.238528 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-79cba5ec-b92a-4b68-9771-827bafabe378 admin admin] 10.222.0.35 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 1.4395883 Sep 18 08:49:49.240308 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] Routers {'7ffeaad5-a677-409b-ba64-09886084c459'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:49:49.241009 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:49:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['7ffeaad5-a677-409b-ba64-09886084c459'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:49:49.241279 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 37618) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:49:49.352584 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] Set router 7ffeaad5-a677-409b-ba64-09886084c459 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:49:49.480620 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8139da30-d59d-4f14-b28a-e57033543a48 None None] Network 22bf7558-e572-4c3e-b191-f1edcd47c9f2 requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:49:49.537739 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ffeaad5-a677-409b-ba64-09886084c459', 'name': 'tempest-AttachVolumeTestJSON-468473020-router', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100'}], 'enable_snat': True}, 'gw_port_id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:49:47Z', 'updated_at': '2021-09-18T08:49:48Z', 'revision_number': 3, 'project_id': '334211ea09044272868662e38cb1a4ad', 'gw_port': {'id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:06:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:48Z', 'updated_at': '2021-09-18T08:49:48Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:49:49.560394 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fb75bb9f-a863-4f96-92cf-3c71e0c17997 None None] Provisioning complete for port 9da4beeb-9bbe-49ad-adc9-a7799514dc47 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:49:49.560982 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fb75bb9f-a863-4f96-92cf-3c71e0c17997 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:49.569618 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] Checking router: 7ffeaad5-a677-409b-ba64-09886084c459 for host: dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:49:49.570059 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] Updating router 7ffeaad5-a677-409b-ba64-09886084c459 port 9456ac74-11c9-4299-be6b-0fdce79ecd45 binding host dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 18 08:49:49.596122 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:49.653397 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-05190afa-0f26-4562-9238-d40ed6c93556 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:49.667288 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0f47c6af-3843-4c0c-aaf3-1c9bf8362d34 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:49.724671 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fb75bb9f-a863-4f96-92cf-3c71e0c17997 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:49.763374 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fb75bb9f-a863-4f96-92cf-3c71e0c17997 None None] For port 9da4beeb-9bbe-49ad-adc9-a7799514dc47, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=9da4beeb-9bbe-49ad-adc9-a7799514dc47,segment=NetworkSegment(71fc0c51-8d26-4812-8dcb-f2ed141a03d2),segment_id=71fc0c51-8d26-4812-8dcb-f2ed141a03d2)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:49:49.774687 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fb75bb9f-a863-4f96-92cf-3c71e0c17997 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:49.786470 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 9da4beeb-9bbe-49ad-adc9-a7799514dc47 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:49:49.858228 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_common [None req-0f47c6af-3843-4c0c-aaf3-1c9bf8362d34 admin admin] Allocated IP 172.20.0.1 (22bf7558-e572-4c3e-b191-f1edcd47c9f2/e900aa03-4504-4ae5-a8a2-0da036634ce2/e79b2742-d588-4bec-bf32-881880841c60) {{(pid=94346) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:49:49.865599 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb75bb9f-a863-4f96-92cf-3c71e0c17997 None None] Pushing event updated for resources: {'Port': ['ID=9da4beeb-9bbe-49ad-adc9-a7799514dc47,revision_number=3']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:49.882256 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 9da4beeb-9bbe-49ad-adc9-a7799514dc47 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:49:49.882773 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:49.924113 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] Notify callbacks [] for port, precommit_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:49.930530 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:49.987309 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0f47c6af-3843-4c0c-aaf3-1c9bf8362d34 admin admin] Notify callbacks [] for port, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:49.990454 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bea50335-fc25-4ef6-ac79-00a417b00756 None None] Pushing event updated for resources: {'Port': ['ID=9456ac74-11c9-4299-be6b-0fdce79ecd45,revision_number=2']} {{(pid=94349) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:49.998546 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] Attempting to bind port 9456ac74-11c9-4299-be6b-0fdce79ecd45 on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:49:49.999147 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] Attempting to bind port 9456ac74-11c9-4299-be6b-0fdce79ecd45 by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}] {{(pid=94349) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:49:49.999771 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] Attempting to bind port 9456ac74-11c9-4299-be6b-0fdce79ecd45 on network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:49:50.003545 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea50335-fc25-4ef6-ac79-00a417b00756 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:50.004160 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea50335-fc25-4ef6-ac79-00a417b00756 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:50.004866 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea50335-fc25-4ef6-ac79-00a417b00756 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:50.005467 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea50335-fc25-4ef6-ac79-00a417b00756 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:50.006020 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea50335-fc25-4ef6-ac79-00a417b00756 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:50.006587 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea50335-fc25-4ef6-ac79-00a417b00756 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:50.007133 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea50335-fc25-4ef6-ac79-00a417b00756 None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:50.007690 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea50335-fc25-4ef6-ac79-00a417b00756 None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:50.008895 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-c095d7b2-0ae6-4e4d-9a61-cbb00194cdd9 None None] Provisioning complete for port 9da4beeb-9bbe-49ad-adc9-a7799514dc47 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:49:50.009043 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea50335-fc25-4ef6-ac79-00a417b00756 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:50.009260 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea50335-fc25-4ef6-ac79-00a417b00756 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:50.009394 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-c095d7b2-0ae6-4e4d-9a61-cbb00194cdd9 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:50.009861 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea50335-fc25-4ef6-ac79-00a417b00756 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:50.010196 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bea50335-fc25-4ef6-ac79-00a417b00756 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94349) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:50.016494 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 49, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:49:50.016871 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] Checking segment: {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94349) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:49:50.017301 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:50.017873 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] Bound using segment: {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'} {{(pid=94349) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:49:50.018518 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.managers [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] Bound port: 9456ac74-11c9-4299-be6b-0fdce79ecd45, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0878b5b4-f4d3-4abd-a0e1-57da5a8e486c', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}}] {{(pid=94349) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:49:50.018920 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:50.031442 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0f47c6af-3843-4c0c-aaf3-1c9bf8362d34 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:50.066327 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f47c6af-3843-4c0c-aaf3-1c9bf8362d34 admin admin] Network 22bf7558-e572-4c3e-b191-f1edcd47c9f2 is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:49:50.071274 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.db [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] For port 9456ac74-11c9-4299-be6b-0fdce79ecd45, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94349) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:49:50.071412 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-0f47c6af-3843-4c0c-aaf3-1c9bf8362d34 admin admin] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:49:50.074265 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f47c6af-3843-4c0c-aaf3-1c9bf8362d34 admin admin] Received port after_create {{(pid=94346) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:49:50.074562 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.plugins.ml2.db [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] For port 9456ac74-11c9-4299-be6b-0fdce79ecd45, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=9456ac74-11c9-4299-be6b-0fdce79ecd45,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94349) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:49:50.081895 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron_lib.callbacks.manager [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94349) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:50.123070 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:50.143603 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bea50335-fc25-4ef6-ac79-00a417b00756 None None] Pushing event updated for resources: {'Port': ['ID=9456ac74-11c9-4299-be6b-0fdce79ecd45,revision_number=3']} {{(pid=94349) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:50.152802 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] Routers {'7ffeaad5-a677-409b-ba64-09886084c459'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:49:50.153263 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:49:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['7ffeaad5-a677-409b-ba64-09886084c459'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:49:50.311594 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-8ef2679d-924b-41b6-a0ef-259cd3da25ec None None] Provisioning complete for port e79b2742-d588-4bec-bf32-881880841c60 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:49:50.311970 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-8ef2679d-924b-41b6-a0ef-259cd3da25ec None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:50.348379 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f47c6af-3843-4c0c-aaf3-1c9bf8362d34 admin admin] Pushing event updated for resources: {'Port': ['ID=e79b2742-d588-4bec-bf32-881880841c60,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:50.351039 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-8ef2679d-924b-41b6-a0ef-259cd3da25ec None None] Port e79b2742-d588-4bec-bf32-881880841c60 cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:49:50.362665 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] Set router 7ffeaad5-a677-409b-ba64-09886084c459 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:49:50.363205 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0f47c6af-3843-4c0c-aaf3-1c9bf8362d34 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-785025'] for router_interface, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:50.488927 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0f47c6af-3843-4c0c-aaf3-1c9bf8362d34 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:50.541867 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ffeaad5-a677-409b-ba64-09886084c459', 'name': 'tempest-AttachVolumeTestJSON-468473020-router', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100'}], 'enable_snat': True}, 'gw_port_id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:49:47Z', 'updated_at': '2021-09-18T08:49:48Z', 'revision_number': 3, 'project_id': '334211ea09044272868662e38cb1a4ad', 'gw_port': {'id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:06:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:48Z', 'updated_at': '2021-09-18T08:49:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:49:50.567912 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9aaf795b-43f9-4c93-a647-e02bf7eef74d None None] The sync data for ids ['7ffeaad5-a677-409b-ba64-09886084c459'] in dv-cinder-804470-6-iscsi is: [{'id': '7ffeaad5-a677-409b-ba64-09886084c459', 'name': 'tempest-AttachVolumeTestJSON-468473020-router', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100'}], 'enable_snat': True}, 'gw_port_id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:49:47Z', 'updated_at': '2021-09-18T08:49:48Z', 'revision_number': 3, 'project_id': '334211ea09044272868662e38cb1a4ad', 'gw_port': {'id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:06:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:48Z', 'updated_at': '2021-09-18T08:49:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}] {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:49:50.651757 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0f47c6af-3843-4c0c-aaf3-1c9bf8362d34 admin admin] Notify callbacks [] for port, precommit_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:50.656881 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0f47c6af-3843-4c0c-aaf3-1c9bf8362d34 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14290155'] for port, after_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:50.722268 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0f47c6af-3843-4c0c-aaf3-1c9bf8362d34 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-580051', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-783377'] for router_interface, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:50.723992 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f47c6af-3843-4c0c-aaf3-1c9bf8362d34 admin admin] Pushing event updated for resources: {'Port': ['ID=e79b2742-d588-4bec-bf32-881880841c60,revision_number=2']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:50.827365 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0f47c6af-3843-4c0c-aaf3-1c9bf8362d34 admin admin] Network 22bf7558-e572-4c3e-b191-f1edcd47c9f2 is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:49:50.828845 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-0f47c6af-3843-4c0c-aaf3-1c9bf8362d34 admin admin] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:49:50.950133 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0f47c6af-3843-4c0c-aaf3-1c9bf8362d34 admin admin] Router 7ffeaad5-a677-409b-ba64-09886084c459 has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94346) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:49:51.066316 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0f47c6af-3843-4c0c-aaf3-1c9bf8362d34 admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94346) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:49:51.071484 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-0f47c6af-3843-4c0c-aaf3-1c9bf8362d34 admin admin] 10.222.0.35 "PUT /v2.0/routers/7ffeaad5-a677-409b-ba64-09886084c459/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8291717 Sep 18 08:49:51.074241 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-61534a9d-548b-47ff-8efb-8b0a0602eef5 None None] Provisioning complete for port e79b2742-d588-4bec-bf32-881880841c60 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:49:51.074764 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-61534a9d-548b-47ff-8efb-8b0a0602eef5 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:51.111610 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-61534a9d-548b-47ff-8efb-8b0a0602eef5 None None] Port e79b2742-d588-4bec-bf32-881880841c60 cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:49:51.753566 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 9da4beeb-9bbe-49ad-adc9-a7799514dc47 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:49:51.799633 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 9da4beeb-9bbe-49ad-adc9-a7799514dc47 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:49:51.799922 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:51.879753 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 9456ac74-11c9-4299-be6b-0fdce79ecd45 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:49:51.925141 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 9456ac74-11c9-4299-be6b-0fdce79ecd45 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:49:51.925546 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:51.991732 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] Sync routers for ids ['7ffeaad5-a677-409b-ba64-09886084c459'] in dv-cinder-804470-6-iscsi {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:49:52.011142 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] Routers {'7ffeaad5-a677-409b-ba64-09886084c459'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:49:52.011763 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:49:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['7ffeaad5-a677-409b-ba64-09886084c459'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:49:52.016300 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:52.073159 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-536c997d-2873-442a-81bf-9fe918803742 None None] For port 9456ac74-11c9-4299-be6b-0fdce79ecd45, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=9456ac74-11c9-4299-be6b-0fdce79ecd45,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:49:52.080815 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:52.168210 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] Set router 7ffeaad5-a677-409b-ba64-09886084c459 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:49:52.195546 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Pushing event updated for resources: {'Port': ['ID=9456ac74-11c9-4299-be6b-0fdce79ecd45,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:52.361615 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ffeaad5-a677-409b-ba64-09886084c459', 'name': 'tempest-AttachVolumeTestJSON-468473020-router', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100'}], 'enable_snat': True}, 'gw_port_id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:49:47Z', 'updated_at': '2021-09-18T08:49:50Z', 'revision_number': 4, 'project_id': '334211ea09044272868662e38cb1a4ad', 'gw_port': {'id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:06:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:48Z', 'updated_at': '2021-09-18T08:49:50Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': 'e79b2742-d588-4bec-bf32-881880841c60', 'name': '', 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'mac_address': 'fa:16:3e:cc:93:14', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_interface', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:49Z', 'updated_at': '2021-09-18T08:49:50Z', 'revision_number': 2, 'project_id': '334211ea09044272868662e38cb1a4ad', 'subnets': [{'id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:49:52.393192 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] Checking router: 7ffeaad5-a677-409b-ba64-09886084c459 for host: dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:49:52.393568 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] Updating router 7ffeaad5-a677-409b-ba64-09886084c459 port e79b2742-d588-4bec-bf32-881880841c60 binding host dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Sep 18 08:49:52.423052 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-bc48672e-88a4-4e07-8ed4-30a19322b53e None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:52.426595 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:52.606306 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 37630) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:49:52.611906 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-0afd4a96-3c95-461f-aba1-ac8768b7b8e5 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Request body: {'security_group': {'name': 'tempest-securitygroup--789608944', 'description': 'tempest-description--1052165452'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:49:52.635736 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0afd4a96-3c95-461f-aba1-ac8768b7b8e5 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:52.682611 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] Notify callbacks [] for port, precommit_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:52.687619 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:52.715399 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0afd4a96-3c95-461f-aba1-ac8768b7b8e5 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:52.727762 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0afd4a96-3c95-461f-aba1-ac8768b7b8e5 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:52.749428 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-161250fd-89b5-49af-940c-03a117999f85 None None] Pushing event updated for resources: {'Port': ['ID=e79b2742-d588-4bec-bf32-881880841c60,revision_number=3']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:52.758740 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0afd4a96-3c95-461f-aba1-ac8768b7b8e5 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a837ba65-24c1-4c3f-944f-fdf03428d219,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:52.762730 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0afd4a96-3c95-461f-aba1-ac8768b7b8e5 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:52.764241 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-0afd4a96-3c95-461f-aba1-ac8768b7b8e5 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1779 time: 0.1564896 Sep 18 08:49:52.767358 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 37632) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:49:52.772063 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-d7360720-fadc-49fc-ae41-bd0982a5acb2 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Request body: {'security_group_rule': {'security_group_id': 'a837ba65-24c1-4c3f-944f-fdf03428d219', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:49:52.797907 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] Attempting to bind port e79b2742-d588-4bec-bf32-881880841c60 on host dv-cinder-804470-6-iscsi for vnic_type normal with profile {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:49:52.798403 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] Attempting to bind port e79b2742-d588-4bec-bf32-881880841c60 by drivers openvswitch,hyperv on host dv-cinder-804470-6-iscsi at level 0 using segments [{'id': '71fc0c51-8d26-4812-8dcb-f2ed141a03d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 230, 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2'}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:49:52.798885 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] Attempting to bind port e79b2742-d588-4bec-bf32-881880841c60 on network 22bf7558-e572-4c3e-b191-f1edcd47c9f2 {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:49:52.802639 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d7360720-fadc-49fc-ae41-bd0982a5acb2 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:52.804467 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] Checking agent: {'id': 'd9994522-1d9c-4774-b1bb-7ae71fed03c4', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-804470-6-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 30, 23), 'started_at': datetime.datetime(2021, 9, 18, 8, 30, 53), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 49, 23), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-804470-6-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.9', 'SecurityGroup': '1.4', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:49:52.805115 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] Checking segment: {'id': '71fc0c51-8d26-4812-8dcb-f2ed141a03d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 230, 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94348) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:49:52.805648 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] Notify callbacks [] for ovs_bridge_name, before_read {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:52.806732 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] Bound using segment: {'id': '71fc0c51-8d26-4812-8dcb-f2ed141a03d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 230, 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2'} {{(pid=94348) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:49:52.807446 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.managers [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] Bound port: e79b2742-d588-4bec-bf32-881880841c60, host: dv-cinder-804470-6-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '71fc0c51-8d26-4812-8dcb-f2ed141a03d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 230, 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2'}}] {{(pid=94348) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:49:52.807930 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:52.862056 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d7360720-fadc-49fc-ae41-bd0982a5acb2 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:52.867961 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d7360720-fadc-49fc-ae41-bd0982a5acb2 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-561193'] for security_group_rule, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:52.879280 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] For port e79b2742-d588-4bec-bf32-881880841c60, host dv-cinder-804470-6-iscsi, cleared binding levels {{(pid=94348) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:49:52.882779 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] For port e79b2742-d588-4bec-bf32-881880841c60, host dv-cinder-804470-6-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=e79b2742-d588-4bec-bf32-881880841c60,segment=NetworkSegment(71fc0c51-8d26-4812-8dcb-f2ed141a03d2),segment_id=71fc0c51-8d26-4812-8dcb-f2ed141a03d2)] {{(pid=94348) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:49:52.887062 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:52.891917 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7360720-fadc-49fc-ae41-bd0982a5acb2 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=54714c84-0a44-466b-a592-8f432292d39f,revision_number=0']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:52.899026 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d7360720-fadc-49fc-ae41-bd0982a5acb2 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:52.903441 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 37634) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:49:52.903944 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-d7360720-fadc-49fc-ae41-bd0982a5acb2 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1351469 Sep 18 08:49:52.909548 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-c66769f1-6da8-42c9-b81a-a9d821af6d43 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Request body: {'security_group_rule': {'security_group_id': 'a837ba65-24c1-4c3f-944f-fdf03428d219', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:49:52.939905 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c66769f1-6da8-42c9-b81a-a9d821af6d43 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:52.959359 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] Routers {'7ffeaad5-a677-409b-ba64-09886084c459'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:49:52.959999 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:49:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['7ffeaad5-a677-409b-ba64-09886084c459'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:49:52.963355 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-161250fd-89b5-49af-940c-03a117999f85 None None] Pushing event updated for resources: {'Port': ['ID=e79b2742-d588-4bec-bf32-881880841c60,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:53.002229 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-edd0c4f3-13ea-4d55-af20-d1c308bc08a1 None None] Provisioning complete for port e79b2742-d588-4bec-bf32-881880841c60 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:49:53.002608 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-edd0c4f3-13ea-4d55-af20-d1c308bc08a1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:53.018811 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c66769f1-6da8-42c9-b81a-a9d821af6d43 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:53.023737 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c66769f1-6da8-42c9-b81a-a9d821af6d43 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-561193'] for security_group_rule, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:53.040911 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c66769f1-6da8-42c9-b81a-a9d821af6d43 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0d0c64ed-bb69-4437-9993-03fd83bf789c,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:53.053968 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c66769f1-6da8-42c9-b81a-a9d821af6d43 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:53.057703 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-c66769f1-6da8-42c9-b81a-a9d821af6d43 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1522565 Sep 18 08:49:53.058787 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 37636) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:49:53.063978 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-0961ed1c-89fe-4449-af29-b0ed93415564 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Request body: {'floatingip': {'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:49:53.089561 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0961ed1c-89fe-4449-af29-b0ed93415564 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for floatingip, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:53.192983 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0961ed1c-89fe-4449-af29-b0ed93415564 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:53.232664 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] Set router 7ffeaad5-a677-409b-ba64-09886084c459 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:49:53.263449 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:53.296865 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_common [None req-0961ed1c-89fe-4449-af29-b0ed93415564 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Allocated IP 172.27.1.193 (2e3b3f85-63e4-4380-917a-8c90c80b3e38/cd525bb9-7f93-490c-a5d6-a08911817e54/4209ba4a-e53b-40f7-b948-c57ab17f83cb) {{(pid=94346) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:49:53.335252 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-edd0c4f3-13ea-4d55-af20-d1c308bc08a1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:53.400955 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0961ed1c-89fe-4449-af29-b0ed93415564 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for port, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:53.428783 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-edd0c4f3-13ea-4d55-af20-d1c308bc08a1 None None] For port e79b2742-d588-4bec-bf32-881880841c60, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=e79b2742-d588-4bec-bf32-881880841c60,segment=NetworkSegment(71fc0c51-8d26-4812-8dcb-f2ed141a03d2),segment_id=71fc0c51-8d26-4812-8dcb-f2ed141a03d2)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:49:53.431233 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:53.433823 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-edd0c4f3-13ea-4d55-af20-d1c308bc08a1 None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:53.434402 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0961ed1c-89fe-4449-af29-b0ed93415564 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:53.472023 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0961ed1c-89fe-4449-af29-b0ed93415564 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:49:53.478336 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-0961ed1c-89fe-4449-af29-b0ed93415564 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:49:53.480788 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0961ed1c-89fe-4449-af29-b0ed93415564 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Received port after_create {{(pid=94346) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:49:53.487750 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0961ed1c-89fe-4449-af29-b0ed93415564 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Pushing event updated for resources: {'Port': ['ID=4209ba4a-e53b-40f7-b948-c57ab17f83cb,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:53.516820 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edd0c4f3-13ea-4d55-af20-d1c308bc08a1 None None] Pushing event updated for resources: {'Port': ['ID=e79b2742-d588-4bec-bf32-881880841c60,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:53.539805 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ffeaad5-a677-409b-ba64-09886084c459', 'name': 'tempest-AttachVolumeTestJSON-468473020-router', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100'}], 'enable_snat': True}, 'gw_port_id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:49:47Z', 'updated_at': '2021-09-18T08:49:50Z', 'revision_number': 4, 'project_id': '334211ea09044272868662e38cb1a4ad', 'gw_port': {'id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:06:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:48Z', 'updated_at': '2021-09-18T08:49:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': 'e79b2742-d588-4bec-bf32-881880841c60', 'name': '', 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'mac_address': 'fa:16:3e:cc:93:14', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_interface', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:49Z', 'updated_at': '2021-09-18T08:49:52Z', 'revision_number': 4, 'project_id': '334211ea09044272868662e38cb1a4ad', 'subnets': [{'id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:49:53.569045 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0961ed1c-89fe-4449-af29-b0ed93415564 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for floatingip, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:53.570956 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d40be7f3-8f82-4ad3-aeca-1a16a91f3bf4 None None] The sync data for ids ['7ffeaad5-a677-409b-ba64-09886084c459'] in dv-cinder-804470-6-iscsi is: [{'id': '7ffeaad5-a677-409b-ba64-09886084c459', 'name': 'tempest-AttachVolumeTestJSON-468473020-router', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100'}], 'enable_snat': True}, 'gw_port_id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:49:47Z', 'updated_at': '2021-09-18T08:49:50Z', 'revision_number': 4, 'project_id': '334211ea09044272868662e38cb1a4ad', 'gw_port': {'id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:06:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:48Z', 'updated_at': '2021-09-18T08:49:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': 'e79b2742-d588-4bec-bf32-881880841c60', 'name': '', 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'mac_address': 'fa:16:3e:cc:93:14', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_interface', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:49Z', 'updated_at': '2021-09-18T08:49:52Z', 'revision_number': 4, 'project_id': '334211ea09044272868662e38cb1a4ad', 'subnets': [{'id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:49:53.578755 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-8f060724-ba88-45f9-8a3c-84698550131c None None] Provisioning complete for port e79b2742-d588-4bec-bf32-881880841c60 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:49:53.579082 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-8f060724-ba88-45f9-8a3c-84698550131c None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:53.612770 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0961ed1c-89fe-4449-af29-b0ed93415564 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:53.793595 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0961ed1c-89fe-4449-af29-b0ed93415564 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for port, precommit_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:53.799588 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0961ed1c-89fe-4449-af29-b0ed93415564 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14290155'] for port, after_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:53.832211 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 9456ac74-11c9-4299-be6b-0fdce79ecd45 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:49:53.870850 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0961ed1c-89fe-4449-af29-b0ed93415564 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Pushing event updated for resources: {'Port': ['ID=4209ba4a-e53b-40f7-b948-c57ab17f83cb,revision_number=2']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:53.883753 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port 9456ac74-11c9-4299-be6b-0fdce79ecd45 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:49:53.884137 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:53.887209 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0961ed1c-89fe-4449-af29-b0ed93415564 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-784908'] for floatingip, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:53.901928 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-0961ed1c-89fe-4449-af29-b0ed93415564 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for floatingip, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:53.903142 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-0961ed1c-89fe-4449-af29-b0ed93415564 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 0.8433094 Sep 18 08:49:53.977429 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device e79b2742-d588-4bec-bf32-881880841c60 up at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:49:54.040862 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Provisioning complete for port e79b2742-d588-4bec-bf32-881880841c60 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:49:54.041519 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:54.066770 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-27508b90-240c-4699-b954-4280db0bed20 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?name=tempest-securitygroup--789608944&fields=id&tenant_id=334211ea09044272868662e38cb1a4ad HTTP/1.1" status: 200 len: 267 time: 0.0371113 Sep 18 08:49:54.175513 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-316f31db-4e25-4630-b575-b35cd9c96c17 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:54.177066 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-316f31db-4e25-4630-b575-b35cd9c96c17 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/networks?id=22bf7558-e572-4c3e-b191-f1edcd47c9f2 HTTP/1.1" status: 200 len: 810 time: 0.1036658 Sep 18 08:49:54.192348 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-32f694dc-197d-4c21-a4a8-da524548e8fd tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/quotas/334211ea09044272868662e38cb1a4ad HTTP/1.1" status: 200 len: 375 time: 0.0094957 Sep 18 08:49:54.246894 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-59b3d57a-b13f-4455-90de-5703ac1efd61 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?tenant_id=334211ea09044272868662e38cb1a4ad&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0485880 Sep 18 08:49:54.262415 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-9e3523e8-2a43-4e1b-8e39-26ebaaa2ce50 service neutron] http://10.222.0.35:9696/v2.0/extensions returned with HTTP 200 {{(pid=94347) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Sep 18 08:49:54.263417 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-9e3523e8-2a43-4e1b-8e39-26ebaaa2ce50 service neutron] 10.222.0.35 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13640 time: 0.0053194 Sep 18 08:49:54.358283 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-a61b9df2-c954-4660-ad28-b5daf0e2635f service neutron] 10.222.0.35 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0886359 Sep 18 08:49:54.453162 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-48249429-35db-443a-8046-94ac7382d881 service neutron] 10.222.0.35 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0876431 Sep 18 08:49:54.616729 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-93636421-d8d8-4554-833f-87dd4b24fa48 req-0c715936-428c-4904-ae05-b446bc9d5da2 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 210 time: 0.0285103 Sep 18 08:49:54.897654 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:55.722333 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-12703662-dff2-4aa0-bce9-a22e7808fcbf req-6b8401f0-992f-4a19-b2c7-63d76f7dd92d tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 210 time: 0.0352139 Sep 18 08:49:55.738460 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-b6e5ac6e-047d-417f-a0d5-797fa26dbaef tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:55.740010 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-b6e5ac6e-047d-417f-a0d5-797fa26dbaef tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.13 "GET /v2.0/networks?id=22bf7558-e572-4c3e-b191-f1edcd47c9f2 HTTP/1.1" status: 200 len: 810 time: 0.1301327 Sep 18 08:49:56.048336 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-2806f201-bb24-440f-b5e2-ad797258fa0e tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.13 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=334211ea09044272868662e38cb1a4ad HTTP/1.1" status: 200 len: 379 time: 0.2903526 Sep 18 08:49:56.057645 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-161fb264-c615-441b-8d28-ef58ad10968b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Request body: {'port': {'device_id': '72f4dadd-ae4c-4dab-ae73-75174398ef1e', 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'admin_state_up': True, 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'security_groups': ['a837ba65-24c1-4c3f-944f-fdf03428d219']}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:49:56.160320 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-161fb264-c615-441b-8d28-ef58ad10968b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Made reservation on behalf of 334211ea09044272868662e38cb1a4ad for: {'port': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:49:56.163989 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-161fb264-c615-441b-8d28-ef58ad10968b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:56.286269 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_common [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-161fb264-c615-441b-8d28-ef58ad10968b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Allocated IP 172.20.0.3 (22bf7558-e572-4c3e-b191-f1edcd47c9f2/e900aa03-4504-4ae5-a8a2-0da036634ce2/17c68a27-b17a-499d-9bde-484199d59ae2) {{(pid=94347) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:49:56.423256 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-161fb264-c615-441b-8d28-ef58ad10968b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for port, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:56.455362 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-161fb264-c615-441b-8d28-ef58ad10968b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:56.496779 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-161fb264-c615-441b-8d28-ef58ad10968b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Network 22bf7558-e572-4c3e-b191-f1edcd47c9f2 is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:49:56.499838 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-161fb264-c615-441b-8d28-ef58ad10968b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:49:56.506102 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-161fb264-c615-441b-8d28-ef58ad10968b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Received port after_create {{(pid=94347) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:49:56.512590 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-161fb264-c615-441b-8d28-ef58ad10968b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Pushing event updated for resources: {'Port': ['ID=17c68a27-b17a-499d-9bde-484199d59ae2,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:56.538895 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-161fb264-c615-441b-8d28-ef58ad10968b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:56.539304 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-161fb264-c615-441b-8d28-ef58ad10968b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:56.539613 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-161fb264-c615-441b-8d28-ef58ad10968b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:56.540024 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-161fb264-c615-441b-8d28-ef58ad10968b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:56.540314 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-161fb264-c615-441b-8d28-ef58ad10968b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:56.540721 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-161fb264-c615-441b-8d28-ef58ad10968b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:56.541103 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-161fb264-c615-441b-8d28-ef58ad10968b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:56.541465 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-161fb264-c615-441b-8d28-ef58ad10968b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:56.541802 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-161fb264-c615-441b-8d28-ef58ad10968b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:56.542134 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-161fb264-c615-441b-8d28-ef58ad10968b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:56.542466 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-161fb264-c615-441b-8d28-ef58ad10968b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:56.542793 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-161fb264-c615-441b-8d28-ef58ad10968b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:49:56.571827 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-161fb264-c615-441b-8d28-ef58ad10968b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:56.572521 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-161fb264-c615-441b-8d28-ef58ad10968b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:56.587093 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-161fb264-c615-441b-8d28-ef58ad10968b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5328670 Sep 18 08:49:56.605553 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-14a6569c-01af-4928-9d22-5a58fb3e3dd8 service neutron] Request body: {'port': {'device_id': '72f4dadd-ae4c-4dab-ae73-75174398ef1e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80447'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:49:56.664101 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-14a6569c-01af-4928-9d22-5a58fb3e3dd8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:56.727754 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-9f96cdf4-c0bd-49f8-8142-96e2d07d6f91 None None] Provisioning complete for port 17c68a27-b17a-499d-9bde-484199d59ae2 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:49:56.728313 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-9f96cdf4-c0bd-49f8-8142-96e2d07d6f91 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:56.764868 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-9f96cdf4-c0bd-49f8-8142-96e2d07d6f91 None None] Port 17c68a27-b17a-499d-9bde-484199d59ae2 cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:49:56.884888 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfc38221-13c7-4872-b18d-74a347728cfc req-6aa86369-35bb-4361-b71c-00082f5c7e2d tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:56.886435 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dfc38221-13c7-4872-b18d-74a347728cfc req-6aa86369-35bb-4361-b71c-00082f5c7e2d tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 931 time: 0.0911641 Sep 18 08:49:56.952446 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-dfc38221-13c7-4872-b18d-74a347728cfc req-2ede2d57-f021-48c2-bfe2-ef8c3b34815c tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0576274 Sep 18 08:49:56.985785 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-14a6569c-01af-4928-9d22-5a58fb3e3dd8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 17c68a27-b17a-499d-9bde-484199d59ae2 {{(pid=94347) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:49:56.992983 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-14a6569c-01af-4928-9d22-5a58fb3e3dd8 service neutron] Notify callbacks [] for port, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:57.004670 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.provisioning_blocks [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-14a6569c-01af-4928-9d22-5a58fb3e3dd8 service neutron] Transition to ACTIVE for port object 17c68a27-b17a-499d-9bde-484199d59ae2 will not be triggered until provisioned by entity L2. {{(pid=94347) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 18 08:49:57.009067 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-14a6569c-01af-4928-9d22-5a58fb3e3dd8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:57.056577 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14a6569c-01af-4928-9d22-5a58fb3e3dd8 service neutron] Pushing event updated for resources: {'Port': ['ID=17c68a27-b17a-499d-9bde-484199d59ae2,revision_number=2']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:57.125940 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-14a6569c-01af-4928-9d22-5a58fb3e3dd8 service neutron] Attempting to bind port 17c68a27-b17a-499d-9bde-484199d59ae2 on host hv-cinder-80447 for vnic_type normal with profile {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:49:57.126276 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-14a6569c-01af-4928-9d22-5a58fb3e3dd8 service neutron] Attempting to bind port 17c68a27-b17a-499d-9bde-484199d59ae2 by drivers openvswitch,hyperv on host hv-cinder-80447 at level 0 using segments [{'id': '71fc0c51-8d26-4812-8dcb-f2ed141a03d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 230, 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2'}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:49:57.126604 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-14a6569c-01af-4928-9d22-5a58fb3e3dd8 service neutron] Attempting to bind port 17c68a27-b17a-499d-9bde-484199d59ae2 on network 22bf7558-e572-4c3e-b191-f1edcd47c9f2 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:49:57.131486 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-14a6569c-01af-4928-9d22-5a58fb3e3dd8 service neutron] Port 17c68a27-b17a-499d-9bde-484199d59ae2 on network 22bf7558-e572-4c3e-b191-f1edcd47c9f2 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80447 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 18 08:49:57.131814 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-14a6569c-01af-4928-9d22-5a58fb3e3dd8 service neutron] Attempting to bind port 17c68a27-b17a-499d-9bde-484199d59ae2 on network 22bf7558-e572-4c3e-b191-f1edcd47c9f2 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:49:57.137398 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-14a6569c-01af-4928-9d22-5a58fb3e3dd8 service neutron] Checking agent: {'id': '8d51fdc4-974b-4200-9c3f-5dddea60a869', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80447', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'started_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 49, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:49:57.137744 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-14a6569c-01af-4928-9d22-5a58fb3e3dd8 service neutron] Checking segment: {'id': '71fc0c51-8d26-4812-8dcb-f2ed141a03d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 230, 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94347) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:49:57.138129 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-14a6569c-01af-4928-9d22-5a58fb3e3dd8 service neutron] Bound using segment: {'id': '71fc0c51-8d26-4812-8dcb-f2ed141a03d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 230, 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2'} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:49:57.138564 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-14a6569c-01af-4928-9d22-5a58fb3e3dd8 service neutron] Bound port: 17c68a27-b17a-499d-9bde-484199d59ae2, host: hv-cinder-80447, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '71fc0c51-8d26-4812-8dcb-f2ed141a03d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 230, 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2'}}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:49:57.138927 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-14a6569c-01af-4928-9d22-5a58fb3e3dd8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:57.206831 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-14a6569c-01af-4928-9d22-5a58fb3e3dd8 service neutron] For port 17c68a27-b17a-499d-9bde-484199d59ae2, host hv-cinder-80447, cleared binding levels {{(pid=94347) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:49:57.209823 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-14a6569c-01af-4928-9d22-5a58fb3e3dd8 service neutron] For port 17c68a27-b17a-499d-9bde-484199d59ae2, host hv-cinder-80447, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=17c68a27-b17a-499d-9bde-484199d59ae2,segment=NetworkSegment(71fc0c51-8d26-4812-8dcb-f2ed141a03d2),segment_id=71fc0c51-8d26-4812-8dcb-f2ed141a03d2)] {{(pid=94347) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:49:57.213715 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-14a6569c-01af-4928-9d22-5a58fb3e3dd8 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:57.245283 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-14a6569c-01af-4928-9d22-5a58fb3e3dd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:57.245902 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-14a6569c-01af-4928-9d22-5a58fb3e3dd8 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:49:57.247274 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-14a6569c-01af-4928-9d22-5a58fb3e3dd8 service neutron] 10.222.0.13 "PUT /v2.0/ports/17c68a27-b17a-499d-9bde-484199d59ae2 HTTP/1.1" status: 200 len: 1093 time: 0.6461258 Sep 18 08:49:57.247745 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '72f4dadd-ae4c-4dab-ae73-75174398ef1e', 'tag': '17c68a27-b17a-499d-9bde-484199d59ae2'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:49:57.250050 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ff2e4016-39b0-437d-83cd-67ac49cb588e" -d '{"events": [{"name": "network-changed", "server_uuid": "72f4dadd-ae4c-4dab-ae73-75174398ef1e", "tag": "17c68a27-b17a-499d-9bde-484199d59ae2"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:49:57.277490 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14a6569c-01af-4928-9d22-5a58fb3e3dd8 service neutron] Pushing event updated for resources: {'Port': ['ID=17c68a27-b17a-499d-9bde-484199d59ae2,revision_number=3']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:49:57.307107 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:49:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9d400fe3-317b-4d72-b1b1-38cd216c88bb x-openstack-request-id: req-9d400fe3-317b-4d72-b1b1-38cd216c88bb {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:49:57.307430 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "72f4dadd-ae4c-4dab-ae73-75174398ef1e", "tag": "17c68a27-b17a-499d-9bde-484199d59ae2", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:49:57.307716 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-9d400fe3-317b-4d72-b1b1-38cd216c88bb {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:49:57.308125 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '72f4dadd-ae4c-4dab-ae73-75174398ef1e', 'tag': '17c68a27-b17a-499d-9bde-484199d59ae2', 'status': 'completed', 'code': 200} Sep 18 08:49:57.363166 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-93825732-3208-44c7-bd5a-142413642f9c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:57.364726 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-93825732-3208-44c7-bd5a-142413642f9c service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=334211ea09044272868662e38cb1a4ad&device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 1096 time: 0.0421188 Sep 18 08:49:57.416235 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-348411b5-3dc6-47f9-9da5-ffa71acc1ec1 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=17c68a27-b17a-499d-9bde-484199d59ae2 HTTP/1.1" status: 200 len: 217 time: 0.0375283 Sep 18 08:49:57.463784 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-b95b64f9-4938-4927-8c40-605a9add708d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:57.465171 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-b95b64f9-4938-4927-8c40-605a9add708d service neutron] 10.222.0.13 "GET /v2.0/subnets?id=e900aa03-4504-4ae5-a8a2-0da036634ce2 HTTP/1.1" status: 200 len: 849 time: 0.0422118 Sep 18 08:49:57.509771 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-d3d691d2-a4a1-460b-ba8e-78e3ffcfbb8c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:57.511200 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-d3d691d2-a4a1-460b-ba8e-78e3ffcfbb8c service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=22bf7558-e572-4c3e-b191-f1edcd47c9f2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0389087 Sep 18 08:49:57.601124 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-90a142e2-75c8-4da1-b0fe-0a36c3cfb981 service neutron] 10.222.0.13 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0829053 Sep 18 08:49:57.691084 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3d66b171-b4ee-45b1-863c-b94a47f40a88 req-04447611-b4c6-4a69-b15a-b016e3b05b17 service neutron] 10.222.0.13 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817306 Sep 18 08:49:57.827018 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff2e4016-39b0-437d-83cd-67ac49cb588e req-c363a330-8b0c-46cc-aef2-a7f2389f789f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:57.828528 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ff2e4016-39b0-437d-83cd-67ac49cb588e req-c363a330-8b0c-46cc-aef2-a7f2389f789f service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=334211ea09044272868662e38cb1a4ad&device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 1096 time: 0.0444226 Sep 18 08:49:57.919403 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff2e4016-39b0-437d-83cd-67ac49cb588e req-2039ecc9-f79e-4754-99f4-4bf6dc64dd9d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:57.920883 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ff2e4016-39b0-437d-83cd-67ac49cb588e req-2039ecc9-f79e-4754-99f4-4bf6dc64dd9d service neutron] 10.222.0.13 "GET /v2.0/networks?id=22bf7558-e572-4c3e-b191-f1edcd47c9f2 HTTP/1.1" status: 200 len: 911 time: 0.0856352 Sep 18 08:49:57.964767 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ff2e4016-39b0-437d-83cd-67ac49cb588e req-b340109a-1ae4-4961-a3e3-f263f9d569da service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=17c68a27-b17a-499d-9bde-484199d59ae2 HTTP/1.1" status: 200 len: 217 time: 0.0364218 Sep 18 08:49:58.015729 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff2e4016-39b0-437d-83cd-67ac49cb588e req-41d2234c-bdf0-4cd5-9edb-9217fb08c652 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:58.017292 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ff2e4016-39b0-437d-83cd-67ac49cb588e req-41d2234c-bdf0-4cd5-9edb-9217fb08c652 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=e900aa03-4504-4ae5-a8a2-0da036634ce2 HTTP/1.1" status: 200 len: 849 time: 0.0459223 Sep 18 08:49:58.089903 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a350377-4c36-467e-bab4-2e2464e061d6 req-1aad965e-9fcb-4b8f-a701-818e0f746c23 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:58.091287 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3a350377-4c36-467e-bab4-2e2464e061d6 req-1aad965e-9fcb-4b8f-a701-818e0f746c23 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 943 time: 0.0723038 Sep 18 08:49:58.093780 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff2e4016-39b0-437d-83cd-67ac49cb588e req-21e660dd-4670-4e48-9af6-13cb4a638e22 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:58.095162 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ff2e4016-39b0-437d-83cd-67ac49cb588e req-21e660dd-4670-4e48-9af6-13cb4a638e22 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=22bf7558-e572-4c3e-b191-f1edcd47c9f2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0681536 Sep 18 08:49:58.179447 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3a350377-4c36-467e-bab4-2e2464e061d6 req-dc021530-4ff1-4742-b5fb-a0ee5104435c tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0820634 Sep 18 08:49:58.207332 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ff2e4016-39b0-437d-83cd-67ac49cb588e req-3b068183-0ac7-46fe-9691-6befe04adeed service neutron] 10.222.0.13 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1042914 Sep 18 08:49:58.300292 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ff2e4016-39b0-437d-83cd-67ac49cb588e req-b81b6be8-afec-4b76-a289-db7193a067ce service neutron] 10.222.0.13 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0854383 Sep 18 08:49:59.292286 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd343fc9-29c2-4786-9a0b-24f7edfc5d13 req-c04738b4-06b2-4c20-bc85-509a12ec20c5 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:49:59.293716 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bd343fc9-29c2-4786-9a0b-24f7edfc5d13 req-c04738b4-06b2-4c20-bc85-509a12ec20c5 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 943 time: 0.0471489 Sep 18 08:49:59.330602 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bd343fc9-29c2-4786-9a0b-24f7edfc5d13 req-70cf06bd-7313-438f-bf9c-629a599148a2 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0306816 Sep 18 08:50:00.437769 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81c3530e-b1e0-4cbb-b603-4535145c2946 req-a379c40e-cf42-48d9-a6a2-2b465d3d03b0 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:50:00.439705 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-81c3530e-b1e0-4cbb-b603-4535145c2946 req-a379c40e-cf42-48d9-a6a2-2b465d3d03b0 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 943 time: 0.0459645 Sep 18 08:50:00.475646 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-81c3530e-b1e0-4cbb-b603-4535145c2946 req-53ddea28-d1a0-4165-83b2-2b85b7cc4082 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0302572 Sep 18 08:50:01.586517 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02def078-68e8-4bcc-bf82-41603fe22fd8 req-5263d6cd-e987-4c23-ae32-4fb94308bc4c tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:50:01.587988 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-02def078-68e8-4bcc-bf82-41603fe22fd8 req-5263d6cd-e987-4c23-ae32-4fb94308bc4c tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 943 time: 0.0470314 Sep 18 08:50:01.627677 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-02def078-68e8-4bcc-bf82-41603fe22fd8 req-0e056a20-6a0d-411f-9683-3a46617efa14 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0339222 Sep 18 08:50:02.737897 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75bd7d23-feb5-438f-ac05-52eeecac2a7c req-6a981554-b9e3-4028-91ef-ddc50035c071 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:50:02.739342 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-75bd7d23-feb5-438f-ac05-52eeecac2a7c req-6a981554-b9e3-4028-91ef-ddc50035c071 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 943 time: 0.0470259 Sep 18 08:50:02.773472 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 17c68a27-b17a-499d-9bde-484199d59ae2 details requested by agent hyperv_hv-cinder-80447 with host hv-cinder-80447 {{(pid=94348) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 18 08:50:02.777991 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-75bd7d23-feb5-438f-ac05-52eeecac2a7c req-a784ef19-6264-46a8-b328-f5d853750143 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0328531 Sep 18 08:50:02.874362 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 17c68a27-b17a-499d-9bde-484199d59ae2, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=17c68a27-b17a-499d-9bde-484199d59ae2,segment=NetworkSegment(71fc0c51-8d26-4812-8dcb-f2ed141a03d2),segment_id=71fc0c51-8d26-4812-8dcb-f2ed141a03d2)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:50:02.885321 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Returning: {'device': '17c68a27-b17a-499d-9bde-484199d59ae2', 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'port_id': '17c68a27-b17a-499d-9bde-484199d59ae2', 'mac_address': 'fa:16:3e:51:16:c1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 230, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94348) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 18 08:50:02.925383 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:50:02.937786 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 17c68a27-b17a-499d-9bde-484199d59ae2 {{(pid=94348) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:50:02.956199 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 17c68a27-b17a-499d-9bde-484199d59ae2, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=17c68a27-b17a-499d-9bde-484199d59ae2,segment=NetworkSegment(71fc0c51-8d26-4812-8dcb-f2ed141a03d2),segment_id=71fc0c51-8d26-4812-8dcb-f2ed141a03d2)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:50:02.960139 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:50:03.011210 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=17c68a27-b17a-499d-9bde-484199d59ae2,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:50:03.357815 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['17c68a27-b17a-499d-9bde-484199d59ae2'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:50:03.890079 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3a4aa26-9e39-4c16-8e7b-a14fe0681623 req-6f58e58c-36f9-4016-8887-20a41fdac37a tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:50:03.891529 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f3a4aa26-9e39-4c16-8e7b-a14fe0681623 req-6f58e58c-36f9-4016-8887-20a41fdac37a tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 944 time: 0.0470412 Sep 18 08:50:03.927816 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f3a4aa26-9e39-4c16-8e7b-a14fe0681623 req-eb16172a-7feb-41a8-afa1-fcf97f0fa65d tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0304003 Sep 18 08:50:04.819644 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 17c68a27-b17a-499d-9bde-484199d59ae2 up at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:50:04.866288 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning for port 17c68a27-b17a-499d-9bde-484199d59ae2 completed by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 18 08:50:04.869806 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning complete for port 17c68a27-b17a-499d-9bde-484199d59ae2 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:50:04.870178 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:50:04.942194 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:50:04.963950 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '72f4dadd-ae4c-4dab-ae73-75174398ef1e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '17c68a27-b17a-499d-9bde-484199d59ae2'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:50:04.966194 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9128c8f0-8490-4557-a63a-33572963c134" -d '{"events": [{"server_uuid": "72f4dadd-ae4c-4dab-ae73-75174398ef1e", "name": "network-vif-plugged", "status": "completed", "tag": "17c68a27-b17a-499d-9bde-484199d59ae2"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:50:04.979220 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 17c68a27-b17a-499d-9bde-484199d59ae2, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=17c68a27-b17a-499d-9bde-484199d59ae2,segment=NetworkSegment(71fc0c51-8d26-4812-8dcb-f2ed141a03d2),segment_id=71fc0c51-8d26-4812-8dcb-f2ed141a03d2)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:50:04.984272 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:50:05.038398 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=17c68a27-b17a-499d-9bde-484199d59ae2,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:50:05.049563 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d8c9bce-2007-4449-8571-658964dfd1de req-33af5f44-8db5-4436-b025-05a530ec8605 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:50:05.051081 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0d8c9bce-2007-4449-8571-658964dfd1de req-33af5f44-8db5-4436-b025-05a530ec8605 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0555177 Sep 18 08:50:05.066412 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:50:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a5847981-ba6f-47d8-bff3-8d1169aec165 x-openstack-request-id: req-a5847981-ba6f-47d8-bff3-8d1169aec165 {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:50:05.066715 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "72f4dadd-ae4c-4dab-ae73-75174398ef1e", "name": "network-vif-plugged", "status": "completed", "tag": "17c68a27-b17a-499d-9bde-484199d59ae2", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:50:05.066971 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-a5847981-ba6f-47d8-bff3-8d1169aec165 {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:50:05.067360 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '72f4dadd-ae4c-4dab-ae73-75174398ef1e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '17c68a27-b17a-499d-9bde-484199d59ae2', 'code': 200} Sep 18 08:50:05.093032 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0d8c9bce-2007-4449-8571-658964dfd1de req-2d726d8e-7396-405e-bc41-93a5777883ea tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0360663 Sep 18 08:50:05.262171 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b08b8609-ff0c-439b-b68b-fdc4bba90116 req-51a13607-ada9-4e52-a2ba-32083b60982d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:50:05.263558 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b08b8609-ff0c-439b-b68b-fdc4bba90116 req-51a13607-ada9-4e52-a2ba-32083b60982d service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 1098 time: 0.0382500 Sep 18 08:50:05.296205 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b08b8609-ff0c-439b-b68b-fdc4bba90116 req-98b5e631-fd78-45d6-a86e-3077afa89dc7 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0256312 Sep 18 08:50:06.204053 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64fbad17-9cc6-46e0-89f3-a00ce5a8d3ae req-c4ebe361-74f0-443c-ab41-ded1e520fd45 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:50:06.205509 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-64fbad17-9cc6-46e0-89f3-a00ce5a8d3ae req-c4ebe361-74f0-443c-ab41-ded1e520fd45 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0460367 Sep 18 08:50:06.241474 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-64fbad17-9cc6-46e0-89f3-a00ce5a8d3ae req-769a3f55-c480-41ec-89e4-f9f723f700d8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0302937 Sep 18 08:50:07.349582 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a7461e0-c905-43f6-9dc4-c00d82f14f1f req-30da1b1e-ec1c-4eeb-b53a-544e5035e784 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:50:07.351019 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7a7461e0-c905-43f6-9dc4-c00d82f14f1f req-30da1b1e-ec1c-4eeb-b53a-544e5035e784 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0459564 Sep 18 08:50:07.389965 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-7a7461e0-c905-43f6-9dc4-c00d82f14f1f req-a93ea2d6-6546-47fa-95b5-21d9b0b2a6ef tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0332298 Sep 18 08:50:07.495763 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5512d54-ecfe-429a-a661-30ceab14ecb6 req-9fe5407a-e9ab-45bf-9d20-886876d95c75 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:50:07.497228 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d5512d54-ecfe-429a-a661-30ceab14ecb6 req-9fe5407a-e9ab-45bf-9d20-886876d95c75 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0470538 Sep 18 08:50:07.507067 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 37702) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:50:07.511549 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-d4f4bfee-de70-4d65-a4d8-535f26bc029c tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Request body: {'floatingip': {'port_id': '17c68a27-b17a-499d-9bde-484199d59ae2'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:50:07.549360 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d4f4bfee-de70-4d65-a4d8-535f26bc029c tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for floatingip, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:50:07.962325 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d4f4bfee-de70-4d65-a4d8-535f26bc029c tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for floatingip, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:50:07.965974 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d4f4bfee-de70-4d65-a4d8-535f26bc029c tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-784908'] for floatingip, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:50:08.061311 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.db.l3_db [None req-d4f4bfee-de70-4d65-a4d8-535f26bc029c tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Floating IP c249629c-5701-4197-9f83-88d0e3c00f94 associated. External IP: 172.27.1.193, port: 17c68a27-b17a-499d-9bde-484199d59ae2. Sep 18 08:50:08.257383 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d4f4bfee-de70-4d65-a4d8-535f26bc029c tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Router 7ffeaad5-a677-409b-ba64-09886084c459 has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94347) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:50:08.358303 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d4f4bfee-de70-4d65-a4d8-535f26bc029c tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94347) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:50:08.363611 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-d4f4bfee-de70-4d65-a4d8-535f26bc029c tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for floatingip, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:50:08.368195 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c81af5b-37aa-4251-bdcd-fb2d70084780 None None] Sync routers for ids ['7ffeaad5-a677-409b-ba64-09886084c459'] in dv-cinder-804470-6-iscsi {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:50:08.377852 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c81af5b-37aa-4251-bdcd-fb2d70084780 None None] Routers {'7ffeaad5-a677-409b-ba64-09886084c459'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:50:08.378458 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-7c81af5b-37aa-4251-bdcd-fb2d70084780 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:49:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['7ffeaad5-a677-409b-ba64-09886084c459'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:50:08.389748 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-d4f4bfee-de70-4d65-a4d8-535f26bc029c tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "PUT /v2.0/floatingips/c249629c-5701-4197-9f83-88d0e3c00f94 HTTP/1.1" status: 200 len: 991 time: 0.8816218 Sep 18 08:50:08.390308 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '72f4dadd-ae4c-4dab-ae73-75174398ef1e', 'tag': '17c68a27-b17a-499d-9bde-484199d59ae2'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:50:08.392545 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cac3ae27-f3d1-4f9f-bde5-ed02644d2b30" -d '{"events": [{"name": "network-changed", "server_uuid": "72f4dadd-ae4c-4dab-ae73-75174398ef1e", "tag": "17c68a27-b17a-499d-9bde-484199d59ae2"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:50:08.433558 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:50:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cbd946ed-8011-4517-bb96-1e492042edda x-openstack-request-id: req-cbd946ed-8011-4517-bb96-1e492042edda {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:50:08.433852 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "72f4dadd-ae4c-4dab-ae73-75174398ef1e", "tag": "17c68a27-b17a-499d-9bde-484199d59ae2", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:50:08.434106 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-cbd946ed-8011-4517-bb96-1e492042edda {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:50:08.434509 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '72f4dadd-ae4c-4dab-ae73-75174398ef1e', 'tag': '17c68a27-b17a-499d-9bde-484199d59ae2', 'status': 'completed', 'code': 200} Sep 18 08:50:08.483543 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-7c81af5b-37aa-4251-bdcd-fb2d70084780 None None] Set router 7ffeaad5-a677-409b-ba64-09886084c459 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:50:08.526537 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cac3ae27-f3d1-4f9f-bde5-ed02644d2b30 req-04c1f20c-1513-49f8-abdc-71b57e9336fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:50:08.528073 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cac3ae27-f3d1-4f9f-bde5-ed02644d2b30 req-04c1f20c-1513-49f8-abdc-71b57e9336fb service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=334211ea09044272868662e38cb1a4ad&device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 1098 time: 0.0409253 Sep 18 08:50:08.620190 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cac3ae27-f3d1-4f9f-bde5-ed02644d2b30 req-f0a1e0e4-6dbe-4691-8a3d-6c44d6d99c09 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:50:08.621693 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cac3ae27-f3d1-4f9f-bde5-ed02644d2b30 req-f0a1e0e4-6dbe-4691-8a3d-6c44d6d99c09 service neutron] 10.222.0.13 "GET /v2.0/networks?id=22bf7558-e572-4c3e-b191-f1edcd47c9f2 HTTP/1.1" status: 200 len: 911 time: 0.0864408 Sep 18 08:50:08.685758 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cac3ae27-f3d1-4f9f-bde5-ed02644d2b30 req-fe6aff56-e06c-44f4-a459-ed392902acba service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=17c68a27-b17a-499d-9bde-484199d59ae2 HTTP/1.1" status: 200 len: 999 time: 0.0562632 Sep 18 08:50:08.699001 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-7c81af5b-37aa-4251-bdcd-fb2d70084780 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ffeaad5-a677-409b-ba64-09886084c459', 'name': 'tempest-AttachVolumeTestJSON-468473020-router', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100'}], 'enable_snat': True}, 'gw_port_id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:49:47Z', 'updated_at': '2021-09-18T08:49:50Z', 'revision_number': 4, 'project_id': '334211ea09044272868662e38cb1a4ad', 'gw_port': {'id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:06:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:48Z', 'updated_at': '2021-09-18T08:49:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': 'c249629c-5701-4197-9f83-88d0e3c00f94', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'floating_ip_address': '172.27.1.193', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'port_id': '17c68a27-b17a-499d-9bde-484199d59ae2', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 653, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'mac_address': 'fa:16:3e:51:16:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72f4dadd-ae4c-4dab-ae73-75174398ef1e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:49:53Z', 'updated_at': '2021-09-18T08:50:07Z', 'revision_number': 1, 'project_id': '334211ea09044272868662e38cb1a4ad', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e79b2742-d588-4bec-bf32-881880841c60', 'name': '', 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'mac_address': 'fa:16:3e:cc:93:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_interface', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:49Z', 'updated_at': '2021-09-18T08:49:53Z', 'revision_number': 5, 'project_id': '334211ea09044272868662e38cb1a4ad', 'subnets': [{'id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:50:08.728121 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c81af5b-37aa-4251-bdcd-fb2d70084780 None None] Checking router: 7ffeaad5-a677-409b-ba64-09886084c459 for host: dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:50:08.733307 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cac3ae27-f3d1-4f9f-bde5-ed02644d2b30 req-cde4e5ca-bfd6-4565-97e0-fe368b5ac64c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:50:08.735359 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cac3ae27-f3d1-4f9f-bde5-ed02644d2b30 req-cde4e5ca-bfd6-4565-97e0-fe368b5ac64c service neutron] 10.222.0.13 "GET /v2.0/subnets?id=e900aa03-4504-4ae5-a8a2-0da036634ce2 HTTP/1.1" status: 200 len: 849 time: 0.0423341 Sep 18 08:50:08.736723 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c81af5b-37aa-4251-bdcd-fb2d70084780 None None] Routers {'7ffeaad5-a677-409b-ba64-09886084c459'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:50:08.737343 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-7c81af5b-37aa-4251-bdcd-fb2d70084780 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:49:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['7ffeaad5-a677-409b-ba64-09886084c459'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:50:08.780844 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cac3ae27-f3d1-4f9f-bde5-ed02644d2b30 req-4ec0cd8a-caa1-4625-8ceb-881958c5dd88 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:50:08.782772 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cac3ae27-f3d1-4f9f-bde5-ed02644d2b30 req-4ec0cd8a-caa1-4625-8ceb-881958c5dd88 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=22bf7558-e572-4c3e-b191-f1edcd47c9f2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0414228 Sep 18 08:50:08.837837 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-7c81af5b-37aa-4251-bdcd-fb2d70084780 None None] Set router 7ffeaad5-a677-409b-ba64-09886084c459 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:50:08.870494 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cac3ae27-f3d1-4f9f-bde5-ed02644d2b30 req-56af84d1-42e5-4bfb-bc05-5a7016126bbb service neutron] 10.222.0.13 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0808690 Sep 18 08:50:08.961731 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cac3ae27-f3d1-4f9f-bde5-ed02644d2b30 req-46d23a4a-2538-4b4b-afb8-4e8cab46e4fa service neutron] 10.222.0.13 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0836029 Sep 18 08:50:09.056670 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-7c81af5b-37aa-4251-bdcd-fb2d70084780 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ffeaad5-a677-409b-ba64-09886084c459', 'name': 'tempest-AttachVolumeTestJSON-468473020-router', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100'}], 'enable_snat': True}, 'gw_port_id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:49:47Z', 'updated_at': '2021-09-18T08:49:50Z', 'revision_number': 4, 'project_id': '334211ea09044272868662e38cb1a4ad', 'gw_port': {'id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:06:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:48Z', 'updated_at': '2021-09-18T08:49:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': 'c249629c-5701-4197-9f83-88d0e3c00f94', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'floating_ip_address': '172.27.1.193', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'port_id': '17c68a27-b17a-499d-9bde-484199d59ae2', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 653, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'mac_address': 'fa:16:3e:51:16:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72f4dadd-ae4c-4dab-ae73-75174398ef1e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:49:53Z', 'updated_at': '2021-09-18T08:50:07Z', 'revision_number': 1, 'project_id': '334211ea09044272868662e38cb1a4ad', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e79b2742-d588-4bec-bf32-881880841c60', 'name': '', 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'mac_address': 'fa:16:3e:cc:93:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_interface', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:49Z', 'updated_at': '2021-09-18T08:49:53Z', 'revision_number': 5, 'project_id': '334211ea09044272868662e38cb1a4ad', 'subnets': [{'id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:50:09.085551 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c81af5b-37aa-4251-bdcd-fb2d70084780 None None] The sync data for ids ['7ffeaad5-a677-409b-ba64-09886084c459'] in dv-cinder-804470-6-iscsi is: [{'id': '7ffeaad5-a677-409b-ba64-09886084c459', 'name': 'tempest-AttachVolumeTestJSON-468473020-router', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100'}], 'enable_snat': True}, 'gw_port_id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:49:47Z', 'updated_at': '2021-09-18T08:49:50Z', 'revision_number': 4, 'project_id': '334211ea09044272868662e38cb1a4ad', 'gw_port': {'id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:06:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:48Z', 'updated_at': '2021-09-18T08:49:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': 'c249629c-5701-4197-9f83-88d0e3c00f94', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'floating_ip_address': '172.27.1.193', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'port_id': '17c68a27-b17a-499d-9bde-484199d59ae2', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 653, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'mac_address': 'fa:16:3e:51:16:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72f4dadd-ae4c-4dab-ae73-75174398ef1e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:49:53Z', 'updated_at': '2021-09-18T08:50:07Z', 'revision_number': 1, 'project_id': '334211ea09044272868662e38cb1a4ad', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e79b2742-d588-4bec-bf32-881880841c60', 'name': '', 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'mac_address': 'fa:16:3e:cc:93:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_interface', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:49Z', 'updated_at': '2021-09-18T08:49:53Z', 'revision_number': 5, 'project_id': '334211ea09044272868662e38cb1a4ad', 'subnets': [{'id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:50:09.262850 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-99d01c18-e0d8-4490-9c2b-0cb4d9948593 None None] New status for floating IP c249629c-5701-4197-9f83-88d0e3c00f94: ACTIVE {{(pid=94348) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 18 08:50:19.625773 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-b8582cdf-d13f-442f-9bbd-8f42e31104a7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:50:20.139309 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:50:22.405103 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-45113201-23c9-4fe4-9d69-cb6bd4c8b216 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:50:23.224735 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:50:23.380661 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:50:24.901133 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:50:25.700166 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:50:26.745489 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-265e6e93-ddd5-42d4-a344-5ac147105c79 req-55ab6c3d-b4d0-42ad-85bf-c9bb624509f7 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0388756 Sep 18 08:50:26.840665 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-265e6e93-ddd5-42d4-a344-5ac147105c79 req-a8c5f217-4b47-41d7-a3c7-5cadb524ec1e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:50:26.842127 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-265e6e93-ddd5-42d4-a344-5ac147105c79 req-a8c5f217-4b47-41d7-a3c7-5cadb524ec1e service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0c7c58787ad549afa94b716f4c2f187b&device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 1099 time: 0.0370667 Sep 18 08:50:26.945410 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-265e6e93-ddd5-42d4-a344-5ac147105c79 req-4c619789-6a2c-4fe7-b615-e3df1b241fc2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:50:26.946930 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-265e6e93-ddd5-42d4-a344-5ac147105c79 req-4c619789-6a2c-4fe7-b615-e3df1b241fc2 service neutron] 10.222.0.13 "GET /v2.0/networks?id=000f3583-b7de-458d-9146-0010cd28b00d HTTP/1.1" status: 200 len: 913 time: 0.0838945 Sep 18 08:50:27.010524 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-265e6e93-ddd5-42d4-a344-5ac147105c79 req-ed7f4851-7947-43ea-8de2-2e2bf306a4ff service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=068a71a1-cf8a-4759-a743-216fe1a17a75 HTTP/1.1" status: 200 len: 1002 time: 0.0561163 Sep 18 08:50:27.062983 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-265e6e93-ddd5-42d4-a344-5ac147105c79 req-382b5838-5d21-4112-8e66-7f5b21998796 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:50:27.064388 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-265e6e93-ddd5-42d4-a344-5ac147105c79 req-382b5838-5d21-4112-8e66-7f5b21998796 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=a4c047cf-cba6-4b94-8339-59469f96c92a HTTP/1.1" status: 200 len: 851 time: 0.0464196 Sep 18 08:50:27.108653 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-265e6e93-ddd5-42d4-a344-5ac147105c79 req-a9624d60-083e-4286-babc-ab114b0d2be7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:50:27.110071 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-265e6e93-ddd5-42d4-a344-5ac147105c79 req-a9624d60-083e-4286-babc-ab114b0d2be7 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=000f3583-b7de-458d-9146-0010cd28b00d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0377591 Sep 18 08:50:27.198450 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-265e6e93-ddd5-42d4-a344-5ac147105c79 req-6033dff9-814e-4725-8b6a-40285a19fba0 service neutron] 10.222.0.13 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0800912 Sep 18 08:50:27.538853 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-265e6e93-ddd5-42d4-a344-5ac147105c79 req-dc9e6de6-09cc-453e-b08f-2b2e74091b1c service neutron] 10.222.0.13 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3320594 Sep 18 08:50:49.626642 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-eba174d2-1c01-430e-b5f8-9c45ffb9bd0d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:50:50.144831 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:50:52.405386 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-4db44927-01ca-4e67-a632-e70c650bbbf2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:50:53.224558 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:50:53.382023 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:50:54.903326 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:02.698602 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:51:13.118657 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 37834) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:51:13.266782 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-8b2e5af1-fb37-4ad8-a185-c77b2b7bcc7c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Deleting port b521b7d1-1888-4a30-96d7-f160b17bbed3 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:51:13.267127 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8b2e5af1-fb37-4ad8-a185-c77b2b7bcc7c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:13.340617 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8b2e5af1-fb37-4ad8-a185-c77b2b7bcc7c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:13.340942 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8b2e5af1-fb37-4ad8-a185-c77b2b7bcc7c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:13.352860 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-8b2e5af1-fb37-4ad8-a185-c77b2b7bcc7c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Calling delete_port for b521b7d1-1888-4a30-96d7-f160b17bbed3 owned by network:floatingip {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:51:13.492385 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8b2e5af1-fb37-4ad8-a185-c77b2b7bcc7c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:13.521858 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b2e5af1-fb37-4ad8-a185-c77b2b7bcc7c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Pushing event deleted for resources: {'Port': ['ID=b521b7d1-1888-4a30-96d7-f160b17bbed3,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:51:13.558001 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b2e5af1-fb37-4ad8-a185-c77b2b7bcc7c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:51:13.558353 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b2e5af1-fb37-4ad8-a185-c77b2b7bcc7c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:51:13.558696 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b2e5af1-fb37-4ad8-a185-c77b2b7bcc7c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:51:13.559035 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b2e5af1-fb37-4ad8-a185-c77b2b7bcc7c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:51:13.559368 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b2e5af1-fb37-4ad8-a185-c77b2b7bcc7c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:51:13.559696 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b2e5af1-fb37-4ad8-a185-c77b2b7bcc7c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:51:13.560024 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b2e5af1-fb37-4ad8-a185-c77b2b7bcc7c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:51:13.560350 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b2e5af1-fb37-4ad8-a185-c77b2b7bcc7c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:51:13.560677 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b2e5af1-fb37-4ad8-a185-c77b2b7bcc7c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:51:13.560997 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b2e5af1-fb37-4ad8-a185-c77b2b7bcc7c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:51:13.561340 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b2e5af1-fb37-4ad8-a185-c77b2b7bcc7c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:51:13.561661 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8b2e5af1-fb37-4ad8-a185-c77b2b7bcc7c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:51:13.581722 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8b2e5af1-fb37-4ad8-a185-c77b2b7bcc7c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for floatingip, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:13.582052 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.db.l3_db [None req-8b2e5af1-fb37-4ad8-a185-c77b2b7bcc7c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Floating IP b938f6f2-607a-406e-9114-2dbeb65db4af disassociated (deleted). External IP: 172.27.1.64, port: 7ef8778e-5f0c-468d-903e-2a37683f22bf. Sep 18 08:51:13.777952 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8b2e5af1-fb37-4ad8-a185-c77b2b7bcc7c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Router 4922fc58-f2eb-480a-878f-2bc3f212b4da has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94347) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:51:13.880142 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8b2e5af1-fb37-4ad8-a185-c77b2b7bcc7c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94347) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:51:13.884821 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8b2e5af1-fb37-4ad8-a185-c77b2b7bcc7c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for floatingip, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:13.889388 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1865971-d318-443c-9bb7-4c1d1f2435a3 None None] Sync routers for ids ['4922fc58-f2eb-480a-878f-2bc3f212b4da'] in dv-cinder-804470-6-iscsi {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:51:13.898471 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1865971-d318-443c-9bb7-4c1d1f2435a3 None None] Routers {'4922fc58-f2eb-480a-878f-2bc3f212b4da'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:51:13.899069 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-d1865971-d318-443c-9bb7-4c1d1f2435a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:50:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['4922fc58-f2eb-480a-878f-2bc3f212b4da'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:51:13.911412 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-8b2e5af1-fb37-4ad8-a185-c77b2b7bcc7c tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "DELETE /v2.0/floatingips/b938f6f2-607a-406e-9114-2dbeb65db4af HTTP/1.1" status: 204 len: 168 time: 0.7916665 Sep 18 08:51:13.912076 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5cd061b1-4698-4997-bbd8-942ec6f21bcd', 'tag': '7ef8778e-5f0c-468d-903e-2a37683f22bf'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:51:13.914493 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8f5acad6-298e-4e2d-a162-7670e79b062f" -d '{"events": [{"name": "network-changed", "server_uuid": "5cd061b1-4698-4997-bbd8-942ec6f21bcd", "tag": "7ef8778e-5f0c-468d-903e-2a37683f22bf"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:51:14.006897 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-d1865971-d318-443c-9bb7-4c1d1f2435a3 None None] Set router 4922fc58-f2eb-480a-878f-2bc3f212b4da gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:51:14.069791 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:51:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-60b8c8ab-4336-46dd-afd1-cfae4a74c487 x-openstack-request-id: req-60b8c8ab-4336-46dd-afd1-cfae4a74c487 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:51:14.070111 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5cd061b1-4698-4997-bbd8-942ec6f21bcd", "tag": "7ef8778e-5f0c-468d-903e-2a37683f22bf", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:51:14.070499 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-60b8c8ab-4336-46dd-afd1-cfae4a74c487 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:51:14.070820 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5cd061b1-4698-4997-bbd8-942ec6f21bcd', 'tag': '7ef8778e-5f0c-468d-903e-2a37683f22bf', 'status': 'completed', 'code': 200} Sep 18 08:51:14.142107 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb1208b2-3784-48aa-91a6-68bd2765b43b req-9775e215-3515-4fb3-b96d-190f7c1a5a3b tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:14.144516 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cb1208b2-3784-48aa-91a6-68bd2765b43b req-9775e215-3515-4fb3-b96d-190f7c1a5a3b tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 946 time: 0.0526669 Sep 18 08:51:14.218175 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cb1208b2-3784-48aa-91a6-68bd2765b43b req-4c1a11c4-3446-4fa1-8f6e-5265b2198ab4 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0632863 Sep 18 08:51:14.225653 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f5acad6-298e-4e2d-a162-7670e79b062f req-631900a9-15ce-4562-a647-993ed65778f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:14.227345 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8f5acad6-298e-4e2d-a162-7670e79b062f req-631900a9-15ce-4562-a647-993ed65778f0 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0c7c58787ad549afa94b716f4c2f187b&device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 1099 time: 0.0581114 Sep 18 08:51:14.332644 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-d1865971-d318-443c-9bb7-4c1d1f2435a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 4, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port': {'id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ad:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 474, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:54Z', 'updated_at': '2021-09-18T08:41:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': '82381b73-8875-486b-bf4a-c647dafc0cbe', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'floating_ip_address': '172.27.1.105', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'port_id': '068a71a1-cf8a-4759-a743-216fe1a17a75', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'mac_address': 'fa:16:3e:ee:92:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '825bdf32-25b4-4b50-a9b5-ed2f13f19319', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:46:52Z', 'updated_at': '2021-09-18T08:46:54Z', 'revision_number': 1, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4eb6aada-4647-4cc0-b357-a3113e1607e9', 'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'mac_address': 'fa:16:3e:49:34:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_interface', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:56Z', 'updated_at': '2021-09-18T08:42:01Z', 'revision_number': 5, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'subnets': [{'id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:51:14.335943 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f5acad6-298e-4e2d-a162-7670e79b062f req-2f9e970b-0f18-41bb-a867-dc1ce4c76727 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:14.341353 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8f5acad6-298e-4e2d-a162-7670e79b062f req-2f9e970b-0f18-41bb-a867-dc1ce4c76727 service neutron] 10.222.0.13 "GET /v2.0/networks?id=000f3583-b7de-458d-9146-0010cd28b00d HTTP/1.1" status: 200 len: 913 time: 0.1059740 Sep 18 08:51:14.361937 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1865971-d318-443c-9bb7-4c1d1f2435a3 None None] Checking router: 4922fc58-f2eb-480a-878f-2bc3f212b4da for host: dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:51:14.370022 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1865971-d318-443c-9bb7-4c1d1f2435a3 None None] Routers {'4922fc58-f2eb-480a-878f-2bc3f212b4da'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:51:14.370631 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-d1865971-d318-443c-9bb7-4c1d1f2435a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:50:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['4922fc58-f2eb-480a-878f-2bc3f212b4da'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:51:14.383968 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8f5acad6-298e-4e2d-a162-7670e79b062f req-31c72bea-bf15-48fe-b1e6-f77dfc6a267f service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=7ef8778e-5f0c-468d-903e-2a37683f22bf HTTP/1.1" status: 200 len: 217 time: 0.0341475 Sep 18 08:51:14.433106 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f5acad6-298e-4e2d-a162-7670e79b062f req-acf99673-8612-455f-8c87-6e8227f36c45 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:14.434682 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8f5acad6-298e-4e2d-a162-7670e79b062f req-acf99673-8612-455f-8c87-6e8227f36c45 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=a4c047cf-cba6-4b94-8339-59469f96c92a HTTP/1.1" status: 200 len: 851 time: 0.0421107 Sep 18 08:51:14.473327 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-d1865971-d318-443c-9bb7-4c1d1f2435a3 None None] Set router 4922fc58-f2eb-480a-878f-2bc3f212b4da gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:51:14.483799 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f5acad6-298e-4e2d-a162-7670e79b062f req-62a80dc3-fbda-4daf-a983-86c8b05fb1fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:14.485317 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8f5acad6-298e-4e2d-a162-7670e79b062f req-62a80dc3-fbda-4daf-a983-86c8b05fb1fa service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=000f3583-b7de-458d-9146-0010cd28b00d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0418422 Sep 18 08:51:14.578106 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8f5acad6-298e-4e2d-a162-7670e79b062f req-6e038afc-f10b-4461-9b18-d73816a19fa8 service neutron] 10.222.0.13 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0819120 Sep 18 08:51:14.679285 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8f5acad6-298e-4e2d-a162-7670e79b062f req-d2127966-cc3b-4df5-8dd5-69bd6006dff0 service neutron] 10.222.0.13 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0889461 Sep 18 08:51:14.692859 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-d1865971-d318-443c-9bb7-4c1d1f2435a3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 4, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port': {'id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ad:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 474, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:54Z', 'updated_at': '2021-09-18T08:41:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': '82381b73-8875-486b-bf4a-c647dafc0cbe', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'floating_ip_address': '172.27.1.105', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'port_id': '068a71a1-cf8a-4759-a743-216fe1a17a75', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'mac_address': 'fa:16:3e:ee:92:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '825bdf32-25b4-4b50-a9b5-ed2f13f19319', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:46:52Z', 'updated_at': '2021-09-18T08:46:54Z', 'revision_number': 1, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4eb6aada-4647-4cc0-b357-a3113e1607e9', 'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'mac_address': 'fa:16:3e:49:34:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_interface', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:56Z', 'updated_at': '2021-09-18T08:42:01Z', 'revision_number': 5, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'subnets': [{'id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:51:14.719434 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d1865971-d318-443c-9bb7-4c1d1f2435a3 None None] The sync data for ids ['4922fc58-f2eb-480a-878f-2bc3f212b4da'] in dv-cinder-804470-6-iscsi is: [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 4, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port': {'id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ad:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 474, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:54Z', 'updated_at': '2021-09-18T08:41:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': '82381b73-8875-486b-bf4a-c647dafc0cbe', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'floating_ip_address': '172.27.1.105', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'port_id': '068a71a1-cf8a-4759-a743-216fe1a17a75', 'fixed_ip_address': '172.20.0.12', 'status': 'ACTIVE', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'mac_address': 'fa:16:3e:ee:92:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '825bdf32-25b4-4b50-a9b5-ed2f13f19319', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:46:52Z', 'updated_at': '2021-09-18T08:46:54Z', 'revision_number': 1, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '4eb6aada-4647-4cc0-b357-a3113e1607e9', 'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'mac_address': 'fa:16:3e:49:34:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_interface', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:56Z', 'updated_at': '2021-09-18T08:42:01Z', 'revision_number': 5, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'subnets': [{'id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:51:14.915570 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-52bcadd1-488a-4070-a0dc-de64aa92dd9c None None] New status for floating IP b938f6f2-607a-406e-9114-2dbeb65db4af: DOWN {{(pid=94348) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 18 08:51:15.331429 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70d45ae5-243d-4187-b19f-a7a492b2cd5d req-c455f248-c016-4a94-a4b0-09d155134b4f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:15.332896 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-70d45ae5-243d-4187-b19f-a7a492b2cd5d req-c455f248-c016-4a94-a4b0-09d155134b4f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 946 time: 0.0475757 Sep 18 08:51:15.368788 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-70d45ae5-243d-4187-b19f-a7a492b2cd5d req-59e54b3c-64bb-4056-803f-c3036f4c3979 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0301347 Sep 18 08:51:16.241172 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89a2a550-9e93-4607-8f49-8681fc8a2250 req-7f9982fd-3da9-472c-b796-144a9f20730f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:16.242614 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-89a2a550-9e93-4607-8f49-8681fc8a2250 req-7f9982fd-3da9-472c-b796-144a9f20730f tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.13 "GET /v2.0/ports?device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 946 time: 0.0466671 Sep 18 08:51:16.346236 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-89a2a550-9e93-4607-8f49-8681fc8a2250 req-1951d05a-fb29-4694-b861-2874d34f0e10 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Deleting port 7ef8778e-5f0c-468d-903e-2a37683f22bf {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:51:16.346906 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-89a2a550-9e93-4607-8f49-8681fc8a2250 req-1951d05a-fb29-4694-b861-2874d34f0e10 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:16.433805 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-89a2a550-9e93-4607-8f49-8681fc8a2250 req-1951d05a-fb29-4694-b861-2874d34f0e10 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] For port 7ef8778e-5f0c-468d-903e-2a37683f22bf, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=7ef8778e-5f0c-468d-903e-2a37683f22bf,segment=NetworkSegment(c215153d-2878-4c82-8dc0-2a92b453bf12),segment_id=c215153d-2878-4c82-8dc0-2a92b453bf12)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:51:16.434172 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-89a2a550-9e93-4607-8f49-8681fc8a2250 req-1951d05a-fb29-4694-b861-2874d34f0e10 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:16.455392 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-89a2a550-9e93-4607-8f49-8681fc8a2250 req-1951d05a-fb29-4694-b861-2874d34f0e10 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Calling delete_port for 7ef8778e-5f0c-468d-903e-2a37683f22bf owned by compute:nova {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:51:16.530866 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8335b4a9-59f5-442a-a2a7-7189a56f24d6 req-019e51a8-b7a0-4d00-9fa9-70f36ffa76ce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:16.532294 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8335b4a9-59f5-442a-a2a7-7189a56f24d6 req-019e51a8-b7a0-4d00-9fa9-70f36ffa76ce tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 946 time: 0.0954399 Sep 18 08:51:16.591453 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8335b4a9-59f5-442a-a2a7-7189a56f24d6 req-1893f406-9ac3-4a89-9b3d-7061c9b287c3 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0503538 Sep 18 08:51:16.645381 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-89a2a550-9e93-4607-8f49-8681fc8a2250 req-1951d05a-fb29-4694-b861-2874d34f0e10 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:16.675419 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1951d05a-fb29-4694-b861-2874d34f0e10 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Pushing event deleted for resources: {'Port': ['ID=7ef8778e-5f0c-468d-903e-2a37683f22bf,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:51:16.716152 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-89a2a550-9e93-4607-8f49-8681fc8a2250 req-1951d05a-fb29-4694-b861-2874d34f0e10 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] No DVR routers for this DVR port 7ef8778e-5f0c-468d-903e-2a37683f22bf on host hv-cinder-80447 {{(pid=94347) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:51:16.718682 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-89a2a550-9e93-4607-8f49-8681fc8a2250 req-1951d05a-fb29-4694-b861-2874d34f0e10 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:16.721329 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-89a2a550-9e93-4607-8f49-8681fc8a2250 req-1951d05a-fb29-4694-b861-2874d34f0e10 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.13 "DELETE /v2.0/ports/7ef8778e-5f0c-468d-903e-2a37683f22bf HTTP/1.1" status: 204 len: 173 time: 0.4582157 Sep 18 08:51:16.721768 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5cd061b1-4698-4997-bbd8-942ec6f21bcd', 'name': 'network-vif-deleted', 'tag': '7ef8778e-5f0c-468d-903e-2a37683f22bf'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:51:16.724232 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7eb3b158-2a24-4d9f-8d75-f38f7fb83adf" -d '{"events": [{"server_uuid": "5cd061b1-4698-4997-bbd8-942ec6f21bcd", "name": "network-vif-deleted", "tag": "7ef8778e-5f0c-468d-903e-2a37683f22bf"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:51:16.759367 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:51:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ae3920d9-f4f5-4223-9ff6-e5617c800a9f x-openstack-request-id: req-ae3920d9-f4f5-4223-9ff6-e5617c800a9f {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:51:16.759686 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5cd061b1-4698-4997-bbd8-942ec6f21bcd", "name": "network-vif-deleted", "tag": "7ef8778e-5f0c-468d-903e-2a37683f22bf", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:51:16.759945 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-ae3920d9-f4f5-4223-9ff6-e5617c800a9f {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:51:16.760348 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5cd061b1-4698-4997-bbd8-942ec6f21bcd', 'name': 'network-vif-deleted', 'tag': '7ef8778e-5f0c-468d-903e-2a37683f22bf', 'status': 'completed', 'code': 200} Sep 18 08:51:17.699282 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c2dff6e2-39d2-4ea0-b283-eb10ff3d79af req-e358d1d8-d1ff-477e-ac4b-01faa41cedab tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=5cd061b1-4698-4997-bbd8-942ec6f21bcd HTTP/1.1" status: 200 len: 210 time: 0.0272288 Sep 18 08:51:19.626502 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-f81cacfa-5652-473f-aa97-ebb2b75c9b60 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:20.144002 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:20.969361 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 37894) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:51:21.120178 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-8ae8154d-fecf-4a43-acde-a5766d6cc389 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Deleting port 89b72f1e-8236-4210-967d-a00424856aea {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:51:21.120519 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8ae8154d-fecf-4a43-acde-a5766d6cc389 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:21.196571 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8ae8154d-fecf-4a43-acde-a5766d6cc389 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:21.196901 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8ae8154d-fecf-4a43-acde-a5766d6cc389 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:21.207410 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 7ef8778e-5f0c-468d-903e-2a37683f22bf no longer exists at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:51:21.209334 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-8ae8154d-fecf-4a43-acde-a5766d6cc389 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Calling delete_port for 89b72f1e-8236-4210-967d-a00424856aea owned by network:floatingip {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:51:21.227744 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] No Port match for: 7ef8778e-5f0c-468d-903e-2a37683f22bf {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:51:21.228094 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 7ef8778e-5f0c-468d-903e-2a37683f22bf not bound to the agent host hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:51:21.352509 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8ae8154d-fecf-4a43-acde-a5766d6cc389 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:21.377131 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8ae8154d-fecf-4a43-acde-a5766d6cc389 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Pushing event deleted for resources: {'Port': ['ID=89b72f1e-8236-4210-967d-a00424856aea,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:51:21.433705 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8ae8154d-fecf-4a43-acde-a5766d6cc389 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for floatingip, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:21.433991 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.db.l3_db [None req-8ae8154d-fecf-4a43-acde-a5766d6cc389 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Floating IP 82381b73-8875-486b-bf4a-c647dafc0cbe disassociated (deleted). External IP: 172.27.1.105, port: 068a71a1-cf8a-4759-a743-216fe1a17a75. Sep 18 08:51:21.633322 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8ae8154d-fecf-4a43-acde-a5766d6cc389 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Router 4922fc58-f2eb-480a-878f-2bc3f212b4da has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94347) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:51:21.737849 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8ae8154d-fecf-4a43-acde-a5766d6cc389 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94347) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:51:21.742362 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8ae8154d-fecf-4a43-acde-a5766d6cc389 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for floatingip, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:21.749198 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c662beb-5fb2-4074-aa4c-42374ccd33ef None None] Sync routers for ids ['4922fc58-f2eb-480a-878f-2bc3f212b4da'] in dv-cinder-804470-6-iscsi {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:51:21.763240 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c662beb-5fb2-4074-aa4c-42374ccd33ef None None] Routers {'4922fc58-f2eb-480a-878f-2bc3f212b4da'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:51:21.763858 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-0c662beb-5fb2-4074-aa4c-42374ccd33ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:50:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['4922fc58-f2eb-480a-878f-2bc3f212b4da'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:51:21.771365 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-8ae8154d-fecf-4a43-acde-a5766d6cc389 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "DELETE /v2.0/floatingips/82381b73-8875-486b-bf4a-c647dafc0cbe HTTP/1.1" status: 204 len: 168 time: 0.7985821 Sep 18 08:51:21.771365 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '825bdf32-25b4-4b50-a9b5-ed2f13f19319', 'tag': '068a71a1-cf8a-4759-a743-216fe1a17a75'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:51:21.771991 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2e6da005-c177-49e1-9047-0ad18ce70a10" -d '{"events": [{"name": "network-changed", "server_uuid": "825bdf32-25b4-4b50-a9b5-ed2f13f19319", "tag": "068a71a1-cf8a-4759-a743-216fe1a17a75"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:51:21.810850 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:51:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-206752ef-558e-4823-a97b-66a5eaf6b598 x-openstack-request-id: req-206752ef-558e-4823-a97b-66a5eaf6b598 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:51:21.811159 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "825bdf32-25b4-4b50-a9b5-ed2f13f19319", "tag": "068a71a1-cf8a-4759-a743-216fe1a17a75", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:51:21.811404 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-206752ef-558e-4823-a97b-66a5eaf6b598 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:51:21.811888 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '825bdf32-25b4-4b50-a9b5-ed2f13f19319', 'tag': '068a71a1-cf8a-4759-a743-216fe1a17a75', 'status': 'completed', 'code': 200} Sep 18 08:51:21.888563 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-0c662beb-5fb2-4074-aa4c-42374ccd33ef None None] Set router 4922fc58-f2eb-480a-878f-2bc3f212b4da gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:51:21.910322 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e6da005-c177-49e1-9047-0ad18ce70a10 req-9bf80ccc-b062-4c75-b145-c632c80858ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:21.911976 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2e6da005-c177-49e1-9047-0ad18ce70a10 req-9bf80ccc-b062-4c75-b145-c632c80858ff service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=0c7c58787ad549afa94b716f4c2f187b&device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 1099 time: 0.0538254 Sep 18 08:51:22.049589 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e6da005-c177-49e1-9047-0ad18ce70a10 req-2aa52c47-29b9-4058-bbfd-dfe3acd5bfb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:22.051108 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2e6da005-c177-49e1-9047-0ad18ce70a10 req-2aa52c47-29b9-4058-bbfd-dfe3acd5bfb7 service neutron] 10.222.0.13 "GET /v2.0/networks?id=000f3583-b7de-458d-9146-0010cd28b00d HTTP/1.1" status: 200 len: 913 time: 0.1312039 Sep 18 08:51:22.109103 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2e6da005-c177-49e1-9047-0ad18ce70a10 req-11c07976-1d7b-4595-9d45-7f5947bc6683 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=068a71a1-cf8a-4759-a743-216fe1a17a75 HTTP/1.1" status: 200 len: 217 time: 0.0434406 Sep 18 08:51:22.135471 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-0c662beb-5fb2-4074-aa4c-42374ccd33ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 4, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port': {'id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ad:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 474, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:54Z', 'updated_at': '2021-09-18T08:41:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '4eb6aada-4647-4cc0-b357-a3113e1607e9', 'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'mac_address': 'fa:16:3e:49:34:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_interface', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:56Z', 'updated_at': '2021-09-18T08:42:01Z', 'revision_number': 5, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'subnets': [{'id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:51:22.151267 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b40cbf21-833b-45da-990e-a2d4f4086765 req-89ceeac3-b1e8-47ae-b4ad-2bd081d96c9b tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:22.152758 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b40cbf21-833b-45da-990e-a2d4f4086765 req-89ceeac3-b1e8-47ae-b4ad-2bd081d96c9b tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 946 time: 0.1471043 Sep 18 08:51:22.162456 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c662beb-5fb2-4074-aa4c-42374ccd33ef None None] Checking router: 4922fc58-f2eb-480a-878f-2bc3f212b4da for host: dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:51:22.172126 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c662beb-5fb2-4074-aa4c-42374ccd33ef None None] Routers {'4922fc58-f2eb-480a-878f-2bc3f212b4da'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:51:22.172126 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-0c662beb-5fb2-4074-aa4c-42374ccd33ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:50:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['4922fc58-f2eb-480a-878f-2bc3f212b4da'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:51:22.184898 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e6da005-c177-49e1-9047-0ad18ce70a10 req-85165879-ca4c-4bc9-acb8-f7c0e0595795 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:22.186392 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2e6da005-c177-49e1-9047-0ad18ce70a10 req-85165879-ca4c-4bc9-acb8-f7c0e0595795 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=a4c047cf-cba6-4b94-8339-59469f96c92a HTTP/1.1" status: 200 len: 851 time: 0.0687432 Sep 18 08:51:22.202471 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b40cbf21-833b-45da-990e-a2d4f4086765 req-62940d13-c4d4-40c3-8e92-fc510cb41658 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416420 Sep 18 08:51:22.242599 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e6da005-c177-49e1-9047-0ad18ce70a10 req-b09c309f-93d1-4cfe-bb61-a60e2858ecb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:22.244091 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2e6da005-c177-49e1-9047-0ad18ce70a10 req-b09c309f-93d1-4cfe-bb61-a60e2858ecb7 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=000f3583-b7de-458d-9146-0010cd28b00d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0407832 Sep 18 08:51:22.281159 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-0c662beb-5fb2-4074-aa4c-42374ccd33ef None None] Set router 4922fc58-f2eb-480a-878f-2bc3f212b4da gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:51:22.341373 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2e6da005-c177-49e1-9047-0ad18ce70a10 req-beffe4a4-ac96-4869-b2f9-a17927ef68cd service neutron] 10.222.0.13 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0887277 Sep 18 08:51:22.409307 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-85cf077a-8ecc-4f26-9c50-b402edb1db63 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:22.431276 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2e6da005-c177-49e1-9047-0ad18ce70a10 req-3e49e1ae-3dfe-41bb-b4de-db2f149af5cf service neutron] 10.222.0.13 "GET /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0823340 Sep 18 08:51:22.481917 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-0c662beb-5fb2-4074-aa4c-42374ccd33ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 4, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port': {'id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ad:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 474, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:54Z', 'updated_at': '2021-09-18T08:41:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '4eb6aada-4647-4cc0-b357-a3113e1607e9', 'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'mac_address': 'fa:16:3e:49:34:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_interface', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:56Z', 'updated_at': '2021-09-18T08:42:01Z', 'revision_number': 5, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'subnets': [{'id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:51:22.508313 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c662beb-5fb2-4074-aa4c-42374ccd33ef None None] The sync data for ids ['4922fc58-f2eb-480a-878f-2bc3f212b4da'] in dv-cinder-804470-6-iscsi is: [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:41:56Z', 'revision_number': 4, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port': {'id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ad:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 474, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:54Z', 'updated_at': '2021-09-18T08:41:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': '4eb6aada-4647-4cc0-b357-a3113e1607e9', 'name': '', 'network_id': '000f3583-b7de-458d-9146-0010cd28b00d', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'mac_address': 'fa:16:3e:49:34:f2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_interface', 'standard_attr_id': 475, 'fixed_ips': [{'subnet_id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:56Z', 'updated_at': '2021-09-18T08:42:01Z', 'revision_number': 5, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'subnets': [{'id': 'a4c047cf-cba6-4b94-8339-59469f96c92a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:51:22.711651 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0b8c96ba-6a8c-4e5f-b20d-e03e6df25945 None None] New status for floating IP 82381b73-8875-486b-bf4a-c647dafc0cbe: DOWN {{(pid=94348) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 18 08:51:23.225340 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:23.319961 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13195bf7-0961-4a2f-93e7-e6e841e10eac req-ebd0d47f-c4ef-4415-88d6-f7e17506d6de tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:23.321487 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-13195bf7-0961-4a2f-93e7-e6e841e10eac req-ebd0d47f-c4ef-4415-88d6-f7e17506d6de tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 946 time: 0.0528526 Sep 18 08:51:23.365989 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-13195bf7-0961-4a2f-93e7-e6e841e10eac req-d3086fb5-8f4c-481b-a0e1-4d9827c00344 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/security-groups?id=c480fa62-0ee8-4f20-8da2-07bbb721cd7c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0383594 Sep 18 08:51:23.394718 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:23.901542 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3288bfd-15f7-4dbc-930a-f343bfb9a060 req-a16fd6a7-19ba-4b4b-a081-f865cbd25ed6 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:23.903182 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b3288bfd-15f7-4dbc-930a-f343bfb9a060 req-a16fd6a7-19ba-4b4b-a081-f865cbd25ed6 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.13 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 946 time: 0.0457418 Sep 18 08:51:23.990490 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-b3288bfd-15f7-4dbc-930a-f343bfb9a060 req-73fb1cc0-b8a9-49de-9637-56c975ac2542 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Deleting port 068a71a1-cf8a-4759-a743-216fe1a17a75 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:51:23.990777 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-b3288bfd-15f7-4dbc-930a-f343bfb9a060 req-73fb1cc0-b8a9-49de-9637-56c975ac2542 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:24.082748 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-b3288bfd-15f7-4dbc-930a-f343bfb9a060 req-73fb1cc0-b8a9-49de-9637-56c975ac2542 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] For port 068a71a1-cf8a-4759-a743-216fe1a17a75, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=068a71a1-cf8a-4759-a743-216fe1a17a75,segment=NetworkSegment(c215153d-2878-4c82-8dc0-2a92b453bf12),segment_id=c215153d-2878-4c82-8dc0-2a92b453bf12)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:51:24.083115 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-b3288bfd-15f7-4dbc-930a-f343bfb9a060 req-73fb1cc0-b8a9-49de-9637-56c975ac2542 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:24.094616 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-b3288bfd-15f7-4dbc-930a-f343bfb9a060 req-73fb1cc0-b8a9-49de-9637-56c975ac2542 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Calling delete_port for 068a71a1-cf8a-4759-a743-216fe1a17a75 owned by compute:nova {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:51:24.221578 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-b3288bfd-15f7-4dbc-930a-f343bfb9a060 req-73fb1cc0-b8a9-49de-9637-56c975ac2542 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:24.248878 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73fb1cc0-b8a9-49de-9637-56c975ac2542 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Pushing event deleted for resources: {'Port': ['ID=068a71a1-cf8a-4759-a743-216fe1a17a75,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:51:24.288223 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-b3288bfd-15f7-4dbc-930a-f343bfb9a060 req-73fb1cc0-b8a9-49de-9637-56c975ac2542 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] No DVR routers for this DVR port 068a71a1-cf8a-4759-a743-216fe1a17a75 on host hv-cinder-80447 {{(pid=94347) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:51:24.290662 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-b3288bfd-15f7-4dbc-930a-f343bfb9a060 req-73fb1cc0-b8a9-49de-9637-56c975ac2542 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:24.292660 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b3288bfd-15f7-4dbc-930a-f343bfb9a060 req-73fb1cc0-b8a9-49de-9637-56c975ac2542 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.13 "DELETE /v2.0/ports/068a71a1-cf8a-4759-a743-216fe1a17a75 HTTP/1.1" status: 204 len: 173 time: 0.3825066 Sep 18 08:51:24.293094 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '825bdf32-25b4-4b50-a9b5-ed2f13f19319', 'name': 'network-vif-deleted', 'tag': '068a71a1-cf8a-4759-a743-216fe1a17a75'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:51:24.295343 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ebae2726-239b-43c2-a3e7-ae4de8696fb3" -d '{"events": [{"server_uuid": "825bdf32-25b4-4b50-a9b5-ed2f13f19319", "name": "network-vif-deleted", "tag": "068a71a1-cf8a-4759-a743-216fe1a17a75"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:51:24.335200 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:51:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d358d3e5-56c3-4b8c-94f1-8db930495eae x-openstack-request-id: req-d358d3e5-56c3-4b8c-94f1-8db930495eae {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:51:24.335836 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "825bdf32-25b4-4b50-a9b5-ed2f13f19319", "name": "network-vif-deleted", "tag": "068a71a1-cf8a-4759-a743-216fe1a17a75", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:51:24.335836 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-d358d3e5-56c3-4b8c-94f1-8db930495eae {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:51:24.336127 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '825bdf32-25b4-4b50-a9b5-ed2f13f19319', 'name': 'network-vif-deleted', 'tag': '068a71a1-cf8a-4759-a743-216fe1a17a75', 'status': 'completed', 'code': 200} Sep 18 08:51:24.461500 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6fa14b12-b9bd-4975-a0df-5f5a414df5ee req-f932bc81-0df2-47c3-b25d-e6715be01221 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "GET /v2.0/ports?device_id=825bdf32-25b4-4b50-a9b5-ed2f13f19319 HTTP/1.1" status: 200 len: 210 time: 0.0254912 Sep 18 08:51:24.905193 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:25.514711 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 37930) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:51:25.636739 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.plugin [None req-d756b82e-db14-4f90-9b04-961eeb8f0350 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Deleting port 1fc79279-be7c-4418-b2a3-5afb8e38c589 {{(pid=94346) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:51:25.637152 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d756b82e-db14-4f90-9b04-961eeb8f0350 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:25.712264 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d756b82e-db14-4f90-9b04-961eeb8f0350 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:25.712592 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d756b82e-db14-4f90-9b04-961eeb8f0350 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:25.724636 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.plugin [None req-d756b82e-db14-4f90-9b04-961eeb8f0350 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Calling delete_port for 1fc79279-be7c-4418-b2a3-5afb8e38c589 owned by network:floatingip {{(pid=94346) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:51:25.845720 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d756b82e-db14-4f90-9b04-961eeb8f0350 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:25.872327 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d756b82e-db14-4f90-9b04-961eeb8f0350 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Pushing event deleted for resources: {'Port': ['ID=1fc79279-be7c-4418-b2a3-5afb8e38c589,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:51:25.883926 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d756b82e-db14-4f90-9b04-961eeb8f0350 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:51:25.884282 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d756b82e-db14-4f90-9b04-961eeb8f0350 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:51:25.884629 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d756b82e-db14-4f90-9b04-961eeb8f0350 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:51:25.884971 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d756b82e-db14-4f90-9b04-961eeb8f0350 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:51:25.885338 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d756b82e-db14-4f90-9b04-961eeb8f0350 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:51:25.885676 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d756b82e-db14-4f90-9b04-961eeb8f0350 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:51:25.886010 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d756b82e-db14-4f90-9b04-961eeb8f0350 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:51:25.886345 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d756b82e-db14-4f90-9b04-961eeb8f0350 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:51:25.886678 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d756b82e-db14-4f90-9b04-961eeb8f0350 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:51:25.887007 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d756b82e-db14-4f90-9b04-961eeb8f0350 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:51:25.887336 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d756b82e-db14-4f90-9b04-961eeb8f0350 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:51:25.887662 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d756b82e-db14-4f90-9b04-961eeb8f0350 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:51:25.938320 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d756b82e-db14-4f90-9b04-961eeb8f0350 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for floatingip, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:25.941325 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d756b82e-db14-4f90-9b04-961eeb8f0350 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for floatingip, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:25.942481 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-d756b82e-db14-4f90-9b04-961eeb8f0350 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "DELETE /v2.0/floatingips/4fbfe49e-e2af-4355-b7c5-c404ed6af093 HTTP/1.1" status: 204 len: 168 time: 0.4267788 Sep 18 08:51:26.779547 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fa531084-d76e-4707-9ccb-3d8e464166a8 req-718724ec-5467-41ad-9f93-7c7cf6981fe5 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0396259 Sep 18 08:51:26.850299 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa531084-d76e-4707-9ccb-3d8e464166a8 req-b911caf6-0009-4c1f-b327-639699745af4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:26.851707 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fa531084-d76e-4707-9ccb-3d8e464166a8 req-b911caf6-0009-4c1f-b327-639699745af4 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=334211ea09044272868662e38cb1a4ad&device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 1098 time: 0.0389349 Sep 18 08:51:26.953776 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa531084-d76e-4707-9ccb-3d8e464166a8 req-60f24acd-8830-4203-869b-22a12d2edb73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:26.956766 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fa531084-d76e-4707-9ccb-3d8e464166a8 req-60f24acd-8830-4203-869b-22a12d2edb73 service neutron] 10.222.0.13 "GET /v2.0/networks?id=22bf7558-e572-4c3e-b191-f1edcd47c9f2 HTTP/1.1" status: 200 len: 911 time: 0.0857308 Sep 18 08:51:27.026426 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fa531084-d76e-4707-9ccb-3d8e464166a8 req-c6c2a529-d26e-49e1-9d87-3eaacce3b6f8 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=17c68a27-b17a-499d-9bde-484199d59ae2 HTTP/1.1" status: 200 len: 1001 time: 0.0619171 Sep 18 08:51:27.072524 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa531084-d76e-4707-9ccb-3d8e464166a8 req-44503d8f-a845-4b37-aa2c-9e0fcab4e46b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:27.073933 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fa531084-d76e-4707-9ccb-3d8e464166a8 req-44503d8f-a845-4b37-aa2c-9e0fcab4e46b service neutron] 10.222.0.13 "GET /v2.0/subnets?id=e900aa03-4504-4ae5-a8a2-0da036634ce2 HTTP/1.1" status: 200 len: 849 time: 0.0411062 Sep 18 08:51:27.116737 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa531084-d76e-4707-9ccb-3d8e464166a8 req-e1e00830-fcb2-473f-ae39-6ab3bc6d82b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:27.118416 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fa531084-d76e-4707-9ccb-3d8e464166a8 req-e1e00830-fcb2-473f-ae39-6ab3bc6d82b9 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=22bf7558-e572-4c3e-b191-f1edcd47c9f2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0376177 Sep 18 08:51:27.125987 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 37948) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:51:27.183811 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-cc64c0d7-57ee-4fdb-8277-1c0d4c766c54 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:27.210120 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-cc64c0d7-57ee-4fdb-8277-1c0d4c766c54 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:27.226234 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 068a71a1-cf8a-4759-a743-216fe1a17a75 no longer exists at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:51:27.250605 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] No Port match for: 068a71a1-cf8a-4759-a743-216fe1a17a75 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:51:27.250962 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 068a71a1-cf8a-4759-a743-216fe1a17a75 not bound to the agent host hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:51:27.281076 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-cc64c0d7-57ee-4fdb-8277-1c0d4c766c54 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:27.284322 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-cc64c0d7-57ee-4fdb-8277-1c0d4c766c54 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:27.285688 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-cc64c0d7-57ee-4fdb-8277-1c0d4c766c54 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] 10.222.0.35 "DELETE /v2.0/security-groups/c480fa62-0ee8-4f20-8da2-07bbb721cd7c HTTP/1.1" status: 204 len: 168 time: 0.1586425 Sep 18 08:51:27.296477 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc64c0d7-57ee-4fdb-8277-1c0d4c766c54 tempest-TestVolumeBootPattern-2104494661 tempest-TestVolumeBootPattern-2104494661-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c480fa62-0ee8-4f20-8da2-07bbb721cd7c,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:51:27.350366 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 37952) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:51:27.466204 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fa531084-d76e-4707-9ccb-3d8e464166a8 req-12c47994-395e-488b-b11f-cf87d3715179 service neutron] 10.222.0.13 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3398924 Sep 18 08:51:27.555486 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fa531084-d76e-4707-9ccb-3d8e464166a8 req-2df01b67-f7f4-4105-94e2-83e43a3b4e1d service neutron] 10.222.0.13 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817254 Sep 18 08:51:27.810904 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d0fa8730-20be-4d9d-bc3b-34745e2d23c6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-783372'] for router_interface, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:28.040733 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.plugin [None req-d0fa8730-20be-4d9d-bc3b-34745e2d23c6 admin admin] Deleting port 4eb6aada-4647-4cc0-b357-a3113e1607e9 {{(pid=94346) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:51:28.041082 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d0fa8730-20be-4d9d-bc3b-34745e2d23c6 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:28.117790 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.db [None req-d0fa8730-20be-4d9d-bc3b-34745e2d23c6 admin admin] For port 4eb6aada-4647-4cc0-b357-a3113e1607e9, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=4eb6aada-4647-4cc0-b357-a3113e1607e9,segment=NetworkSegment(c215153d-2878-4c82-8dc0-2a92b453bf12),segment_id=c215153d-2878-4c82-8dc0-2a92b453bf12)] {{(pid=94346) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:51:28.118149 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d0fa8730-20be-4d9d-bc3b-34745e2d23c6 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:28.130447 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.plugin [None req-d0fa8730-20be-4d9d-bc3b-34745e2d23c6 admin admin] Calling delete_port for 4eb6aada-4647-4cc0-b357-a3113e1607e9 owned by network:router_interface {{(pid=94346) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:51:28.303130 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d0fa8730-20be-4d9d-bc3b-34745e2d23c6 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:28.328969 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0fa8730-20be-4d9d-bc3b-34745e2d23c6 admin admin] Pushing event deleted for resources: {'Port': ['ID=4eb6aada-4647-4cc0-b357-a3113e1607e9,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:51:28.707359 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d0fa8730-20be-4d9d-bc3b-34745e2d23c6 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-580042', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-785084'] for router_interface, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:28.909777 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d0fa8730-20be-4d9d-bc3b-34745e2d23c6 admin admin] Router 4922fc58-f2eb-480a-878f-2bc3f212b4da has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94346) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:51:29.017034 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d0fa8730-20be-4d9d-bc3b-34745e2d23c6 admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94346) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:51:29.022629 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-d0fa8730-20be-4d9d-bc3b-34745e2d23c6 admin admin] 10.222.0.35 "PUT /v2.0/routers/4922fc58-f2eb-480a-878f-2bc3f212b4da/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6711843 Sep 18 08:51:29.025072 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 37962) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:51:29.029814 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfdf859d-45d0-41c2-98d9-bbfc4237cf75 None None] Sync routers for ids ['4922fc58-f2eb-480a-878f-2bc3f212b4da'] in dv-cinder-804470-6-iscsi {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:51:29.038542 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfdf859d-45d0-41c2-98d9-bbfc4237cf75 None None] Routers {'4922fc58-f2eb-480a-878f-2bc3f212b4da'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:51:29.039157 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-bfdf859d-45d0-41c2-98d9-bbfc4237cf75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:51:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['4922fc58-f2eb-480a-878f-2bc3f212b4da'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:51:29.128176 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c1ef08be-d9cc-4c74-ab9e-b38667c2a5fa admin admin] Notify callbacks [] for router, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:29.151046 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-bfdf859d-45d0-41c2-98d9-bbfc4237cf75 None None] Set router 4922fc58-f2eb-480a-878f-2bc3f212b4da gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:51:29.232127 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c1ef08be-d9cc-4c74-ab9e-b38667c2a5fa admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:29.286142 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.plugin [None req-c1ef08be-d9cc-4c74-ab9e-b38667c2a5fa admin admin] Deleting port f206227f-a59a-4423-8cb4-9d1abe6f264f {{(pid=94346) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:51:29.286477 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c1ef08be-d9cc-4c74-ab9e-b38667c2a5fa admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:29.369090 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.db [None req-c1ef08be-d9cc-4c74-ab9e-b38667c2a5fa admin admin] For port f206227f-a59a-4423-8cb4-9d1abe6f264f, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=f206227f-a59a-4423-8cb4-9d1abe6f264f,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94346) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:51:29.369487 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c1ef08be-d9cc-4c74-ab9e-b38667c2a5fa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:29.381706 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.plugin [None req-c1ef08be-d9cc-4c74-ab9e-b38667c2a5fa admin admin] Calling delete_port for f206227f-a59a-4423-8cb4-9d1abe6f264f owned by network:router_gateway {{(pid=94346) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:51:29.430642 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-bfdf859d-45d0-41c2-98d9-bbfc4237cf75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183'}], 'enable_snat': True}, 'gw_port_id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:51:28Z', 'revision_number': 5, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port': {'id': 'f206227f-a59a-4423-8cb4-9d1abe6f264f', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:63:ad:c5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'device_owner': 'network:router_gateway', 'standard_attr_id': 474, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.183', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:54Z', 'updated_at': '2021-09-18T08:41:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:51:29.459431 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfdf859d-45d0-41c2-98d9-bbfc4237cf75 None None] Checking router: 4922fc58-f2eb-480a-878f-2bc3f212b4da for host: dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:51:29.467578 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfdf859d-45d0-41c2-98d9-bbfc4237cf75 None None] Routers {'4922fc58-f2eb-480a-878f-2bc3f212b4da'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:51:29.468183 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-bfdf859d-45d0-41c2-98d9-bbfc4237cf75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:51:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['4922fc58-f2eb-480a-878f-2bc3f212b4da'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:51:29.549757 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c1ef08be-d9cc-4c74-ab9e-b38667c2a5fa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:29.553620 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-bfdf859d-45d0-41c2-98d9-bbfc4237cf75 None None] Set router 4922fc58-f2eb-480a-878f-2bc3f212b4da gateway port host: None {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:51:29.575096 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1ef08be-d9cc-4c74-ab9e-b38667c2a5fa admin admin] Pushing event deleted for resources: {'Port': ['ID=f206227f-a59a-4423-8cb4-9d1abe6f264f,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:51:29.605420 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-bfdf859d-45d0-41c2-98d9-bbfc4237cf75 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:51:29Z', 'revision_number': 6, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port_host': None}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:51:29.634532 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfdf859d-45d0-41c2-98d9-bbfc4237cf75 None None] The sync data for ids ['4922fc58-f2eb-480a-878f-2bc3f212b4da'] in dv-cinder-804470-6-iscsi is: [{'id': '4922fc58-f2eb-480a-878f-2bc3f212b4da', 'name': 'tempest-TestVolumeBootPattern-1303512803-router', 'tenant_id': '0c7c58787ad549afa94b716f4c2f187b', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:53Z', 'updated_at': '2021-09-18T08:51:29Z', 'revision_number': 6, 'project_id': '0c7c58787ad549afa94b716f4c2f187b', 'gw_port_host': None}] {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:51:29.654169 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c1ef08be-d9cc-4c74-ab9e-b38667c2a5fa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-785018'] for router_gateway, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:29.748536 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c1ef08be-d9cc-4c74-ab9e-b38667c2a5fa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-782379', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2977'] for router, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:29.750923 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c1ef08be-d9cc-4c74-ab9e-b38667c2a5fa admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:29.792986 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c1ef08be-d9cc-4c74-ab9e-b38667c2a5fa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-782544'] for router, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:29.793544 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c1ef08be-d9cc-4c74-ab9e-b38667c2a5fa admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4922fc58-f2eb-480a-878f-2bc3f212b4da {{(pid=94346) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 18 08:51:29.797760 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c1ef08be-d9cc-4c74-ab9e-b38667c2a5fa admin admin] Notify callbacks [] for router, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:29.799585 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-c1ef08be-d9cc-4c74-ab9e-b38667c2a5fa admin admin] 10.222.0.35 "DELETE /v2.0/routers/4922fc58-f2eb-480a-878f-2bc3f212b4da HTTP/1.1" status: 204 len: 168 time: 0.7734544 Sep 18 08:51:29.802102 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 37970) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:51:29.843486 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_v2 [None req-d1a62aaf-7eed-482f-ae68-932a6c127f2f admin admin] Deleting subnet a4c047cf-cba6-4b94-8339-59469f96c92a {{(pid=94346) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 18 08:51:29.846846 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d1a62aaf-7eed-482f-ae68-932a6c127f2f admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:29.879322 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d1a62aaf-7eed-482f-ae68-932a6c127f2f admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14122726'] for subnet, precommit_delete_associations {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:29.957759 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d1a62aaf-7eed-482f-ae68-932a6c127f2f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1821528'] for subnet, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:30.032239 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d1a62aaf-7eed-482f-ae68-932a6c127f2f admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1821519', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14290141', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14198653'] for subnet, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:30.065014 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1a62aaf-7eed-482f-ae68-932a6c127f2f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a4c047cf-cba6-4b94-8339-59469f96c92a,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:51:30.067175 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-d1a62aaf-7eed-482f-ae68-932a6c127f2f admin admin] Notify callbacks [] for subnet, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:30.069435 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-d1a62aaf-7eed-482f-ae68-932a6c127f2f admin admin] 10.222.0.35 "DELETE /v2.0/subnets/a4c047cf-cba6-4b94-8339-59469f96c92a HTTP/1.1" status: 204 len: 168 time: 0.2664008 Sep 18 08:51:30.071964 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 37972) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:51:30.076439 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1d6ba7f4-7021-461f-8b0f-bf7ba4a804e1 None None] Network 000f3583-b7de-458d-9146-0010cd28b00d requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:51:30.158562 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9f2db4e9-5af1-498e-90b7-155e1b261ffe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1861545'] for network, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:30.166014 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 4eb6aada-4647-4cc0-b357-a3113e1607e9 no longer exists at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:51:30.192593 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-536c997d-2873-442a-81bf-9fe918803742 None None] No Port match for: 4eb6aada-4647-4cc0-b357-a3113e1607e9 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:51:30.193267 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 4eb6aada-4647-4cc0-b357-a3113e1607e9 not bound to the agent host dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:51:30.214878 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-9f2db4e9-5af1-498e-90b7-155e1b261ffe admin admin] Deleting port 578ee7da-5391-495a-b55d-a0609cbf3eb1 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:51:30.215228 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9f2db4e9-5af1-498e-90b7-155e1b261ffe admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:30.281108 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [None req-9f2db4e9-5af1-498e-90b7-155e1b261ffe admin admin] For port 578ee7da-5391-495a-b55d-a0609cbf3eb1, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=578ee7da-5391-495a-b55d-a0609cbf3eb1,segment=NetworkSegment(c215153d-2878-4c82-8dc0-2a92b453bf12),segment_id=c215153d-2878-4c82-8dc0-2a92b453bf12)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:51:30.281509 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9f2db4e9-5af1-498e-90b7-155e1b261ffe admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:30.294085 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-9f2db4e9-5af1-498e-90b7-155e1b261ffe admin admin] Calling delete_port for 578ee7da-5391-495a-b55d-a0609cbf3eb1 owned by network:dhcp {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:51:30.370203 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9f2db4e9-5af1-498e-90b7-155e1b261ffe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:30.399641 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f2db4e9-5af1-498e-90b7-155e1b261ffe admin admin] Pushing event deleted for resources: {'Port': ['ID=578ee7da-5391-495a-b55d-a0609cbf3eb1,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:51:30.404435 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9f2db4e9-5af1-498e-90b7-155e1b261ffe admin admin] No DVR routers for this DVR port 578ee7da-5391-495a-b55d-a0609cbf3eb1 on host dv-cinder-804470-6-iscsi {{(pid=94347) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:51:30.465088 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f8e5e72e-1d7d-49c0-9929-7d6c3c8aab0b None None] DHCP port deletion for 000f3583-b7de-458d-9146-0010cd28b00d request from dv-cinder-804470-6-iscsi {{(pid=94348) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 18 08:51:30.482473 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9f2db4e9-5af1-498e-90b7-155e1b261ffe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1806559', 'neutron.services.segments.db._delete_segments_for_network-8732885752733'] for network, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:30.502259 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.services.segments.db [None req-9f2db4e9-5af1-498e-90b7-155e1b261ffe admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['000f3583-b7de-458d-9146-0010cd28b00d']}} {{(pid=94347) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:51:30.511080 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.services.segments.db [None req-9f2db4e9-5af1-498e-90b7-155e1b261ffe admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c215153d-2878-4c82-8dc0-2a92b453bf12') {'for_net_delete': True} {{(pid=94347) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:51:30.511373 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.services.segments.db [None req-9f2db4e9-5af1-498e-90b7-155e1b261ffe admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c215153d-2878-4c82-8dc0-2a92b453bf12') {} {{(pid=94347) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:51:30.520829 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9f2db4e9-5af1-498e-90b7-155e1b261ffe admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732885753254', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-13659327'] for segment, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:30.533432 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9f2db4e9-5af1-498e-90b7-155e1b261ffe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:30.539140 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9f2db4e9-5af1-498e-90b7-155e1b261ffe admin admin] Releasing vlan 200 on physical network physnet1 to pool {{(pid=94347) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 18 08:51:30.539528 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9f2db4e9-5af1-498e-90b7-155e1b261ffe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15067250'] for segment, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: Traceback (most recent call last): Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: timer() Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: cb(*args, **kw) Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: return func(*args, **kwargs) Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: self._notify() Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: self.callback(batched_events) Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: event.method(event) Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: aggregate_uuid = self.p_client.list_aggregates( Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: return f(self, *a, **k) Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: return self._get(url).json() Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: return self.request(url, 'GET', **kwargs) Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: base_url = self.get_endpoint(auth, allow=allow, Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 18 08:51:30.541132 dv-cinder-804470-6-iscsi neutron-server[94347]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 18 08:51:30.599136 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9f2db4e9-5af1-498e-90b7-155e1b261ffe admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1806534', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-784926'] for network, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:30.604542 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-9f2db4e9-5af1-498e-90b7-155e1b261ffe admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:30.606352 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-9f2db4e9-5af1-498e-90b7-155e1b261ffe admin admin] 10.222.0.35 "DELETE /v2.0/networks/000f3583-b7de-458d-9146-0010cd28b00d HTTP/1.1" status: 204 len: 168 time: 0.5333850 Sep 18 08:51:30.609334 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 37976) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:51:30.623766 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f2db4e9-5af1-498e-90b7-155e1b261ffe admin admin] Pushing event deleted for resources: {'Network': ['ID=000f3583-b7de-458d-9146-0010cd28b00d,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:51:30.962327 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-834499de-5d29-4e58-885f-588e64603af0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-783372'] for router_interface, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:31.159870 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30d96d3a-bb8f-4814-8eb9-19e56a866589 req-52fbd9ab-49dd-4031-a4db-cf43fea4c4ca tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:31.161326 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-30d96d3a-bb8f-4814-8eb9-19e56a866589 req-52fbd9ab-49dd-4031-a4db-cf43fea4c4ca tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0703948 Sep 18 08:51:31.230717 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-30d96d3a-bb8f-4814-8eb9-19e56a866589 req-e782d44e-3f15-432c-8ccd-06d86c3bdeb7 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0621345 Sep 18 08:51:31.274287 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-834499de-5d29-4e58-885f-588e64603af0 admin admin] Deleting port 4fbf206e-55b5-4ee6-ab2b-e3d758a81072 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:51:31.274636 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-834499de-5d29-4e58-885f-588e64603af0 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:31.352572 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [None req-834499de-5d29-4e58-885f-588e64603af0 admin admin] For port 4fbf206e-55b5-4ee6-ab2b-e3d758a81072, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=4fbf206e-55b5-4ee6-ab2b-e3d758a81072,segment=NetworkSegment(8465a312-532d-4cae-ae69-08750a6f234e),segment_id=8465a312-532d-4cae-ae69-08750a6f234e)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:51:31.352917 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-834499de-5d29-4e58-885f-588e64603af0 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:31.364876 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-834499de-5d29-4e58-885f-588e64603af0 admin admin] Calling delete_port for 4fbf206e-55b5-4ee6-ab2b-e3d758a81072 owned by network:router_interface {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:51:31.535106 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-834499de-5d29-4e58-885f-588e64603af0 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:31.560785 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-834499de-5d29-4e58-885f-588e64603af0 admin admin] Pushing event deleted for resources: {'Port': ['ID=4fbf206e-55b5-4ee6-ab2b-e3d758a81072,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:51:31.723200 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-834499de-5d29-4e58-885f-588e64603af0 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-580042', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-785084'] for router_interface, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:31.821394 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device f206227f-a59a-4423-8cb4-9d1abe6f264f no longer exists at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:51:31.843989 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-536c997d-2873-442a-81bf-9fe918803742 None None] No Port match for: f206227f-a59a-4423-8cb4-9d1abe6f264f {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:51:31.844258 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device f206227f-a59a-4423-8cb4-9d1abe6f264f not bound to the agent host dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:51:31.844682 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 578ee7da-5391-495a-b55d-a0609cbf3eb1 no longer exists at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:51:31.865542 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-536c997d-2873-442a-81bf-9fe918803742 None None] No Port match for: 578ee7da-5391-495a-b55d-a0609cbf3eb1 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:51:31.865889 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 578ee7da-5391-495a-b55d-a0609cbf3eb1 not bound to the agent host dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:51:31.941703 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-834499de-5d29-4e58-885f-588e64603af0 admin admin] Router 7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5 has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94347) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:51:32.051615 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-834499de-5d29-4e58-885f-588e64603af0 admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94347) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:51:32.060265 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 37990) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:51:32.060797 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-834499de-5d29-4e58-885f-588e64603af0 admin admin] 10.222.0.35 "PUT /v2.0/routers/7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4499931 Sep 18 08:51:32.061398 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ded69dc-4548-4234-9799-6f55460c2f63 None None] Sync routers for ids ['7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5'] in dv-cinder-804470-6-iscsi {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:51:32.071100 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ded69dc-4548-4234-9799-6f55460c2f63 None None] Routers {'7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:51:32.071658 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-4ded69dc-4548-4234-9799-6f55460c2f63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:51:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:51:32.162294 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-72a26809-55b4-4cf4-b88d-522f335080fa admin admin] Notify callbacks [] for router, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:32.175832 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-4ded69dc-4548-4234-9799-6f55460c2f63 None None] Set router 7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:51:32.266058 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-72a26809-55b4-4cf4-b88d-522f335080fa admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:32.325315 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.plugin [None req-72a26809-55b4-4cf4-b88d-522f335080fa admin admin] Deleting port c6d050fc-3bc2-4b89-baaf-c1be3438b3f6 {{(pid=94346) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:51:32.325672 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-72a26809-55b4-4cf4-b88d-522f335080fa admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:32.363931 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-4ded69dc-4548-4234-9799-6f55460c2f63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5', 'name': 'tempest-TestVolumeBootPattern-977916314-router', 'tenant_id': '4d7fa64820344320b93dffee809df6ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.6'}], 'enable_snat': True}, 'gw_port_id': 'c6d050fc-3bc2-4b89-baaf-c1be3438b3f6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:58Z', 'updated_at': '2021-09-18T08:51:31Z', 'revision_number': 5, 'project_id': '4d7fa64820344320b93dffee809df6ff', 'gw_port': {'id': 'c6d050fc-3bc2-4b89-baaf-c1be3438b3f6', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:ae:b8:e1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 486, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.6', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:41:59Z', 'updated_at': '2021-09-18T08:42:05Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:51:32.369838 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a64bb8ae-fac9-4638-a8b1-41cc994d5219 req-feb621b4-935f-4948-9a85-84f038ebcfe4 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:32.371410 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a64bb8ae-fac9-4638-a8b1-41cc994d5219 req-feb621b4-935f-4948-9a85-84f038ebcfe4 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0541267 Sep 18 08:51:32.393944 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ded69dc-4548-4234-9799-6f55460c2f63 None None] Checking router: 7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5 for host: dv-cinder-804470-6-iscsi {{(pid=94348) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:51:32.402241 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ded69dc-4548-4234-9799-6f55460c2f63 None None] Routers {'7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94348) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:51:32.402856 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-4ded69dc-4548-4234-9799-6f55460c2f63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:51:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5'], 'active': True} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:51:32.411077 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a64bb8ae-fac9-4638-a8b1-41cc994d5219 req-0be07cc6-4aa5-4fcc-afc6-1221b04b8118 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0331781 Sep 18 08:51:32.414411 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.db [None req-72a26809-55b4-4cf4-b88d-522f335080fa admin admin] For port c6d050fc-3bc2-4b89-baaf-c1be3438b3f6, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=c6d050fc-3bc2-4b89-baaf-c1be3438b3f6,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94346) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:51:32.414783 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-72a26809-55b4-4cf4-b88d-522f335080fa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:32.433298 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.plugin [None req-72a26809-55b4-4cf4-b88d-522f335080fa admin admin] Calling delete_port for c6d050fc-3bc2-4b89-baaf-c1be3438b3f6 owned by network:router_gateway {{(pid=94346) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:51:32.601949 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-72a26809-55b4-4cf4-b88d-522f335080fa admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:32.615493 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_dvr_db [None req-4ded69dc-4548-4234-9799-6f55460c2f63 None None] Set router 7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5 gateway port host: None {{(pid=94348) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:51:32.627832 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72a26809-55b4-4cf4-b88d-522f335080fa admin admin] Pushing event deleted for resources: {'Port': ['ID=c6d050fc-3bc2-4b89-baaf-c1be3438b3f6,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:51:32.673784 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.l3_hamode_db [None req-4ded69dc-4548-4234-9799-6f55460c2f63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5', 'name': 'tempest-TestVolumeBootPattern-977916314-router', 'tenant_id': '4d7fa64820344320b93dffee809df6ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:58Z', 'updated_at': '2021-09-18T08:51:32Z', 'revision_number': 6, 'project_id': '4d7fa64820344320b93dffee809df6ff', 'gw_port_host': None}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94348) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:51:32.684774 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-72a26809-55b4-4cf4-b88d-522f335080fa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-785018'] for router_gateway, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:32.704137 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ded69dc-4548-4234-9799-6f55460c2f63 None None] The sync data for ids ['7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5'] in dv-cinder-804470-6-iscsi is: [{'id': '7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5', 'name': 'tempest-TestVolumeBootPattern-977916314-router', 'tenant_id': '4d7fa64820344320b93dffee809df6ff', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:41:58Z', 'updated_at': '2021-09-18T08:51:32Z', 'revision_number': 6, 'project_id': '4d7fa64820344320b93dffee809df6ff', 'gw_port_host': None}] {{(pid=94348) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:51:32.776132 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-72a26809-55b4-4cf4-b88d-522f335080fa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-782379', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2977'] for router, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:32.778256 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-72a26809-55b4-4cf4-b88d-522f335080fa admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:32.818051 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-72a26809-55b4-4cf4-b88d-522f335080fa admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-782544'] for router, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:32.818559 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-72a26809-55b4-4cf4-b88d-522f335080fa admin admin] Fanout notify agent at l3_agent the message router_deleted on router 7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5 {{(pid=94346) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 18 08:51:32.822623 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-72a26809-55b4-4cf4-b88d-522f335080fa admin admin] Notify callbacks [] for router, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:32.823767 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-72a26809-55b4-4cf4-b88d-522f335080fa admin admin] 10.222.0.35 "DELETE /v2.0/routers/7ad6dcaa-fff7-492f-b3d2-a4e690f50ac5 HTTP/1.1" status: 204 len: 168 time: 0.7625287 Sep 18 08:51:32.826388 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 37994) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:51:32.869016 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_v2 [None req-42a9f283-ef48-4edd-80c6-5fa822ede0c7 admin admin] Deleting subnet 75555034-92fb-4ece-a037-0b068488ec29 {{(pid=94346) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 18 08:51:32.871911 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-42a9f283-ef48-4edd-80c6-5fa822ede0c7 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:32.904876 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-42a9f283-ef48-4edd-80c6-5fa822ede0c7 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-14122726'] for subnet, precommit_delete_associations {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:32.982962 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-42a9f283-ef48-4edd-80c6-5fa822ede0c7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1821528'] for subnet, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:33.035211 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-42a9f283-ef48-4edd-80c6-5fa822ede0c7 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1821519', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-14290141', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-14198653'] for subnet, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:33.061964 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42a9f283-ef48-4edd-80c6-5fa822ede0c7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=75555034-92fb-4ece-a037-0b068488ec29,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:51:33.064561 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-42a9f283-ef48-4edd-80c6-5fa822ede0c7 admin admin] Notify callbacks [] for subnet, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:33.066508 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-42a9f283-ef48-4edd-80c6-5fa822ede0c7 admin admin] 10.222.0.35 "DELETE /v2.0/subnets/75555034-92fb-4ece-a037-0b068488ec29 HTTP/1.1" status: 204 len: 168 time: 0.2391777 Sep 18 08:51:33.069015 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 37996) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:51:33.074237 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10c5125b-4055-4b44-9830-a4a6a239de71 None None] Network 381227c0-612c-49cf-a6b8-b4b55d31fb02 requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:51:33.144991 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-00c98bdf-1053-425e-a680-7752554f49af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1861545'] for network, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:33.196002 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.plugin [None req-00c98bdf-1053-425e-a680-7752554f49af admin admin] Deleting port 218f0876-0173-499c-8e72-f52a4f3e02b5 {{(pid=94346) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:51:33.196345 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-00c98bdf-1053-425e-a680-7752554f49af admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:33.257189 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.db [None req-00c98bdf-1053-425e-a680-7752554f49af admin admin] For port 218f0876-0173-499c-8e72-f52a4f3e02b5, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=218f0876-0173-499c-8e72-f52a4f3e02b5,segment=NetworkSegment(8465a312-532d-4cae-ae69-08750a6f234e),segment_id=8465a312-532d-4cae-ae69-08750a6f234e)] {{(pid=94346) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:51:33.257581 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-00c98bdf-1053-425e-a680-7752554f49af admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:33.273070 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.plugin [None req-00c98bdf-1053-425e-a680-7752554f49af admin admin] Calling delete_port for 218f0876-0173-499c-8e72-f52a4f3e02b5 owned by network:dhcp {{(pid=94346) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:51:33.348578 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-00c98bdf-1053-425e-a680-7752554f49af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:33.372729 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00c98bdf-1053-425e-a680-7752554f49af admin admin] Pushing event deleted for resources: {'Port': ['ID=218f0876-0173-499c-8e72-f52a4f3e02b5,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:51:33.376239 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [None req-00c98bdf-1053-425e-a680-7752554f49af admin admin] No DVR routers for this DVR port 218f0876-0173-499c-8e72-f52a4f3e02b5 on host dv-cinder-804470-6-iscsi {{(pid=94346) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:51:33.445028 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-00c98bdf-1053-425e-a680-7752554f49af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1806559', 'neutron.services.segments.db._delete_segments_for_network-8732885752733'] for network, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:33.466222 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-00c98bdf-1053-425e-a680-7752554f49af admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['381227c0-612c-49cf-a6b8-b4b55d31fb02']}} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:51:33.477427 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-00c98bdf-1053-425e-a680-7752554f49af admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8465a312-532d-4cae-ae69-08750a6f234e') {'for_net_delete': True} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:51:33.477731 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.services.segments.db [None req-00c98bdf-1053-425e-a680-7752554f49af admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8465a312-532d-4cae-ae69-08750a6f234e') {} {{(pid=94346) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:51:33.486400 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-42d2681c-d60b-49cb-acd8-ea8266b4749a None None] DHCP port deletion for 381227c0-612c-49cf-a6b8-b4b55d31fb02 request from dv-cinder-804470-6-iscsi {{(pid=94348) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 18 08:51:33.491882 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-00c98bdf-1053-425e-a680-7752554f49af admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732885753254', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-14122733'] for segment, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:33.505421 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-00c98bdf-1053-425e-a680-7752554f49af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:33.511582 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-00c98bdf-1053-425e-a680-7752554f49af admin admin] Releasing vlan 217 on physical network physnet1 to pool {{(pid=94346) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 18 08:51:33.511978 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-00c98bdf-1053-425e-a680-7752554f49af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-14289667'] for segment, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: Traceback (most recent call last): Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: timer() Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: cb(*args, **kw) Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: return func(*args, **kwargs) Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: self._notify() Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: self.callback(batched_events) Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: event.method(event) Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: aggregate_uuid = self.p_client.list_aggregates( Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: return f(self, *a, **k) Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: return self._get(url).json() Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: return self.request(url, 'GET', **kwargs) Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: base_url = self.get_endpoint(auth, allow=allow, Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 18 08:51:33.513711 dv-cinder-804470-6-iscsi neutron-server[94346]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 18 08:51:33.549919 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-729be309-05ee-4884-84ec-3d4e3b632b1a req-6266caac-1bb3-46e2-a2ac-81641d47db5a tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:33.551544 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-729be309-05ee-4884-84ec-3d4e3b632b1a req-6266caac-1bb3-46e2-a2ac-81641d47db5a tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0647714 Sep 18 08:51:33.579003 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-00c98bdf-1053-425e-a680-7752554f49af admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1806534', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-784926'] for network, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:33.592167 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-00c98bdf-1053-425e-a680-7752554f49af admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:33.598338 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-00c98bdf-1053-425e-a680-7752554f49af admin admin] 10.222.0.35 "DELETE /v2.0/networks/381227c0-612c-49cf-a6b8-b4b55d31fb02 HTTP/1.1" status: 204 len: 168 time: 0.5283506 Sep 18 08:51:33.608881 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-729be309-05ee-4884-84ec-3d4e3b632b1a req-63d200fb-54cd-4043-abe4-29b0d0e78365 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0476768 Sep 18 08:51:33.610617 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00c98bdf-1053-425e-a680-7752554f49af admin admin] Pushing event deleted for resources: {'Network': ['ID=381227c0-612c-49cf-a6b8-b4b55d31fb02,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:51:33.716584 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 38002) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:51:33.759097 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-f074cb30-bebb-45e2-88c2-27b63a39413d admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=0c7c58787ad549afa94b716f4c2f187b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0410788 Sep 18 08:51:33.761821 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 38004) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:51:33.767451 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 218f0876-0173-499c-8e72-f52a4f3e02b5 no longer exists at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:51:33.788856 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-536c997d-2873-442a-81bf-9fe918803742 None None] No Port match for: 218f0876-0173-499c-8e72-f52a4f3e02b5 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:51:33.789521 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 218f0876-0173-499c-8e72-f52a4f3e02b5 not bound to the agent host dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:51:33.789952 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 4fbf206e-55b5-4ee6-ab2b-e3d758a81072 no longer exists at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:51:33.810078 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-536c997d-2873-442a-81bf-9fe918803742 None None] No Port match for: 4fbf206e-55b5-4ee6-ab2b-e3d758a81072 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:51:33.810493 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 4fbf206e-55b5-4ee6-ab2b-e3d758a81072 not bound to the agent host dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:51:33.810828 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1fc58c65-ccaf-43a8-b454-bdb66eca83c5 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:33.811451 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device c6d050fc-3bc2-4b89-baaf-c1be3438b3f6 no longer exists at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:51:33.831291 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-536c997d-2873-442a-81bf-9fe918803742 None None] No Port match for: c6d050fc-3bc2-4b89-baaf-c1be3438b3f6 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:51:33.831638 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device c6d050fc-3bc2-4b89-baaf-c1be3438b3f6 not bound to the agent host dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:51:33.838199 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1fc58c65-ccaf-43a8-b454-bdb66eca83c5 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:33.884808 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1fc58c65-ccaf-43a8-b454-bdb66eca83c5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:33.887272 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-1fc58c65-ccaf-43a8-b454-bdb66eca83c5 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:33.888442 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-1fc58c65-ccaf-43a8-b454-bdb66eca83c5 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/d8512039-443c-4490-b4a6-c8b163c8fdbc HTTP/1.1" status: 204 len: 168 time: 0.1256397 Sep 18 08:51:33.896764 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fc58c65-ccaf-43a8-b454-bdb66eca83c5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d8512039-443c-4490-b4a6-c8b163c8fdbc,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:51:34.194150 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 38010) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:51:34.232517 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-b62b6a72-6860-46b4-954e-06561d1de205 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=4d7fa64820344320b93dffee809df6ff&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0372198 Sep 18 08:51:34.234806 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 38012) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:51:34.279766 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c9b5a1d7-8815-4708-89cd-b149d64051c8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:34.300474 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c9b5a1d7-8815-4708-89cd-b149d64051c8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:34.348176 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c9b5a1d7-8815-4708-89cd-b149d64051c8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:34.350777 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c9b5a1d7-8815-4708-89cd-b149d64051c8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:34.351921 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-c9b5a1d7-8815-4708-89cd-b149d64051c8 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/26d5aef2-7f70-4a6c-88b0-a9b75f962e74 HTTP/1.1" status: 204 len: 168 time: 0.1162379 Sep 18 08:51:34.359975 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9b5a1d7-8815-4708-89cd-b149d64051c8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=26d5aef2-7f70-4a6c-88b0-a9b75f962e74,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:51:34.722873 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d86e8d8-df0c-458c-9e3b-0e3c18c8c8fd req-95690c04-2c73-4f05-b610-4f747ae094a2 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:34.724288 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5d86e8d8-df0c-458c-9e3b-0e3c18c8c8fd req-95690c04-2c73-4f05-b610-4f747ae094a2 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0487378 Sep 18 08:51:34.759873 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5d86e8d8-df0c-458c-9e3b-0e3c18c8c8fd req-838fb1b3-a580-4c43-bd09-5e8f773a3779 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0297666 Sep 18 08:51:35.874469 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30062433-4957-4c8b-9476-812294a95fba req-682c079d-a0d7-4a68-ab58-bef7e626709e tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:35.875981 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-30062433-4957-4c8b-9476-812294a95fba req-682c079d-a0d7-4a68-ab58-bef7e626709e tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0481336 Sep 18 08:51:35.913488 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-30062433-4957-4c8b-9476-812294a95fba req-3c74d672-50d6-435a-bf64-b493a71a9a81 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0312185 Sep 18 08:51:37.029881 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-233aab1e-f779-4b70-bedc-00ec44f18a1f req-1f0f24f8-5d4a-4f7f-98d9-09cf01f78b57 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:37.031354 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-233aab1e-f779-4b70-bedc-00ec44f18a1f req-1f0f24f8-5d4a-4f7f-98d9-09cf01f78b57 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0507090 Sep 18 08:51:37.069086 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-233aab1e-f779-4b70-bedc-00ec44f18a1f req-5fa15d22-7b81-4adb-b5cb-21882aac959b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0319135 Sep 18 08:51:38.180644 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d26484b4-4d76-469e-ab11-14116bd33d41 req-f1755afd-a01c-422b-95e6-829d2358803c tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:38.182174 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d26484b4-4d76-469e-ab11-14116bd33d41 req-f1755afd-a01c-422b-95e6-829d2358803c tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0474880 Sep 18 08:51:38.218889 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d26484b4-4d76-469e-ab11-14116bd33d41 req-568ade1a-f446-4e73-b1ca-685137d431c3 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0306344 Sep 18 08:51:39.332882 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b29ea4c7-630e-40e9-a08e-3a4c8473c6a0 req-7b01f445-f281-45f8-961d-ed510d414474 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:39.334350 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b29ea4c7-630e-40e9-a08e-3a4c8473c6a0 req-7b01f445-f281-45f8-961d-ed510d414474 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0470774 Sep 18 08:51:39.370149 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b29ea4c7-630e-40e9-a08e-3a4c8473c6a0 req-22638c99-2001-48d7-9f3d-e650ec2d1665 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0300498 Sep 18 08:51:39.697452 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:51:40.485349 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1bed622-5d37-4ae2-8076-1e04c7de6ebf req-28a688bf-39b6-4fc5-9878-dbf15f2cb075 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:40.486823 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a1bed622-5d37-4ae2-8076-1e04c7de6ebf req-28a688bf-39b6-4fc5-9878-dbf15f2cb075 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0513086 Sep 18 08:51:40.522894 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a1bed622-5d37-4ae2-8076-1e04c7de6ebf req-1120f41c-391b-4343-b4d3-9d2dc50940c3 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0302811 Sep 18 08:51:41.635089 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c7fa4da-d039-413a-9456-dff13e0ae48d req-331ade2e-5e21-4673-825d-db21147d388a tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:41.636546 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2c7fa4da-d039-413a-9456-dff13e0ae48d req-331ade2e-5e21-4673-825d-db21147d388a tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0474622 Sep 18 08:51:41.680586 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-2c7fa4da-d039-413a-9456-dff13e0ae48d req-f45fb183-b204-4c5a-8402-16485c2905de tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0380936 Sep 18 08:51:42.793223 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b069296-a6b6-49d7-8dcd-11dd4a540bbe req-17d43caf-728a-4904-8b26-3f4b6533591c tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:42.794692 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3b069296-a6b6-49d7-8dcd-11dd4a540bbe req-17d43caf-728a-4904-8b26-3f4b6533591c tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0478692 Sep 18 08:51:42.830317 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3b069296-a6b6-49d7-8dcd-11dd4a540bbe req-cd7555a6-1adc-434a-bbab-640b4bd41d54 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0298355 Sep 18 08:51:43.944258 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e84e3503-f9a6-4bfa-9a96-2ba8a739105b req-fbe96589-ef7f-49ab-97c0-66c69200a5a0 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:43.945768 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e84e3503-f9a6-4bfa-9a96-2ba8a739105b req-fbe96589-ef7f-49ab-97c0-66c69200a5a0 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0497444 Sep 18 08:51:43.982148 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-e84e3503-f9a6-4bfa-9a96-2ba8a739105b req-e266192d-ce43-4126-b0fb-727dfd810bb0 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0306509 Sep 18 08:51:45.093355 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33fcea46-609d-48b2-bc4b-3bae82fd520a req-808e635d-42fa-4fc1-ae42-36c1e8bd63b0 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:45.094887 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-33fcea46-609d-48b2-bc4b-3bae82fd520a req-808e635d-42fa-4fc1-ae42-36c1e8bd63b0 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0462618 Sep 18 08:51:45.131154 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-33fcea46-609d-48b2-bc4b-3bae82fd520a req-7c9a6ffb-0996-4972-98cc-6df44f08298a tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0297582 Sep 18 08:51:46.242509 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a20ce17b-3fa0-44e4-b355-95e504bcf057 req-c931fe19-eb1c-405e-a22f-49c49910f0e4 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:46.243986 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a20ce17b-3fa0-44e4-b355-95e504bcf057 req-c931fe19-eb1c-405e-a22f-49c49910f0e4 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0479426 Sep 18 08:51:46.279920 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a20ce17b-3fa0-44e4-b355-95e504bcf057 req-f1372646-66d2-48c8-a0f3-2683c0d9e979 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0300615 Sep 18 08:51:47.394107 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abda0fe7-21fb-4867-b0f5-9b5a9ab391b6 req-9e676efa-ca35-4860-9551-4c937cce65a9 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:47.395565 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-abda0fe7-21fb-4867-b0f5-9b5a9ab391b6 req-9e676efa-ca35-4860-9551-4c937cce65a9 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0501261 Sep 18 08:51:47.432122 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-abda0fe7-21fb-4867-b0f5-9b5a9ab391b6 req-54c6373a-aee8-4bc6-b6f8-4f1fc27f1b78 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0307422 Sep 18 08:51:47.620825 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17a3d715-9f33-42a2-b968-72942aea80d4 req-ccde7fd8-c6e0-408e-b4e2-b8a03a47bfd4 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:47.622374 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-17a3d715-9f33-42a2-b968-72942aea80d4 req-ccde7fd8-c6e0-408e-b4e2-b8a03a47bfd4 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0485480 Sep 18 08:51:47.679704 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-17a3d715-9f33-42a2-b968-72942aea80d4 req-3bb58ce5-0928-4b6e-aaa4-87cbca3041ca tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0511322 Sep 18 08:51:47.706113 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edc5ff5f-fc11-42c9-be2f-a954fb262a08 req-efcf4fb3-24f2-4785-82c2-25747e2dfbba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:47.707599 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-edc5ff5f-fc11-42c9-be2f-a954fb262a08 req-efcf4fb3-24f2-4785-82c2-25747e2dfbba service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=334211ea09044272868662e38cb1a4ad&device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 1098 time: 0.0431144 Sep 18 08:51:47.796630 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edc5ff5f-fc11-42c9-be2f-a954fb262a08 req-86e179ae-130c-4ba3-91bd-87371365314b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:47.798673 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-edc5ff5f-fc11-42c9-be2f-a954fb262a08 req-86e179ae-130c-4ba3-91bd-87371365314b service neutron] 10.222.0.13 "GET /v2.0/networks?id=22bf7558-e572-4c3e-b191-f1edcd47c9f2 HTTP/1.1" status: 200 len: 911 time: 0.0837190 Sep 18 08:51:47.858458 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-edc5ff5f-fc11-42c9-be2f-a954fb262a08 req-52e63182-22fd-4e1a-bf3e-d56842482f7e service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=17c68a27-b17a-499d-9bde-484199d59ae2 HTTP/1.1" status: 200 len: 1001 time: 0.0538170 Sep 18 08:51:47.907868 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edc5ff5f-fc11-42c9-be2f-a954fb262a08 req-7d5ab867-3b2b-449b-9d32-0261cd7ca61a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:47.909165 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-edc5ff5f-fc11-42c9-be2f-a954fb262a08 req-7d5ab867-3b2b-449b-9d32-0261cd7ca61a service neutron] 10.222.0.13 "GET /v2.0/subnets?id=e900aa03-4504-4ae5-a8a2-0da036634ce2 HTTP/1.1" status: 200 len: 849 time: 0.0443246 Sep 18 08:51:47.960395 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edc5ff5f-fc11-42c9-be2f-a954fb262a08 req-204e0c9e-9f77-48a1-8df9-9b9c165875b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:47.961985 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-edc5ff5f-fc11-42c9-be2f-a954fb262a08 req-204e0c9e-9f77-48a1-8df9-9b9c165875b5 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=22bf7558-e572-4c3e-b191-f1edcd47c9f2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0457613 Sep 18 08:51:48.051942 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-edc5ff5f-fc11-42c9-be2f-a954fb262a08 req-8e540302-3f7c-40e2-9eee-2a5fc5490639 service neutron] 10.222.0.13 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0823271 Sep 18 08:51:48.141097 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-edc5ff5f-fc11-42c9-be2f-a954fb262a08 req-139f8f49-92f3-4e21-b57a-2278bb4db2f4 service neutron] 10.222.0.13 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817432 Sep 18 08:51:48.791808 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3386b28-69e2-4511-8d25-73286c66e5f8 req-7f988812-d7fe-4e22-a2b9-02d58b62b618 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:48.793272 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f3386b28-69e2-4511-8d25-73286c66e5f8 req-7f988812-d7fe-4e22-a2b9-02d58b62b618 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0461628 Sep 18 08:51:48.833387 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f3386b28-69e2-4511-8d25-73286c66e5f8 req-5b8d7017-ee5d-45ff-865d-37d0571a123b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0336177 Sep 18 08:51:49.625946 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-1263add7-10f4-443e-b3a3-2c296c20d615 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:49.949719 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c142ab6b-913b-4758-a26a-1d96b96e33a6 req-2f218988-16b5-472d-96ef-728fa4648a33 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:51:49.951100 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c142ab6b-913b-4758-a26a-1d96b96e33a6 req-2f218988-16b5-472d-96ef-728fa4648a33 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0520597 Sep 18 08:51:49.987431 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c142ab6b-913b-4758-a26a-1d96b96e33a6 req-ebec437c-b5f9-4e55-90db-b02653b5bc53 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0298443 Sep 18 08:51:50.154785 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:52.410737 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-92215e24-f943-4ca1-b9f1-d50ac10a8d6c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:53.226262 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:53.389235 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:51:54.907269 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:52:16.695908 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:52:19.626333 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-c9138d37-502c-4628-bc27-c16c504f7e2b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:52:20.154757 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:52:22.410610 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-67949cad-b33a-4429-8224-483564735015 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:52:23.227009 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:52:23.390281 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:52:24.910075 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:52:26.726241 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fd2850b6-b210-4830-9e30-37f8aec5fdf4 req-1925a7e4-ea11-4fae-9637-498c560d0239 service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0387621 Sep 18 08:52:26.820992 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd2850b6-b210-4830-9e30-37f8aec5fdf4 req-be40084b-df8e-4360-ba09-f8f5edbb379c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:52:26.822461 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fd2850b6-b210-4830-9e30-37f8aec5fdf4 req-be40084b-df8e-4360-ba09-f8f5edbb379c service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=334211ea09044272868662e38cb1a4ad&device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 1098 time: 0.0383096 Sep 18 08:52:26.923707 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd2850b6-b210-4830-9e30-37f8aec5fdf4 req-4cc8d508-94e2-4021-bf32-f870b8aa42e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:52:26.925690 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fd2850b6-b210-4830-9e30-37f8aec5fdf4 req-4cc8d508-94e2-4021-bf32-f870b8aa42e9 service neutron] 10.222.0.13 "GET /v2.0/networks?id=22bf7558-e572-4c3e-b191-f1edcd47c9f2 HTTP/1.1" status: 200 len: 911 time: 0.0842230 Sep 18 08:52:26.987983 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fd2850b6-b210-4830-9e30-37f8aec5fdf4 req-9bc9e6d8-2f29-444c-88ea-2793286e81ab service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=17c68a27-b17a-499d-9bde-484199d59ae2 HTTP/1.1" status: 200 len: 1001 time: 0.0556672 Sep 18 08:52:27.034963 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd2850b6-b210-4830-9e30-37f8aec5fdf4 req-ae2cc701-2ff4-4681-8c53-565828dd5da9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:52:27.036401 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fd2850b6-b210-4830-9e30-37f8aec5fdf4 req-ae2cc701-2ff4-4681-8c53-565828dd5da9 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=e900aa03-4504-4ae5-a8a2-0da036634ce2 HTTP/1.1" status: 200 len: 849 time: 0.0421412 Sep 18 08:52:27.083382 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd2850b6-b210-4830-9e30-37f8aec5fdf4 req-b0b64c05-d406-4ac4-9d6d-2e39a26f4604 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:52:27.084810 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fd2850b6-b210-4830-9e30-37f8aec5fdf4 req-b0b64c05-d406-4ac4-9d6d-2e39a26f4604 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=22bf7558-e572-4c3e-b191-f1edcd47c9f2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0417080 Sep 18 08:52:27.171317 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fd2850b6-b210-4830-9e30-37f8aec5fdf4 req-3015c652-657e-40dd-b079-3c84c7f48e15 service neutron] 10.222.0.13 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0792916 Sep 18 08:52:27.260894 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-fd2850b6-b210-4830-9e30-37f8aec5fdf4 req-7e51310a-f786-4f28-ab2a-e273b3bd7a46 service neutron] 10.222.0.13 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0822008 Sep 18 08:52:46.998255 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c3a3eb2-af24-4c93-b7c7-582d58a07d46 req-510cbf7a-d938-49f1-a766-093cee5d98a9 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:52:46.999744 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0c3a3eb2-af24-4c93-b7c7-582d58a07d46 req-510cbf7a-d938-49f1-a766-093cee5d98a9 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0473280 Sep 18 08:52:47.038163 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-0c3a3eb2-af24-4c93-b7c7-582d58a07d46 req-6d90187e-54a4-425b-b95e-3765f2a5eaaf tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0319507 Sep 18 08:52:48.148976 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-771fb7d6-9ed2-4770-950c-2628d467837d req-e3c43f5e-aec5-463a-b434-206bb4c9445c tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:52:48.150463 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-771fb7d6-9ed2-4770-950c-2628d467837d req-e3c43f5e-aec5-463a-b434-206bb4c9445c tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0470703 Sep 18 08:52:48.190980 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-771fb7d6-9ed2-4770-950c-2628d467837d req-4863911e-2e8c-46fd-8dfe-51334c73a236 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0348027 Sep 18 08:52:49.300859 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-366c67b9-b57d-48cf-a615-85aacd6d6c07 req-15649290-35dc-4609-b84c-f57a963e92d5 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:52:49.302276 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-366c67b9-b57d-48cf-a615-85aacd6d6c07 req-15649290-35dc-4609-b84c-f57a963e92d5 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0467556 Sep 18 08:52:49.339065 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-366c67b9-b57d-48cf-a615-85aacd6d6c07 req-f01d1b0f-412a-40b3-b750-9654e21eaef1 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0310655 Sep 18 08:52:49.627556 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-4e31fffe-c688-4d35-9a31-52963f0899fa None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:52:50.164184 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:52:50.448337 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e5fffd3-8a65-45c6-b2a0-e238d616d67b req-4fe5e09e-1eac-47ee-b2f1-f690d30f5ff6 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:52:50.449813 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1e5fffd3-8a65-45c6-b2a0-e238d616d67b req-4fe5e09e-1eac-47ee-b2f1-f690d30f5ff6 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0463464 Sep 18 08:52:50.487118 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1e5fffd3-8a65-45c6-b2a0-e238d616d67b req-ffbc89cd-949c-46ce-8d7e-0bd9241940f6 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0308812 Sep 18 08:52:51.597929 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-190befd8-1e18-484c-97cd-25aaa137da73 req-8b5e46e4-a2ac-4367-9be1-d08b6d818b7c tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:52:51.599662 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-190befd8-1e18-484c-97cd-25aaa137da73 req-8b5e46e4-a2ac-4367-9be1-d08b6d818b7c tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0470154 Sep 18 08:52:51.639287 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-190befd8-1e18-484c-97cd-25aaa137da73 req-0770ad01-a991-466d-9b25-352da34fe56f tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0337877 Sep 18 08:52:52.410855 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-7faf6a0f-a72d-4a17-b339-d6b0ae39fcdc None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:52:52.748305 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1399d98f-204c-419f-b100-2388d7ca7894 req-d50cc119-17fc-4d0d-90e2-b257a31ba03c tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:52:52.749806 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1399d98f-204c-419f-b100-2388d7ca7894 req-d50cc119-17fc-4d0d-90e2-b257a31ba03c tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0472739 Sep 18 08:52:52.787014 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1399d98f-204c-419f-b100-2388d7ca7894 req-b2ea561d-d706-450d-aafa-90f3a97479ea tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0310223 Sep 18 08:52:53.227987 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:52:53.392969 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:52:53.694747 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:52:53.900606 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0b827a3-de91-4531-9219-4e9f03ecf62a req-79d24e70-2aac-4b64-86cf-8d99fa464ef7 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:52:53.902071 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a0b827a3-de91-4531-9219-4e9f03ecf62a req-79d24e70-2aac-4b64-86cf-8d99fa464ef7 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0466003 Sep 18 08:52:53.938468 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a0b827a3-de91-4531-9219-4e9f03ecf62a req-fe235f10-81d1-4556-96de-11cf7cbd753b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0306888 Sep 18 08:52:54.912720 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:52:55.049638 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b9fb040-46c3-4729-85bf-22aacab22291 req-93b19008-c745-4953-a9e9-273483b2e8c0 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:52:55.051107 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1b9fb040-46c3-4729-85bf-22aacab22291 req-93b19008-c745-4953-a9e9-273483b2e8c0 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0475700 Sep 18 08:52:55.089733 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1b9fb040-46c3-4729-85bf-22aacab22291 req-1c43e6f9-0a3a-4264-b3c7-8bc18f74ef68 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0329044 Sep 18 08:52:56.200076 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39491304-6bae-4063-866b-be7c6a2ef434 req-faf4a893-ac4f-4c54-a8a9-beeb716409ca tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:52:56.201570 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-39491304-6bae-4063-866b-be7c6a2ef434 req-faf4a893-ac4f-4c54-a8a9-beeb716409ca tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0470603 Sep 18 08:52:56.238469 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-39491304-6bae-4063-866b-be7c6a2ef434 req-c4174efa-470f-44da-a7e0-2ca5e158a089 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0311980 Sep 18 08:52:57.355077 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66277d34-f530-4bed-aecf-ab8b630a972e req-2e8d3ff8-327c-4891-9a89-cc286ccb6fa2 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:52:57.356557 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-66277d34-f530-4bed-aecf-ab8b630a972e req-2e8d3ff8-327c-4891-9a89-cc286ccb6fa2 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0518339 Sep 18 08:52:57.394480 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-66277d34-f530-4bed-aecf-ab8b630a972e req-f90bb859-d00c-461e-b700-4bf4c4587304 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0319598 Sep 18 08:52:58.504195 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c70609e-8a34-4268-9fe0-00f8664dbfb3 req-80208f90-b575-4a06-bfe0-2d659b17a212 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:52:58.505699 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1c70609e-8a34-4268-9fe0-00f8664dbfb3 req-80208f90-b575-4a06-bfe0-2d659b17a212 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0471563 Sep 18 08:52:58.545984 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1c70609e-8a34-4268-9fe0-00f8664dbfb3 req-1290e39a-7e84-4438-9e88-b8d6cedd5b03 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0343239 Sep 18 08:52:58.733394 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d549ef12-de47-4e69-90b2-6707a6dd602f req-a0db3288-235a-4f1a-862c-c521eddfc7c0 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:52:58.734796 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d549ef12-de47-4e69-90b2-6707a6dd602f req-a0db3288-235a-4f1a-862c-c521eddfc7c0 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0474176 Sep 18 08:52:58.784243 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d549ef12-de47-4e69-90b2-6707a6dd602f req-926db8f1-d792-4de7-a34d-bbc9f9d6a8d3 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434661 Sep 18 08:52:58.822580 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c657ce5c-1d2d-4da9-93c6-46e9adab2962 req-850ac0df-0725-44de-912b-9bd78a755638 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:52:58.824085 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c657ce5c-1d2d-4da9-93c6-46e9adab2962 req-850ac0df-0725-44de-912b-9bd78a755638 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=334211ea09044272868662e38cb1a4ad&device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 1098 time: 0.0500951 Sep 18 08:52:58.912009 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c657ce5c-1d2d-4da9-93c6-46e9adab2962 req-2bd66ba4-c2a1-4d74-93b8-8fa6cbee4398 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:52:58.913565 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c657ce5c-1d2d-4da9-93c6-46e9adab2962 req-2bd66ba4-c2a1-4d74-93b8-8fa6cbee4398 service neutron] 10.222.0.13 "GET /v2.0/networks?id=22bf7558-e572-4c3e-b191-f1edcd47c9f2 HTTP/1.1" status: 200 len: 911 time: 0.0823886 Sep 18 08:52:58.975786 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c657ce5c-1d2d-4da9-93c6-46e9adab2962 req-4bd00a61-e8f9-4e23-93ff-c6c40d314c3e service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=17c68a27-b17a-499d-9bde-484199d59ae2 HTTP/1.1" status: 200 len: 1001 time: 0.0553298 Sep 18 08:52:59.023354 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c657ce5c-1d2d-4da9-93c6-46e9adab2962 req-9498db4f-472a-431b-9a98-d30a37cc86cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:52:59.024804 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c657ce5c-1d2d-4da9-93c6-46e9adab2962 req-9498db4f-472a-431b-9a98-d30a37cc86cb service neutron] 10.222.0.13 "GET /v2.0/subnets?id=e900aa03-4504-4ae5-a8a2-0da036634ce2 HTTP/1.1" status: 200 len: 849 time: 0.0427108 Sep 18 08:52:59.322175 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c657ce5c-1d2d-4da9-93c6-46e9adab2962 req-1684d12e-dd54-4e1b-adaa-5d1e0d546a67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:52:59.323686 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c657ce5c-1d2d-4da9-93c6-46e9adab2962 req-1684d12e-dd54-4e1b-adaa-5d1e0d546a67 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=22bf7558-e572-4c3e-b191-f1edcd47c9f2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2919910 Sep 18 08:52:59.410583 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c657ce5c-1d2d-4da9-93c6-46e9adab2962 req-dc267afe-b2c2-4152-b93e-f8255a82700f service neutron] 10.222.0.13 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0790138 Sep 18 08:52:59.499910 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c657ce5c-1d2d-4da9-93c6-46e9adab2962 req-0bc5ac5f-eb69-410d-99ed-033f9605703e service neutron] 10.222.0.13 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0820150 Sep 18 08:52:59.897716 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d72351f4-3e76-454b-98e8-0c8f990f0444 req-22cd726e-068f-4134-9f09-63a64b237ad4 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:52:59.899201 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d72351f4-3e76-454b-98e8-0c8f990f0444 req-22cd726e-068f-4134-9f09-63a64b237ad4 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0478415 Sep 18 08:52:59.936040 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d72351f4-3e76-454b-98e8-0c8f990f0444 req-afda7a71-1dda-4798-85c5-1dcdd3ca0120 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0310185 Sep 18 08:53:01.047643 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b42e06b-3236-4c55-991b-cdf26701ef37 req-d589bf99-e604-4b9b-b534-55444259cb05 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:53:01.049133 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1b42e06b-3236-4c55-991b-cdf26701ef37 req-d589bf99-e604-4b9b-b534-55444259cb05 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0462418 Sep 18 08:53:01.089604 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1b42e06b-3236-4c55-991b-cdf26701ef37 req-7172b282-3a0c-48b7-9649-7a9885444f9d tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0345805 Sep 18 08:53:19.628301 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-f5d3d4c4-a604-4fc5-bc1c-9f07bed93a5b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:20.164733 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:22.411339 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-e640d24d-0727-4ce7-b040-71afed29e85a None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:23.228419 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:23.396703 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:24.914830 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:27.727766 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c42da416-3d78-4c54-ab1d-6b7c21d5a0fa req-f260bbde-ad38-442c-bbef-e740391b8d6a service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0375841 Sep 18 08:53:27.823349 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c42da416-3d78-4c54-ab1d-6b7c21d5a0fa req-e8741228-5d98-4450-8d12-279543f9271a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:53:27.825075 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c42da416-3d78-4c54-ab1d-6b7c21d5a0fa req-e8741228-5d98-4450-8d12-279543f9271a service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=334211ea09044272868662e38cb1a4ad&device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 1098 time: 0.0388341 Sep 18 08:53:27.926081 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c42da416-3d78-4c54-ab1d-6b7c21d5a0fa req-7544cbba-5958-422d-a70a-35b8c39ec685 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:53:27.927497 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c42da416-3d78-4c54-ab1d-6b7c21d5a0fa req-7544cbba-5958-422d-a70a-35b8c39ec685 service neutron] 10.222.0.13 "GET /v2.0/networks?id=22bf7558-e572-4c3e-b191-f1edcd47c9f2 HTTP/1.1" status: 200 len: 911 time: 0.0844083 Sep 18 08:53:27.990353 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c42da416-3d78-4c54-ab1d-6b7c21d5a0fa req-2a1de2a3-5941-487d-aa61-5066e2f443fe service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=17c68a27-b17a-499d-9bde-484199d59ae2 HTTP/1.1" status: 200 len: 1001 time: 0.0554202 Sep 18 08:53:28.037060 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c42da416-3d78-4c54-ab1d-6b7c21d5a0fa req-e65721b8-13ce-4d34-8007-c8ce3136f995 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:53:28.038491 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c42da416-3d78-4c54-ab1d-6b7c21d5a0fa req-e65721b8-13ce-4d34-8007-c8ce3136f995 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=e900aa03-4504-4ae5-a8a2-0da036634ce2 HTTP/1.1" status: 200 len: 849 time: 0.0417092 Sep 18 08:53:28.084459 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c42da416-3d78-4c54-ab1d-6b7c21d5a0fa req-57a66b8b-5685-4a9e-b12e-b7704b7706e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:53:28.085918 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c42da416-3d78-4c54-ab1d-6b7c21d5a0fa req-57a66b8b-5685-4a9e-b12e-b7704b7706e1 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=22bf7558-e572-4c3e-b191-f1edcd47c9f2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0405328 Sep 18 08:53:28.173084 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c42da416-3d78-4c54-ab1d-6b7c21d5a0fa req-ffcfabc0-f38d-4c5a-871a-5b891f14e0b6 service neutron] 10.222.0.13 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0800533 Sep 18 08:53:28.262793 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-c42da416-3d78-4c54-ab1d-6b7c21d5a0fa req-9a4f121b-0150-460e-9743-493cf5f6387f service neutron] 10.222.0.13 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0822208 Sep 18 08:53:30.693158 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:53:49.629805 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-a2ee0c2b-bafd-4d5b-868b-22d19308b3f9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:50.018102 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01c88d07-66f0-49ab-b122-236001382465 req-9fddaa33-7e8b-489a-89e0-64b4916cd7f3 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:53:50.019609 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-01c88d07-66f0-49ab-b122-236001382465 req-9fddaa33-7e8b-489a-89e0-64b4916cd7f3 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.2772920 Sep 18 08:53:50.057004 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-01c88d07-66f0-49ab-b122-236001382465 req-b3f27fba-8bde-49e7-b8dc-c78129614cd9 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0314729 Sep 18 08:53:50.170348 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:50.563424 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [req-8c11c73b-716a-4f8b-bdfd-c4f98560b329 req-c2a46b45-0b77-4811-9760-958f83a3e8a5 service neutron] (94346) timed out ('10.222.0.13', 59050) {{(pid=94346) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Sep 18 08:53:50.973101 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [req-5bae2fef-0d58-4b69-9459-bbfe67a3bc57 req-50367c77-195a-49ae-8e7c-d56e7385db6f service neutron] (94346) timed out ('10.222.0.13', 59044) {{(pid=94346) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Sep 18 08:53:51.239760 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d4f2840-ff22-455c-afa1-a1ee9ca34141 req-13e25ada-0f9d-4201-aff2-0704d9b9c93b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:53:51.241200 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5d4f2840-ff22-455c-afa1-a1ee9ca34141 req-13e25ada-0f9d-4201-aff2-0704d9b9c93b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.1025529 Sep 18 08:53:51.277778 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5d4f2840-ff22-455c-afa1-a1ee9ca34141 req-dfd5ebdf-f944-47fc-8a87-ba80ebc9b60f tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0306637 Sep 18 08:53:52.071675 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38a6c5f0-4554-4326-8514-79d7c1a43f0f req-3ab710c0-fff0-4b83-9b79-cb593c4786f4 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:53:52.073132 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-38a6c5f0-4554-4326-8514-79d7c1a43f0f req-3ab710c0-fff0-4b83-9b79-cb593c4786f4 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.13 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0504012 Sep 18 08:53:52.158820 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-38a6c5f0-4554-4326-8514-79d7c1a43f0f req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Deleting port 17c68a27-b17a-499d-9bde-484199d59ae2 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:53:52.159165 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-38a6c5f0-4554-4326-8514-79d7c1a43f0f req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:52.247868 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-38a6c5f0-4554-4326-8514-79d7c1a43f0f req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] For port 17c68a27-b17a-499d-9bde-484199d59ae2, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=17c68a27-b17a-499d-9bde-484199d59ae2,segment=NetworkSegment(71fc0c51-8d26-4812-8dcb-f2ed141a03d2),segment_id=71fc0c51-8d26-4812-8dcb-f2ed141a03d2)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:53:52.248550 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-38a6c5f0-4554-4326-8514-79d7c1a43f0f req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:52.412640 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-80f83d92-1f6f-4c77-8b72-be808fc96e4f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:52.443313 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-38a6c5f0-4554-4326-8514-79d7c1a43f0f req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for floatingip, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:52.443694 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-38a6c5f0-4554-4326-8514-79d7c1a43f0f req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-784908'] for floatingip, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:52.444009 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.db.l3_db [req-38a6c5f0-4554-4326-8514-79d7c1a43f0f req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Floating IP c249629c-5701-4197-9f83-88d0e3c00f94 disassociated. External IP: 172.27.1.193, port: 17c68a27-b17a-499d-9bde-484199d59ae2. Sep 18 08:53:52.444349 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-38a6c5f0-4554-4326-8514-79d7c1a43f0f req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Calling delete_port for 17c68a27-b17a-499d-9bde-484199d59ae2 owned by compute:nova {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:53:52.461620 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94bf2574-1baf-41da-8554-3627a1e91d4d req-f51612e3-6c9a-433b-b5d8-1f605845b249 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:53:52.463119 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-94bf2574-1baf-41da-8554-3627a1e91d4d req-f51612e3-6c9a-433b-b5d8-1f605845b249 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=72f4dadd-ae4c-4dab-ae73-75174398ef1e HTTP/1.1" status: 200 len: 945 time: 0.0971739 Sep 18 08:53:52.543514 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-94bf2574-1baf-41da-8554-3627a1e91d4d req-9e4833d8-8516-400e-82b2-4fcaabefa624 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=a837ba65-24c1-4c3f-944f-fdf03428d219&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0460520 Sep 18 08:53:52.609868 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-38a6c5f0-4554-4326-8514-79d7c1a43f0f req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:52.636325 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Pushing event deleted for resources: {'Port': ['ID=17c68a27-b17a-499d-9bde-484199d59ae2,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:53:52.645822 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:53:52.646175 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:53:52.646517 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:53:52.646854 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:53:52.647184 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:53:52.647515 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:53:52.647841 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:53:52.648166 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:53:52.648490 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:53:52.649326 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:53:52.649326 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:53:52.649489 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:53:52.759965 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.l3_agent_scheduler [req-38a6c5f0-4554-4326-8514-79d7c1a43f0f req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Router 7ffeaad5-a677-409b-ba64-09886084c459 has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94347) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:53:52.863384 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-38a6c5f0-4554-4326-8514-79d7c1a43f0f req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94347) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:53:52.872643 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63885499-77f9-4a64-9301-dd015e79a34a None None] Sync routers for ids ['7ffeaad5-a677-409b-ba64-09886084c459'] in dv-cinder-804470-6-iscsi {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:53:52.881258 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63885499-77f9-4a64-9301-dd015e79a34a None None] Routers {'7ffeaad5-a677-409b-ba64-09886084c459'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:53:52.881864 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-63885499-77f9-4a64-9301-dd015e79a34a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:53:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['7ffeaad5-a677-409b-ba64-09886084c459'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:53:52.899776 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-38a6c5f0-4554-4326-8514-79d7c1a43f0f req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] No DVR routers for this DVR port 17c68a27-b17a-499d-9bde-484199d59ae2 on host hv-cinder-80447 {{(pid=94347) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:53:52.902270 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-38a6c5f0-4554-4326-8514-79d7c1a43f0f req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:52.904241 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-38a6c5f0-4554-4326-8514-79d7c1a43f0f req-1915a439-32fa-4af5-bd93-91d793731da8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.13 "DELETE /v2.0/ports/17c68a27-b17a-499d-9bde-484199d59ae2 HTTP/1.1" status: 204 len: 173 time: 0.8247745 Sep 18 08:53:52.904676 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '72f4dadd-ae4c-4dab-ae73-75174398ef1e', 'name': 'network-vif-deleted', 'tag': '17c68a27-b17a-499d-9bde-484199d59ae2'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:53:52.906931 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-66af4422-7039-434a-bb34-e46c1229423f" -d '{"events": [{"server_uuid": "72f4dadd-ae4c-4dab-ae73-75174398ef1e", "name": "network-vif-deleted", "tag": "17c68a27-b17a-499d-9bde-484199d59ae2"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:53:52.944957 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:53:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a095edfc-0edd-4b02-833e-1906af5c218d x-openstack-request-id: req-a095edfc-0edd-4b02-833e-1906af5c218d {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:53:52.945280 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "72f4dadd-ae4c-4dab-ae73-75174398ef1e", "name": "network-vif-deleted", "tag": "17c68a27-b17a-499d-9bde-484199d59ae2", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:53:52.945598 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-a095edfc-0edd-4b02-833e-1906af5c218d {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:53:52.946059 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '72f4dadd-ae4c-4dab-ae73-75174398ef1e', 'name': 'network-vif-deleted', 'tag': '17c68a27-b17a-499d-9bde-484199d59ae2', 'status': 'completed', 'code': 200} Sep 18 08:53:52.994515 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-63885499-77f9-4a64-9301-dd015e79a34a None None] Set router 7ffeaad5-a677-409b-ba64-09886084c459 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:53:53.198083 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-63885499-77f9-4a64-9301-dd015e79a34a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ffeaad5-a677-409b-ba64-09886084c459', 'name': 'tempest-AttachVolumeTestJSON-468473020-router', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100'}], 'enable_snat': True}, 'gw_port_id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:49:47Z', 'updated_at': '2021-09-18T08:49:50Z', 'revision_number': 4, 'project_id': '334211ea09044272868662e38cb1a4ad', 'gw_port': {'id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:06:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:48Z', 'updated_at': '2021-09-18T08:49:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': 'e79b2742-d588-4bec-bf32-881880841c60', 'name': '', 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'mac_address': 'fa:16:3e:cc:93:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_interface', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:49Z', 'updated_at': '2021-09-18T08:49:53Z', 'revision_number': 5, 'project_id': '334211ea09044272868662e38cb1a4ad', 'subnets': [{'id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:53:53.229270 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63885499-77f9-4a64-9301-dd015e79a34a None None] Checking router: 7ffeaad5-a677-409b-ba64-09886084c459 for host: dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:53:53.233334 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:53.238712 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-63885499-77f9-4a64-9301-dd015e79a34a None None] Routers {'7ffeaad5-a677-409b-ba64-09886084c459'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:53:53.239311 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-63885499-77f9-4a64-9301-dd015e79a34a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:53:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['7ffeaad5-a677-409b-ba64-09886084c459'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:53:53.340463 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-63885499-77f9-4a64-9301-dd015e79a34a None None] Set router 7ffeaad5-a677-409b-ba64-09886084c459 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:53:53.401788 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:53.545501 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-63885499-77f9-4a64-9301-dd015e79a34a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ffeaad5-a677-409b-ba64-09886084c459', 'name': 'tempest-AttachVolumeTestJSON-468473020-router', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100'}], 'enable_snat': True}, 'gw_port_id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:49:47Z', 'updated_at': '2021-09-18T08:49:50Z', 'revision_number': 4, 'project_id': '334211ea09044272868662e38cb1a4ad', 'gw_port': {'id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:06:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:48Z', 'updated_at': '2021-09-18T08:49:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': 'e79b2742-d588-4bec-bf32-881880841c60', 'name': '', 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'mac_address': 'fa:16:3e:cc:93:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_interface', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:49Z', 'updated_at': '2021-09-18T08:49:53Z', 'revision_number': 5, 'project_id': '334211ea09044272868662e38cb1a4ad', 'subnets': [{'id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:53:53.570918 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-63885499-77f9-4a64-9301-dd015e79a34a None None] The sync data for ids ['7ffeaad5-a677-409b-ba64-09886084c459'] in dv-cinder-804470-6-iscsi is: [{'id': '7ffeaad5-a677-409b-ba64-09886084c459', 'name': 'tempest-AttachVolumeTestJSON-468473020-router', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100'}], 'enable_snat': True}, 'gw_port_id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:49:47Z', 'updated_at': '2021-09-18T08:49:50Z', 'revision_number': 4, 'project_id': '334211ea09044272868662e38cb1a4ad', 'gw_port': {'id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:06:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:48Z', 'updated_at': '2021-09-18T08:49:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': 'e79b2742-d588-4bec-bf32-881880841c60', 'name': '', 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'mac_address': 'fa:16:3e:cc:93:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_interface', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:49Z', 'updated_at': '2021-09-18T08:49:53Z', 'revision_number': 5, 'project_id': '334211ea09044272868662e38cb1a4ad', 'subnets': [{'id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:53:53.773721 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb752cf1-795b-4715-98e9-22834434d929 None None] New status for floating IP c249629c-5701-4197-9f83-88d0e3c00f94: DOWN {{(pid=94348) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 18 08:53:54.648044 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 38174) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:53:54.700242 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-68b23759-c95f-4cdf-8830-92cfaab276c3 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:54.722402 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-68b23759-c95f-4cdf-8830-92cfaab276c3 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:54.768590 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-68b23759-c95f-4cdf-8830-92cfaab276c3 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:54.771134 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-68b23759-c95f-4cdf-8830-92cfaab276c3 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:54.772273 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-68b23759-c95f-4cdf-8830-92cfaab276c3 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "DELETE /v2.0/security-groups/a837ba65-24c1-4c3f-944f-fdf03428d219 HTTP/1.1" status: 204 len: 168 time: 0.1232414 Sep 18 08:53:54.775022 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 38178) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:53:54.780929 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68b23759-c95f-4cdf-8830-92cfaab276c3 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a837ba65-24c1-4c3f-944f-fdf03428d219,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:53:54.787910 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68b23759-c95f-4cdf-8830-92cfaab276c3 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:53:54.788265 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68b23759-c95f-4cdf-8830-92cfaab276c3 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:53:54.788627 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68b23759-c95f-4cdf-8830-92cfaab276c3 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:53:54.788956 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68b23759-c95f-4cdf-8830-92cfaab276c3 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:53:54.789323 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68b23759-c95f-4cdf-8830-92cfaab276c3 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:53:54.789661 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68b23759-c95f-4cdf-8830-92cfaab276c3 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:53:54.789991 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68b23759-c95f-4cdf-8830-92cfaab276c3 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:53:54.790324 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68b23759-c95f-4cdf-8830-92cfaab276c3 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:53:54.790654 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68b23759-c95f-4cdf-8830-92cfaab276c3 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:53:54.790981 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68b23759-c95f-4cdf-8830-92cfaab276c3 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:53:54.791309 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68b23759-c95f-4cdf-8830-92cfaab276c3 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:53:54.791631 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68b23759-c95f-4cdf-8830-92cfaab276c3 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:53:54.791768 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.api.v2.resource [None req-58c6358a-4126-459c-8211-774c95329315 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] show failed (client error): The resource could not be found. Sep 18 08:53:54.792770 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-58c6358a-4126-459c-8211-774c95329315 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups/a837ba65-24c1-4c3f-944f-fdf03428d219 HTTP/1.1" status: 404 len: 347 time: 0.0167696 Sep 18 08:53:54.796318 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 38180) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:53:54.917560 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:54.919941 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-72390903-dbdf-4bad-8688-048719e0815a tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Deleting port 4209ba4a-e53b-40f7-b948-c57ab17f83cb {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:53:54.920317 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-72390903-dbdf-4bad-8688-048719e0815a tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:54.994116 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-72390903-dbdf-4bad-8688-048719e0815a tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:54.994453 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-72390903-dbdf-4bad-8688-048719e0815a tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:55.006116 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-72390903-dbdf-4bad-8688-048719e0815a tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Calling delete_port for 4209ba4a-e53b-40f7-b948-c57ab17f83cb owned by network:floatingip {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:53:55.134756 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-72390903-dbdf-4bad-8688-048719e0815a tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:55.160444 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72390903-dbdf-4bad-8688-048719e0815a tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Pushing event deleted for resources: {'Port': ['ID=4209ba4a-e53b-40f7-b948-c57ab17f83cb,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:53:55.217828 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-72390903-dbdf-4bad-8688-048719e0815a tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for floatingip, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:55.220181 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-72390903-dbdf-4bad-8688-048719e0815a tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for floatingip, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:55.221904 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-72390903-dbdf-4bad-8688-048719e0815a tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "DELETE /v2.0/floatingips/c249629c-5701-4197-9f83-88d0e3c00f94 HTTP/1.1" status: 204 len: 168 time: 0.4246747 Sep 18 08:53:55.617138 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 38184) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:53:55.621730 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-ac864895-e2d4-4eff-8feb-e90b178e38b7 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Request body: {'security_group': {'name': 'tempest-securitygroup--806184320', 'description': 'tempest-description--747449007'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:53:55.643244 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ac864895-e2d4-4eff-8feb-e90b178e38b7 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:55.723355 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ac864895-e2d4-4eff-8feb-e90b178e38b7 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:55.727178 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ac864895-e2d4-4eff-8feb-e90b178e38b7 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:55.753564 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-ac864895-e2d4-4eff-8feb-e90b178e38b7 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:55.754763 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-ac864895-e2d4-4eff-8feb-e90b178e38b7 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1778 time: 0.1365898 Sep 18 08:53:55.756570 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac864895-e2d4-4eff-8feb-e90b178e38b7 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Pushing event updated for resources: {'SecurityGroup': ['ID=adb64c73-3c2c-4142-9f4a-99dfbea0c233,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:53:55.757678 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 38186) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:53:55.763285 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-7aaa84ca-bfe3-42cd-b21e-438b5db9d2e9 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Request body: {'security_group_rule': {'security_group_id': 'adb64c73-3c2c-4142-9f4a-99dfbea0c233', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:53:55.790904 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-7aaa84ca-bfe3-42cd-b21e-438b5db9d2e9 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:55.836787 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-7aaa84ca-bfe3-42cd-b21e-438b5db9d2e9 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:55.840136 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-7aaa84ca-bfe3-42cd-b21e-438b5db9d2e9 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-561193'] for security_group_rule, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:55.859926 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7aaa84ca-bfe3-42cd-b21e-438b5db9d2e9 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f4e44293-b3f1-4f63-8bd9-d161ccf8e4f3,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:53:55.863280 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-7aaa84ca-bfe3-42cd-b21e-438b5db9d2e9 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:55.864474 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-7aaa84ca-bfe3-42cd-b21e-438b5db9d2e9 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1050303 Sep 18 08:53:55.867104 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 38188) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:53:55.871402 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-fac9e7e7-3c74-4bee-979c-9935cce404ef tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Request body: {'security_group_rule': {'security_group_id': 'adb64c73-3c2c-4142-9f4a-99dfbea0c233', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:53:55.897818 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-fac9e7e7-3c74-4bee-979c-9935cce404ef tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for security_group_rule, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:55.944057 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 17c68a27-b17a-499d-9bde-484199d59ae2 no longer exists at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:53:55.957038 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-fac9e7e7-3c74-4bee-979c-9935cce404ef tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for security_group_rule, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:55.960653 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-fac9e7e7-3c74-4bee-979c-9935cce404ef tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-561193'] for security_group_rule, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:55.964365 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] No Port match for: 17c68a27-b17a-499d-9bde-484199d59ae2 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:53:55.964712 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 17c68a27-b17a-499d-9bde-484199d59ae2 not bound to the agent host hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:53:55.979473 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fac9e7e7-3c74-4bee-979c-9935cce404ef tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=943b68d3-619a-4c9c-84fb-55911fd23925,revision_number=0']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:53:55.986056 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-fac9e7e7-3c74-4bee-979c-9935cce404ef tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for security_group_rule, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:55.987482 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-fac9e7e7-3c74-4bee-979c-9935cce404ef tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1194613 Sep 18 08:53:55.990395 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 38190) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:53:55.994608 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.v2.base [None req-fc6bfe09-c9e3-4b5b-940e-a77f98051f1f tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Request body: {'floatingip': {'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38'}} {{(pid=94346) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:53:56.015850 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-fc6bfe09-c9e3-4b5b-940e-a77f98051f1f tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for floatingip, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:56.106467 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-fc6bfe09-c9e3-4b5b-940e-a77f98051f1f tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:56.430944 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.db_base_plugin_common [None req-fc6bfe09-c9e3-4b5b-940e-a77f98051f1f tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Allocated IP 172.27.1.27 (2e3b3f85-63e4-4380-917a-8c90c80b3e38/cd525bb9-7f93-490c-a5d6-a08911817e54/643dfc40-c4c3-40eb-a868-a0b6fd762b0a) {{(pid=94346) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:53:56.528260 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-fc6bfe09-c9e3-4b5b-940e-a77f98051f1f tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for port, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:56.564440 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-fc6bfe09-c9e3-4b5b-940e-a77f98051f1f tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:56.601813 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc6bfe09-c9e3-4b5b-940e-a77f98051f1f tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Network 2e3b3f85-63e4-4380-917a-8c90c80b3e38 is already hosted by enough agents. {{(pid=94346) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:53:56.604652 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.base_scheduler [None req-fc6bfe09-c9e3-4b5b-940e-a77f98051f1f tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Resources bound (agent type, host, resource id): {{(pid=94346) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:53:56.610196 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fc6bfe09-c9e3-4b5b-940e-a77f98051f1f tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Received port after_create {{(pid=94346) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:53:56.631746 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc6bfe09-c9e3-4b5b-940e-a77f98051f1f tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Pushing event updated for resources: {'Port': ['ID=643dfc40-c4c3-40eb-a868-a0b6fd762b0a,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:53:56.692171 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-fc6bfe09-c9e3-4b5b-940e-a77f98051f1f tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for floatingip, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:56.723405 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-fc6bfe09-c9e3-4b5b-940e-a77f98051f1f tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:56.867018 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-fc6bfe09-c9e3-4b5b-940e-a77f98051f1f tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for port, precommit_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:56.871439 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-fc6bfe09-c9e3-4b5b-940e-a77f98051f1f tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-14290155'] for port, after_update {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:56.939949 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc6bfe09-c9e3-4b5b-940e-a77f98051f1f tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Pushing event updated for resources: {'Port': ['ID=643dfc40-c4c3-40eb-a868-a0b6fd762b0a,revision_number=2']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:53:56.951918 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-fc6bfe09-c9e3-4b5b-940e-a77f98051f1f tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-784908'] for floatingip, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:56.965285 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-fc6bfe09-c9e3-4b5b-940e-a77f98051f1f tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for floatingip, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:56.966544 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-fc6bfe09-c9e3-4b5b-940e-a77f98051f1f tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 0.9751790 Sep 18 08:53:57.146814 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-5e2de6d0-5897-419f-b016-537ebd9fb103 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?name=tempest-securitygroup--806184320&fields=id&tenant_id=334211ea09044272868662e38cb1a4ad HTTP/1.1" status: 200 len: 267 time: 0.0321329 Sep 18 08:53:57.252643 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-4a16323a-add1-42a4-bda1-97e325a210ce tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:53:57.254044 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-4a16323a-add1-42a4-bda1-97e325a210ce tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/networks?id=22bf7558-e572-4c3e-b191-f1edcd47c9f2 HTTP/1.1" status: 200 len: 810 time: 0.1008205 Sep 18 08:53:57.268071 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-eff98400-9783-4ed1-ac24-b28358e14331 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/quotas/334211ea09044272868662e38cb1a4ad HTTP/1.1" status: 200 len: 375 time: 0.0085614 Sep 18 08:53:57.318035 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-34fdc1fb-f32d-4ba0-8eac-cc5565dcc7e0 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?tenant_id=334211ea09044272868662e38cb1a4ad&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0449636 Sep 18 08:53:57.450468 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-8390da75-3a82-44dd-b8c6-9af0f4dfdfd0 service neutron] 10.222.0.35 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1213231 Sep 18 08:53:57.539442 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-a9ba2148-1faf-434c-a336-cb8b5f5f3252 service neutron] 10.222.0.35 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0827022 Sep 18 08:53:57.695069 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-28117bcc-46fa-4a92-b389-58371641c461 req-0fce51bf-e21a-42c3-87ab-01e3254122ea tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=f7780dcf-bbd6-433c-ac50-1d45ed33ef5b HTTP/1.1" status: 200 len: 210 time: 0.0251493 Sep 18 08:53:58.665820 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-bfe6687d-fd16-429a-8e16-16c460bab49f tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:53:58.667431 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-bfe6687d-fd16-429a-8e16-16c460bab49f tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.13 "GET /v2.0/networks?id=22bf7558-e572-4c3e-b191-f1edcd47c9f2 HTTP/1.1" status: 200 len: 810 time: 0.1057932 Sep 18 08:53:58.718695 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-729155ec-0f00-4172-add1-378c42582a8f tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.13 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=334211ea09044272868662e38cb1a4ad HTTP/1.1" status: 200 len: 379 time: 0.0344346 Sep 18 08:53:58.729008 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-f10b1b83-f430-4092-8eae-d30831ca2d8b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Request body: {'port': {'device_id': 'f7780dcf-bbd6-433c-ac50-1d45ed33ef5b', 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'admin_state_up': True, 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'security_groups': ['adb64c73-3c2c-4142-9f4a-99dfbea0c233']}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:53:58.820735 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-a8646133-715e-4488-8ad9-aa709d7e6652 req-c7eae176-2fae-4d1e-a2f8-61b29a737554 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=f7780dcf-bbd6-433c-ac50-1d45ed33ef5b HTTP/1.1" status: 200 len: 210 time: 0.0356648 Sep 18 08:53:58.858672 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-f10b1b83-f430-4092-8eae-d30831ca2d8b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Made reservation on behalf of 334211ea09044272868662e38cb1a4ad for: {'port': 1} {{(pid=94347) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Sep 18 08:53:58.862759 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-f10b1b83-f430-4092-8eae-d30831ca2d8b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:58.982732 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_common [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-f10b1b83-f430-4092-8eae-d30831ca2d8b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Allocated IP 172.20.0.4 (22bf7558-e572-4c3e-b191-f1edcd47c9f2/e900aa03-4504-4ae5-a8a2-0da036634ce2/241277d8-1c0c-4cc6-b9e5-e32064abe8d0) {{(pid=94347) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Sep 18 08:53:59.116231 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-f10b1b83-f430-4092-8eae-d30831ca2d8b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for port, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:59.148954 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-f10b1b83-f430-4092-8eae-d30831ca2d8b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8732885273528', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:59.189446 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-f10b1b83-f430-4092-8eae-d30831ca2d8b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Network 22bf7558-e572-4c3e-b191-f1edcd47c9f2 is already hosted by enough agents. {{(pid=94347) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Sep 18 08:53:59.192460 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.base_scheduler [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-f10b1b83-f430-4092-8eae-d30831ca2d8b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Resources bound (agent type, host, resource id): {{(pid=94347) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Sep 18 08:53:59.197900 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-f10b1b83-f430-4092-8eae-d30831ca2d8b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Received port after_create {{(pid=94347) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Sep 18 08:53:59.204158 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f10b1b83-f430-4092-8eae-d30831ca2d8b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Pushing event updated for resources: {'Port': ['ID=241277d8-1c0c-4cc6-b9e5-e32064abe8d0,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:53:59.254127 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-f10b1b83-f430-4092-8eae-d30831ca2d8b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:53:59.254770 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-f10b1b83-f430-4092-8eae-d30831ca2d8b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:59.270202 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-f10b1b83-f430-4092-8eae-d30831ca2d8b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.13 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5448687 Sep 18 08:53:59.305411 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-b661cd21-c78e-4bd6-aea5-70a3109d4a99 service neutron] Request body: {'port': {'device_id': 'f7780dcf-bbd6-433c-ac50-1d45ed33ef5b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-80447'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:53:59.359537 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-b661cd21-c78e-4bd6-aea5-70a3109d4a99 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:59.446071 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-b302a850-a2cf-4773-9990-5594c36d2e85 None None] Provisioning complete for port 241277d8-1c0c-4cc6-b9e5-e32064abe8d0 triggered by entity DHCP. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:53:59.446735 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-b302a850-a2cf-4773-9990-5594c36d2e85 None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:59.480307 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-b302a850-a2cf-4773-9990-5594c36d2e85 None None] Port 241277d8-1c0c-4cc6-b9e5-e32064abe8d0 cannot update to ACTIVE because it is not bound. {{(pid=94348) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:338}} Sep 18 08:53:59.609795 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-b661cd21-c78e-4bd6-aea5-70a3109d4a99 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 241277d8-1c0c-4cc6-b9e5-e32064abe8d0 {{(pid=94347) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:53:59.617060 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-b661cd21-c78e-4bd6-aea5-70a3109d4a99 service neutron] Notify callbacks [] for port, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:59.628998 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.provisioning_blocks [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-b661cd21-c78e-4bd6-aea5-70a3109d4a99 service neutron] Transition to ACTIVE for port object 241277d8-1c0c-4cc6-b9e5-e32064abe8d0 will not be triggered until provisioned by entity L2. {{(pid=94347) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Sep 18 08:53:59.632791 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-b661cd21-c78e-4bd6-aea5-70a3109d4a99 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:59.684410 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b661cd21-c78e-4bd6-aea5-70a3109d4a99 service neutron] Pushing event updated for resources: {'Port': ['ID=241277d8-1c0c-4cc6-b9e5-e32064abe8d0,revision_number=2']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:53:59.751368 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-b661cd21-c78e-4bd6-aea5-70a3109d4a99 service neutron] Attempting to bind port 241277d8-1c0c-4cc6-b9e5-e32064abe8d0 on host hv-cinder-80447 for vnic_type normal with profile {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:790}} Sep 18 08:53:59.751708 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-b661cd21-c78e-4bd6-aea5-70a3109d4a99 service neutron] Attempting to bind port 241277d8-1c0c-4cc6-b9e5-e32064abe8d0 by drivers openvswitch,hyperv on host hv-cinder-80447 at level 0 using segments [{'id': '71fc0c51-8d26-4812-8dcb-f2ed141a03d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 230, 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2'}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:815}} Sep 18 08:53:59.752564 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-b661cd21-c78e-4bd6-aea5-70a3109d4a99 service neutron] Attempting to bind port 241277d8-1c0c-4cc6-b9e5-e32064abe8d0 on network 22bf7558-e572-4c3e-b191-f1edcd47c9f2 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:53:59.756964 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-b661cd21-c78e-4bd6-aea5-70a3109d4a99 service neutron] Port 241277d8-1c0c-4cc6-b9e5-e32064abe8d0 on network 22bf7558-e572-4c3e-b191-f1edcd47c9f2 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-80447 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Sep 18 08:53:59.757324 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-b661cd21-c78e-4bd6-aea5-70a3109d4a99 service neutron] Attempting to bind port 241277d8-1c0c-4cc6-b9e5-e32064abe8d0 on network 22bf7558-e572-4c3e-b191-f1edcd47c9f2 {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Sep 18 08:53:59.762320 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-b661cd21-c78e-4bd6-aea5-70a3109d4a99 service neutron] Checking agent: {'id': '8d51fdc4-974b-4200-9c3f-5dddea60a869', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-80447', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'started_at': datetime.datetime(2021, 9, 18, 8, 36, 18), 'heartbeat_timestamp': datetime.datetime(2021, 9, 18, 8, 53, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Sep 18 08:53:59.762580 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-b661cd21-c78e-4bd6-aea5-70a3109d4a99 service neutron] Checking segment: {'id': '71fc0c51-8d26-4812-8dcb-f2ed141a03d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 230, 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=94347) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:358}} Sep 18 08:53:59.762967 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-b661cd21-c78e-4bd6-aea5-70a3109d4a99 service neutron] Bound using segment: {'id': '71fc0c51-8d26-4812-8dcb-f2ed141a03d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 230, 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2'} {{(pid=94347) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Sep 18 08:53:59.763394 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.managers [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-b661cd21-c78e-4bd6-aea5-70a3109d4a99 service neutron] Bound port: 241277d8-1c0c-4cc6-b9e5-e32064abe8d0, host: hv-cinder-80447, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '71fc0c51-8d26-4812-8dcb-f2ed141a03d2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 230, 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2'}}] {{(pid=94347) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:928}} Sep 18 08:53:59.763753 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-b661cd21-c78e-4bd6-aea5-70a3109d4a99 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:59.827237 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-b661cd21-c78e-4bd6-aea5-70a3109d4a99 service neutron] For port 241277d8-1c0c-4cc6-b9e5-e32064abe8d0, host hv-cinder-80447, cleared binding levels {{(pid=94347) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Sep 18 08:53:59.830829 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-b661cd21-c78e-4bd6-aea5-70a3109d4a99 service neutron] For port 241277d8-1c0c-4cc6-b9e5-e32064abe8d0, host hv-cinder-80447, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=241277d8-1c0c-4cc6-b9e5-e32064abe8d0,segment=NetworkSegment(71fc0c51-8d26-4812-8dcb-f2ed141a03d2),segment_id=71fc0c51-8d26-4812-8dcb-f2ed141a03d2)] {{(pid=94347) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Sep 18 08:53:59.835253 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-b661cd21-c78e-4bd6-aea5-70a3109d4a99 service neutron] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-15069082'] for port, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:59.871970 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-b661cd21-c78e-4bd6-aea5-70a3109d4a99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:53:59.872603 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-b661cd21-c78e-4bd6-aea5-70a3109d4a99 service neutron] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:53:59.874068 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-b661cd21-c78e-4bd6-aea5-70a3109d4a99 service neutron] 10.222.0.13 "PUT /v2.0/ports/241277d8-1c0c-4cc6-b9e5-e32064abe8d0 HTTP/1.1" status: 200 len: 1093 time: 0.5730882 Sep 18 08:53:59.874534 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f7780dcf-bbd6-433c-ac50-1d45ed33ef5b', 'tag': '241277d8-1c0c-4cc6-b9e5-e32064abe8d0'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:53:59.876773 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5fe5af90-0063-418b-a92b-a2803ed8edaa" -d '{"events": [{"name": "network-changed", "server_uuid": "f7780dcf-bbd6-433c-ac50-1d45ed33ef5b", "tag": "241277d8-1c0c-4cc6-b9e5-e32064abe8d0"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:53:59.938128 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:53:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-22cd70fd-b322-4d18-bff8-90bbb964a6bf x-openstack-request-id: req-22cd70fd-b322-4d18-bff8-90bbb964a6bf {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:53:59.938463 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f7780dcf-bbd6-433c-ac50-1d45ed33ef5b", "tag": "241277d8-1c0c-4cc6-b9e5-e32064abe8d0", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:53:59.938717 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-22cd70fd-b322-4d18-bff8-90bbb964a6bf {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:53:59.939108 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f7780dcf-bbd6-433c-ac50-1d45ed33ef5b', 'tag': '241277d8-1c0c-4cc6-b9e5-e32064abe8d0', 'status': 'completed', 'code': 200} Sep 18 08:53:59.939819 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b661cd21-c78e-4bd6-aea5-70a3109d4a99 service neutron] Pushing event updated for resources: {'Port': ['ID=241277d8-1c0c-4cc6-b9e5-e32064abe8d0,revision_number=3']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:53:59.991105 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc792b55-e1c5-42ed-8706-fbf57fa6d952 req-aac9161f-18af-481a-8ba8-8fe51b6c9c76 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:53:59.992651 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bc792b55-e1c5-42ed-8706-fbf57fa6d952 req-aac9161f-18af-481a-8ba8-8fe51b6c9c76 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=f7780dcf-bbd6-433c-ac50-1d45ed33ef5b HTTP/1.1" status: 200 len: 943 time: 0.0896935 Sep 18 08:54:00.008432 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-217738eb-d831-4430-a6d2-af296a5af680 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:54:00.009925 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-217738eb-d831-4430-a6d2-af296a5af680 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=334211ea09044272868662e38cb1a4ad&device_id=f7780dcf-bbd6-433c-ac50-1d45ed33ef5b HTTP/1.1" status: 200 len: 1096 time: 0.0607042 Sep 18 08:54:00.072382 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-bc792b55-e1c5-42ed-8706-fbf57fa6d952 req-ebdefd10-0323-4643-9e20-b66471218a98 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=adb64c73-3c2c-4142-9f4a-99dfbea0c233&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0718341 Sep 18 08:54:00.073775 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-b5b6ad90-c2d9-4947-b063-1495b57f64a2 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=241277d8-1c0c-4cc6-b9e5-e32064abe8d0 HTTP/1.1" status: 200 len: 217 time: 0.0497556 Sep 18 08:54:00.123379 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-2aaffe0f-cdc5-4d4a-aa64-2d311591743b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:54:00.124742 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-2aaffe0f-cdc5-4d4a-aa64-2d311591743b service neutron] 10.222.0.13 "GET /v2.0/subnets?id=e900aa03-4504-4ae5-a8a2-0da036634ce2 HTTP/1.1" status: 200 len: 849 time: 0.0433466 Sep 18 08:54:00.170302 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-34e46e95-7036-44b8-bfb5-81f751940d12 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:54:00.171799 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-34e46e95-7036-44b8-bfb5-81f751940d12 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=22bf7558-e572-4c3e-b191-f1edcd47c9f2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0398505 Sep 18 08:54:00.263637 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-24c700dc-db0b-443c-b512-29884a97820b service neutron] 10.222.0.13 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0845425 Sep 18 08:54:00.349194 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8333493a-d2ef-419e-9c9b-8b584cf6018e req-f92d2311-864b-45aa-b74e-d2397506c851 service neutron] 10.222.0.13 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0786088 Sep 18 08:54:00.480389 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fe5af90-0063-418b-a92b-a2803ed8edaa req-7d16a371-dfec-4815-a704-19bb0f655d89 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:54:00.481812 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5fe5af90-0063-418b-a92b-a2803ed8edaa req-7d16a371-dfec-4815-a704-19bb0f655d89 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=334211ea09044272868662e38cb1a4ad&device_id=f7780dcf-bbd6-433c-ac50-1d45ed33ef5b HTTP/1.1" status: 200 len: 1096 time: 0.0425708 Sep 18 08:54:00.568851 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fe5af90-0063-418b-a92b-a2803ed8edaa req-5009022c-89af-4679-b6fa-712b72d3f5ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:54:00.570339 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5fe5af90-0063-418b-a92b-a2803ed8edaa req-5009022c-89af-4679-b6fa-712b72d3f5ce service neutron] 10.222.0.13 "GET /v2.0/networks?id=22bf7558-e572-4c3e-b191-f1edcd47c9f2 HTTP/1.1" status: 200 len: 911 time: 0.0815573 Sep 18 08:54:00.613749 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5fe5af90-0063-418b-a92b-a2803ed8edaa req-8cfd64c3-dd26-4157-875d-9ad6b29aed44 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=241277d8-1c0c-4cc6-b9e5-e32064abe8d0 HTTP/1.1" status: 200 len: 217 time: 0.0359132 Sep 18 08:54:00.661796 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fe5af90-0063-418b-a92b-a2803ed8edaa req-a809c68c-3b01-4dda-8d65-42eec017867d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:54:00.663257 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5fe5af90-0063-418b-a92b-a2803ed8edaa req-a809c68c-3b01-4dda-8d65-42eec017867d service neutron] 10.222.0.13 "GET /v2.0/subnets?id=e900aa03-4504-4ae5-a8a2-0da036634ce2 HTTP/1.1" status: 200 len: 849 time: 0.0427020 Sep 18 08:54:00.708164 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fe5af90-0063-418b-a92b-a2803ed8edaa req-a1b4d5d5-8152-4a35-87a8-1ab863642869 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:54:00.709679 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5fe5af90-0063-418b-a92b-a2803ed8edaa req-a1b4d5d5-8152-4a35-87a8-1ab863642869 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=22bf7558-e572-4c3e-b191-f1edcd47c9f2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0382302 Sep 18 08:54:00.802031 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5fe5af90-0063-418b-a92b-a2803ed8edaa req-54f6cbb0-8cb1-476d-8ba4-344d4305cfe7 service neutron] 10.222.0.13 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0840728 Sep 18 08:54:00.887658 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5fe5af90-0063-418b-a92b-a2803ed8edaa req-f026d1f8-2fcd-44fe-a6e0-8351131feae2 service neutron] 10.222.0.13 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0775747 Sep 18 08:54:01.183694 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0ead807-379a-4424-b5cd-8b62677a3bca req-e45ba266-d4bb-4bf6-82ae-8a978a94368d tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:54:01.185130 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b0ead807-379a-4424-b5cd-8b62677a3bca req-e45ba266-d4bb-4bf6-82ae-8a978a94368d tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=f7780dcf-bbd6-433c-ac50-1d45ed33ef5b HTTP/1.1" status: 200 len: 943 time: 0.0459976 Sep 18 08:54:01.226289 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b0ead807-379a-4424-b5cd-8b62677a3bca req-08b86b73-84ed-4026-993d-f7c687f88a7b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=adb64c73-3c2c-4142-9f4a-99dfbea0c233&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0346599 Sep 18 08:54:02.587292 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b525f20e-23f4-43b7-91eb-17c64ef92d8d req-3ce28ac0-6181-4849-9802-49c61809be70 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:54:02.588783 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b525f20e-23f4-43b7-91eb-17c64ef92d8d req-3ce28ac0-6181-4849-9802-49c61809be70 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=f7780dcf-bbd6-433c-ac50-1d45ed33ef5b HTTP/1.1" status: 200 len: 943 time: 0.2978010 Sep 18 08:54:02.625360 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b525f20e-23f4-43b7-91eb-17c64ef92d8d req-6b1fbb0b-1c63-4567-be68-ea628efb6662 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=adb64c73-3c2c-4142-9f4a-99dfbea0c233&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0307229 Sep 18 08:54:03.734130 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b03d64fa-ab15-4496-b7be-8224769d70a4 req-06226456-57ab-46af-bf7b-b4b2d69245b5 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:54:03.735565 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b03d64fa-ab15-4496-b7be-8224769d70a4 req-06226456-57ab-46af-bf7b-b4b2d69245b5 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=f7780dcf-bbd6-433c-ac50-1d45ed33ef5b HTTP/1.1" status: 200 len: 943 time: 0.0472336 Sep 18 08:54:03.771868 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-b03d64fa-ab15-4496-b7be-8224769d70a4 req-3962b800-f0f9-4cf8-8b9d-f00d6a0b24c0 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=adb64c73-3c2c-4142-9f4a-99dfbea0c233&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0302787 Sep 18 08:54:03.967922 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 241277d8-1c0c-4cc6-b9e5-e32064abe8d0 details requested by agent hyperv_hv-cinder-80447 with host hv-cinder-80447 {{(pid=94348) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Sep 18 08:54:04.062242 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 241277d8-1c0c-4cc6-b9e5-e32064abe8d0, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=241277d8-1c0c-4cc6-b9e5-e32064abe8d0,segment=NetworkSegment(71fc0c51-8d26-4812-8dcb-f2ed141a03d2),segment_id=71fc0c51-8d26-4812-8dcb-f2ed141a03d2)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:54:04.073194 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Returning: {'device': '241277d8-1c0c-4cc6-b9e5-e32064abe8d0', 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'port_id': '241277d8-1c0c-4cc6-b9e5-e32064abe8d0', 'mac_address': 'fa:16:3e:04:42:16', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 230, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=94348) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Sep 18 08:54:04.108860 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:54:04.121028 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 241277d8-1c0c-4cc6-b9e5-e32064abe8d0 {{(pid=94348) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Sep 18 08:54:04.139380 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 241277d8-1c0c-4cc6-b9e5-e32064abe8d0, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=241277d8-1c0c-4cc6-b9e5-e32064abe8d0,segment=NetworkSegment(71fc0c51-8d26-4812-8dcb-f2ed141a03d2),segment_id=71fc0c51-8d26-4812-8dcb-f2ed141a03d2)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:54:04.144029 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:54:04.194757 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=241277d8-1c0c-4cc6-b9e5-e32064abe8d0,revision_number=4']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:54:04.201758 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:54:04.202115 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:54:04.202463 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:54:04.202804 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:54:04.203140 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:54:04.203476 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:54:04.203810 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:54:04.204140 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:54:04.204496 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:54:04.204827 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:54:04.205747 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:54:04.206076 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94348) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:54:04.580304 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] get_ports_and_sgs() called for port_ids ['241277d8-1c0c-4cc6-b9e5-e32064abe8d0'] {{(pid=94348) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Sep 18 08:54:04.880785 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f53cc3b6-7f53-4cfd-8e8d-e1d276617a41 req-407a2158-10bb-4627-b87f-849b4c15d932 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:54:04.882163 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f53cc3b6-7f53-4cfd-8e8d-e1d276617a41 req-407a2158-10bb-4627-b87f-849b4c15d932 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=f7780dcf-bbd6-433c-ac50-1d45ed33ef5b HTTP/1.1" status: 200 len: 944 time: 0.0466330 Sep 18 08:54:04.921105 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-f53cc3b6-7f53-4cfd-8e8d-e1d276617a41 req-c0b9c61e-9926-4b60-a7ba-b5fe563338a8 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=adb64c73-3c2c-4142-9f4a-99dfbea0c233&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0332453 Sep 18 08:54:05.984380 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 241277d8-1c0c-4cc6-b9e5-e32064abe8d0 up at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Sep 18 08:54:06.032793 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f4c3abb-9b76-49e1-9fa2-45c0e82be0ad req-f8f2f21f-99de-4f31-9552-3d4bbe7e7f91 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:54:06.034433 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning for port 241277d8-1c0c-4cc6-b9e5-e32064abe8d0 completed by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Sep 18 08:54:06.034623 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5f4c3abb-9b76-49e1-9fa2-45c0e82be0ad req-f8f2f21f-99de-4f31-9552-3d4bbe7e7f91 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=f7780dcf-bbd6-433c-ac50-1d45ed33ef5b HTTP/1.1" status: 200 len: 944 time: 0.0485976 Sep 18 08:54:06.038304 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.db.provisioning_blocks [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Provisioning complete for port 241277d8-1c0c-4cc6-b9e5-e32064abe8d0 triggered by entity L2. {{(pid=94348) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Sep 18 08:54:06.038677 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1808420'] for port, provisioning_complete {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:54:06.072183 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-5f4c3abb-9b76-49e1-9fa2-45c0e82be0ad req-fbc2cc24-c50a-4c5f-860e-98068d1e9afa tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=adb64c73-3c2c-4142-9f4a-99dfbea0c233&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0313921 Sep 18 08:54:06.115886 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1718504'] for port, before_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:54:06.137187 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f7780dcf-bbd6-433c-ac50-1d45ed33ef5b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '241277d8-1c0c-4cc6-b9e5-e32064abe8d0'}] {{(pid=94348) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:54:06.139395 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4f1ec4b9c43d662454a1f1f685588868a5bf1fe813f47ff66a97f38efcf20665" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1c05e514-16ce-4a6a-b360-4e6d6c9dcbd7" -d '{"events": [{"server_uuid": "f7780dcf-bbd6-433c-ac50-1d45ed33ef5b", "name": "network-vif-plugged", "status": "completed", "tag": "241277d8-1c0c-4cc6-b9e5-e32064abe8d0"}]}' {{(pid=94348) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:54:06.151159 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.db [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] For port 241277d8-1c0c-4cc6-b9e5-e32064abe8d0, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=241277d8-1c0c-4cc6-b9e5-e32064abe8d0,segment=NetworkSegment(71fc0c51-8d26-4812-8dcb-f2ed141a03d2),segment_id=71fc0c51-8d26-4812-8dcb-f2ed141a03d2)] {{(pid=94348) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:54:06.155625 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8732885775373', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8732885273546', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8732885273564'] for port, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:54:06.180685 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:54:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c19185f8-6c1c-4622-b085-1e51cc6b0159 x-openstack-request-id: req-c19185f8-6c1c-4622-b085-1e51cc6b0159 {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:54:06.180983 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f7780dcf-bbd6-433c-ac50-1d45ed33ef5b", "name": "network-vif-plugged", "status": "completed", "tag": "241277d8-1c0c-4cc6-b9e5-e32064abe8d0", "code": 200}]} {{(pid=94348) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:54:06.181323 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-c19185f8-6c1c-4622-b085-1e51cc6b0159 {{(pid=94348) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:54:06.181718 dv-cinder-804470-6-iscsi neutron-server[94348]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f7780dcf-bbd6-433c-ac50-1d45ed33ef5b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '241277d8-1c0c-4cc6-b9e5-e32064abe8d0', 'code': 200} Sep 18 08:54:06.205105 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Pushing event updated for resources: {'Port': ['ID=241277d8-1c0c-4cc6-b9e5-e32064abe8d0,revision_number=5']} {{(pid=94348) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:54:06.372771 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fe01295-a792-4bf1-a7ee-c522cbffc082 req-2d4ec5ab-ddf8-467b-85c9-c808ea15ca0b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:54:06.374252 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9fe01295-a792-4bf1-a7ee-c522cbffc082 req-2d4ec5ab-ddf8-467b-85c9-c808ea15ca0b service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=f7780dcf-bbd6-433c-ac50-1d45ed33ef5b HTTP/1.1" status: 200 len: 1098 time: 0.0386393 Sep 18 08:54:06.407679 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-9fe01295-a792-4bf1-a7ee-c522cbffc082 req-8b6298b8-1998-4837-a76a-97d8dc053274 service neutron] 10.222.0.13 "GET /v2.0/security-groups?id=adb64c73-3c2c-4142-9f4a-99dfbea0c233&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0261543 Sep 18 08:54:07.182755 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e710499-3c9a-4c0f-843a-4c1d49f05c53 req-400140ef-7f9a-4d53-9808-eee775523af3 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:54:07.184274 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8e710499-3c9a-4c0f-843a-4c1d49f05c53 req-400140ef-7f9a-4d53-9808-eee775523af3 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=f7780dcf-bbd6-433c-ac50-1d45ed33ef5b HTTP/1.1" status: 200 len: 945 time: 0.0465939 Sep 18 08:54:07.223555 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8e710499-3c9a-4c0f-843a-4c1d49f05c53 req-e7bc1051-5de9-45f6-a69b-96a7044a27a1 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=adb64c73-3c2c-4142-9f4a-99dfbea0c233&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0331385 Sep 18 08:54:07.692063 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:54:08.334468 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-297a10bb-2091-45a1-b924-3611d516a288 req-7b6422f7-9357-44d5-b5bf-e258c0039cea tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:54:08.335923 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-297a10bb-2091-45a1-b924-3611d516a288 req-7b6422f7-9357-44d5-b5bf-e258c0039cea tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=f7780dcf-bbd6-433c-ac50-1d45ed33ef5b HTTP/1.1" status: 200 len: 945 time: 0.0462632 Sep 18 08:54:08.372075 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-297a10bb-2091-45a1-b924-3611d516a288 req-3b11f76f-3e44-4738-814f-78579f4d6016 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=adb64c73-3c2c-4142-9f4a-99dfbea0c233&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0305116 Sep 18 08:54:08.478041 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f9d277b-2658-46ae-9dde-b250220d11ce req-1e16b954-f9d6-4402-b2da-8d17be97f9b2 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:54:08.479492 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-6f9d277b-2658-46ae-9dde-b250220d11ce req-1e16b954-f9d6-4402-b2da-8d17be97f9b2 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=f7780dcf-bbd6-433c-ac50-1d45ed33ef5b HTTP/1.1" status: 200 len: 945 time: 0.0469723 Sep 18 08:54:08.487733 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 38248) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:54:08.491952 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.v2.base [None req-fe5bd7bb-f9d1-4581-bea6-803f5f7ebc2b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Request body: {'floatingip': {'port_id': '241277d8-1c0c-4cc6-b9e5-e32064abe8d0'}} {{(pid=94347) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:730}} Sep 18 08:54:08.532040 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-fe5bd7bb-f9d1-4581-bea6-803f5f7ebc2b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for floatingip, before_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:54:08.942195 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-fe5bd7bb-f9d1-4581-bea6-803f5f7ebc2b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for floatingip, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:54:08.945916 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-fe5bd7bb-f9d1-4581-bea6-803f5f7ebc2b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-784908'] for floatingip, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:54:09.042010 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.db.l3_db [None req-fe5bd7bb-f9d1-4581-bea6-803f5f7ebc2b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Floating IP ef629eb5-736d-448b-8b68-89c911523862 associated. External IP: 172.27.1.27, port: 241277d8-1c0c-4cc6-b9e5-e32064abe8d0. Sep 18 08:54:09.263650 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fe5bd7bb-f9d1-4581-bea6-803f5f7ebc2b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Router 7ffeaad5-a677-409b-ba64-09886084c459 has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94347) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:54:09.367117 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fe5bd7bb-f9d1-4581-bea6-803f5f7ebc2b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94347) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:54:09.371925 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-fe5bd7bb-f9d1-4581-bea6-803f5f7ebc2b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for floatingip, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:54:09.376536 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a48251b1-d627-4b6b-afb4-4ec796507819 None None] Sync routers for ids ['7ffeaad5-a677-409b-ba64-09886084c459'] in dv-cinder-804470-6-iscsi {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:54:09.386369 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a48251b1-d627-4b6b-afb4-4ec796507819 None None] Routers {'7ffeaad5-a677-409b-ba64-09886084c459'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:54:09.386995 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-a48251b1-d627-4b6b-afb4-4ec796507819 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:53:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['7ffeaad5-a677-409b-ba64-09886084c459'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:54:09.397680 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-fe5bd7bb-f9d1-4581-bea6-803f5f7ebc2b tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "PUT /v2.0/floatingips/ef629eb5-736d-448b-8b68-89c911523862 HTTP/1.1" status: 200 len: 990 time: 0.9089432 Sep 18 08:54:09.398266 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'f7780dcf-bbd6-433c-ac50-1d45ed33ef5b', 'tag': '241277d8-1c0c-4cc6-b9e5-e32064abe8d0'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:54:09.400476 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cdd9eaf1-5ddd-4051-8b05-ed90b582b695" -d '{"events": [{"name": "network-changed", "server_uuid": "f7780dcf-bbd6-433c-ac50-1d45ed33ef5b", "tag": "241277d8-1c0c-4cc6-b9e5-e32064abe8d0"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:54:09.441427 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Sat, 18 Sep 2021 08:54:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3aec67ff-ea11-4ca0-8268-90d629cc30e0 x-openstack-request-id: req-3aec67ff-ea11-4ca0-8268-90d629cc30e0 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:54:09.441722 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "f7780dcf-bbd6-433c-ac50-1d45ed33ef5b", "tag": "241277d8-1c0c-4cc6-b9e5-e32064abe8d0", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:54:09.441977 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-3aec67ff-ea11-4ca0-8268-90d629cc30e0 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:54:09.442382 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'f7780dcf-bbd6-433c-ac50-1d45ed33ef5b', 'tag': '241277d8-1c0c-4cc6-b9e5-e32064abe8d0', 'status': 'completed', 'code': 200} Sep 18 08:54:09.495896 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-a48251b1-d627-4b6b-afb4-4ec796507819 None None] Set router 7ffeaad5-a677-409b-ba64-09886084c459 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:54:09.541857 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdd9eaf1-5ddd-4051-8b05-ed90b582b695 req-7a2d102a-211c-422f-a5ad-ccd2486fdb98 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:54:09.543410 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cdd9eaf1-5ddd-4051-8b05-ed90b582b695 req-7a2d102a-211c-422f-a5ad-ccd2486fdb98 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=334211ea09044272868662e38cb1a4ad&device_id=f7780dcf-bbd6-433c-ac50-1d45ed33ef5b HTTP/1.1" status: 200 len: 1098 time: 0.0483527 Sep 18 08:54:09.639978 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdd9eaf1-5ddd-4051-8b05-ed90b582b695 req-3c2a8a53-3f6b-46ca-8eff-a33dadfd62c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:54:09.641506 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cdd9eaf1-5ddd-4051-8b05-ed90b582b695 req-3c2a8a53-3f6b-46ca-8eff-a33dadfd62c4 service neutron] 10.222.0.13 "GET /v2.0/networks?id=22bf7558-e572-4c3e-b191-f1edcd47c9f2 HTTP/1.1" status: 200 len: 911 time: 0.0896490 Sep 18 08:54:09.703275 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cdd9eaf1-5ddd-4051-8b05-ed90b582b695 req-954980a4-c338-445f-8ed1-def4c0673176 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=241277d8-1c0c-4cc6-b9e5-e32064abe8d0 HTTP/1.1" status: 200 len: 998 time: 0.0553100 Sep 18 08:54:09.758099 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdd9eaf1-5ddd-4051-8b05-ed90b582b695 req-79cba437-e1af-4069-ab4c-adc3193519ab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:54:09.759562 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cdd9eaf1-5ddd-4051-8b05-ed90b582b695 req-79cba437-e1af-4069-ab4c-adc3193519ab service neutron] 10.222.0.13 "GET /v2.0/subnets?id=e900aa03-4504-4ae5-a8a2-0da036634ce2 HTTP/1.1" status: 200 len: 849 time: 0.0460980 Sep 18 08:54:09.801844 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-a48251b1-d627-4b6b-afb4-4ec796507819 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ffeaad5-a677-409b-ba64-09886084c459', 'name': 'tempest-AttachVolumeTestJSON-468473020-router', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100'}], 'enable_snat': True}, 'gw_port_id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:49:47Z', 'updated_at': '2021-09-18T08:49:50Z', 'revision_number': 4, 'project_id': '334211ea09044272868662e38cb1a4ad', 'gw_port': {'id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:06:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:48Z', 'updated_at': '2021-09-18T08:49:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': 'ef629eb5-736d-448b-8b68-89c911523862', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'floating_ip_address': '172.27.1.27', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'port_id': '241277d8-1c0c-4cc6-b9e5-e32064abe8d0', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 661, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'mac_address': 'fa:16:3e:04:42:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f7780dcf-bbd6-433c-ac50-1d45ed33ef5b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:53:56Z', 'updated_at': '2021-09-18T08:54:08Z', 'revision_number': 1, 'project_id': '334211ea09044272868662e38cb1a4ad', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e79b2742-d588-4bec-bf32-881880841c60', 'name': '', 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'mac_address': 'fa:16:3e:cc:93:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_interface', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:49Z', 'updated_at': '2021-09-18T08:49:53Z', 'revision_number': 5, 'project_id': '334211ea09044272868662e38cb1a4ad', 'subnets': [{'id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:54:09.805323 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cdd9eaf1-5ddd-4051-8b05-ed90b582b695 req-153f0d7b-f341-4016-8a98-44797b822af0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:54:09.806862 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cdd9eaf1-5ddd-4051-8b05-ed90b582b695 req-153f0d7b-f341-4016-8a98-44797b822af0 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=22bf7558-e572-4c3e-b191-f1edcd47c9f2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0394237 Sep 18 08:54:09.826952 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a48251b1-d627-4b6b-afb4-4ec796507819 None None] Checking router: 7ffeaad5-a677-409b-ba64-09886084c459 for host: dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:54:09.835498 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a48251b1-d627-4b6b-afb4-4ec796507819 None None] Routers {'7ffeaad5-a677-409b-ba64-09886084c459'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:54:09.836106 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-a48251b1-d627-4b6b-afb4-4ec796507819 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:53:52Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['7ffeaad5-a677-409b-ba64-09886084c459'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:54:09.900867 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cdd9eaf1-5ddd-4051-8b05-ed90b582b695 req-1f497fd0-cf7e-40fd-85b8-9160e6cbb2af service neutron] 10.222.0.13 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0861111 Sep 18 08:54:09.938777 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-a48251b1-d627-4b6b-afb4-4ec796507819 None None] Set router 7ffeaad5-a677-409b-ba64-09886084c459 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:54:09.993509 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cdd9eaf1-5ddd-4051-8b05-ed90b582b695 req-dafd039c-4151-4913-9a8e-d3771c10313b service neutron] 10.222.0.13 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0843313 Sep 18 08:54:10.161367 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-a48251b1-d627-4b6b-afb4-4ec796507819 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ffeaad5-a677-409b-ba64-09886084c459', 'name': 'tempest-AttachVolumeTestJSON-468473020-router', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100'}], 'enable_snat': True}, 'gw_port_id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:49:47Z', 'updated_at': '2021-09-18T08:49:50Z', 'revision_number': 4, 'project_id': '334211ea09044272868662e38cb1a4ad', 'gw_port': {'id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:06:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:48Z', 'updated_at': '2021-09-18T08:49:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': 'ef629eb5-736d-448b-8b68-89c911523862', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'floating_ip_address': '172.27.1.27', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'port_id': '241277d8-1c0c-4cc6-b9e5-e32064abe8d0', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 661, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'mac_address': 'fa:16:3e:04:42:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f7780dcf-bbd6-433c-ac50-1d45ed33ef5b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:53:56Z', 'updated_at': '2021-09-18T08:54:08Z', 'revision_number': 1, 'project_id': '334211ea09044272868662e38cb1a4ad', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e79b2742-d588-4bec-bf32-881880841c60', 'name': '', 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'mac_address': 'fa:16:3e:cc:93:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_interface', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:49Z', 'updated_at': '2021-09-18T08:49:53Z', 'revision_number': 5, 'project_id': '334211ea09044272868662e38cb1a4ad', 'subnets': [{'id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:54:10.187646 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a48251b1-d627-4b6b-afb4-4ec796507819 None None] The sync data for ids ['7ffeaad5-a677-409b-ba64-09886084c459'] in dv-cinder-804470-6-iscsi is: [{'id': '7ffeaad5-a677-409b-ba64-09886084c459', 'name': 'tempest-AttachVolumeTestJSON-468473020-router', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100'}], 'enable_snat': True}, 'gw_port_id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:49:47Z', 'updated_at': '2021-09-18T08:49:50Z', 'revision_number': 4, 'project_id': '334211ea09044272868662e38cb1a4ad', 'gw_port': {'id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:06:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:48Z', 'updated_at': '2021-09-18T08:49:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_floatingips': [{'id': 'ef629eb5-736d-448b-8b68-89c911523862', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'floating_ip_address': '172.27.1.27', 'floating_network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'router_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'port_id': '241277d8-1c0c-4cc6-b9e5-e32064abe8d0', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 661, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'mac_address': 'fa:16:3e:04:42:16', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'f7780dcf-bbd6-433c-ac50-1d45ed33ef5b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-09-18T08:53:56Z', 'updated_at': '2021-09-18T08:54:08Z', 'revision_number': 1, 'project_id': '334211ea09044272868662e38cb1a4ad', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e79b2742-d588-4bec-bf32-881880841c60', 'name': '', 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'mac_address': 'fa:16:3e:cc:93:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_interface', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:49Z', 'updated_at': '2021-09-18T08:49:53Z', 'revision_number': 5, 'project_id': '334211ea09044272868662e38cb1a4ad', 'subnets': [{'id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:54:10.357091 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-79e248d4-4a9e-4419-8a2e-fde76241fcb4 None None] New status for floating IP ef629eb5-736d-448b-8b68-89c911523862: ACTIVE {{(pid=94348) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 18 08:54:19.630685 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-2de79bac-6a99-4ff2-aa68-75693ecbfa82 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:54:20.175063 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:54:22.414234 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-feb2d264-efc2-44e8-a38d-42351c7837ed None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:54:23.234533 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:54:23.402349 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:54:24.917552 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:54:28.767157 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ad7aca71-c1d5-40bb-9d10-71171037f01d req-eb073a62-23c8-469c-a2d7-317962bb2b3d service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=f7780dcf-bbd6-433c-ac50-1d45ed33ef5b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0799339 Sep 18 08:54:28.866997 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad7aca71-c1d5-40bb-9d10-71171037f01d req-31a4dd0b-1589-4332-a2e5-c2807586ca37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:54:28.868536 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ad7aca71-c1d5-40bb-9d10-71171037f01d req-31a4dd0b-1589-4332-a2e5-c2807586ca37 service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=334211ea09044272868662e38cb1a4ad&device_id=f7780dcf-bbd6-433c-ac50-1d45ed33ef5b HTTP/1.1" status: 200 len: 1098 time: 0.0425787 Sep 18 08:54:28.969624 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad7aca71-c1d5-40bb-9d10-71171037f01d req-2bec3e9b-f5dd-43e0-93d5-85ba7217a919 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:54:28.971023 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ad7aca71-c1d5-40bb-9d10-71171037f01d req-2bec3e9b-f5dd-43e0-93d5-85ba7217a919 service neutron] 10.222.0.13 "GET /v2.0/networks?id=22bf7558-e572-4c3e-b191-f1edcd47c9f2 HTTP/1.1" status: 200 len: 911 time: 0.0823209 Sep 18 08:54:29.037824 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ad7aca71-c1d5-40bb-9d10-71171037f01d req-a0ed571c-708a-4f7a-9249-78cf3d9cc461 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=241277d8-1c0c-4cc6-b9e5-e32064abe8d0 HTTP/1.1" status: 200 len: 1000 time: 0.0592356 Sep 18 08:54:29.086026 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad7aca71-c1d5-40bb-9d10-71171037f01d req-a9f55dff-1ded-43b5-bc07-60c21cc4d609 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:54:29.087410 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ad7aca71-c1d5-40bb-9d10-71171037f01d req-a9f55dff-1ded-43b5-bc07-60c21cc4d609 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=e900aa03-4504-4ae5-a8a2-0da036634ce2 HTTP/1.1" status: 200 len: 849 time: 0.0417681 Sep 18 08:54:29.131731 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad7aca71-c1d5-40bb-9d10-71171037f01d req-4f9d40ef-7848-4854-9a8d-b858559db218 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:54:29.133146 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ad7aca71-c1d5-40bb-9d10-71171037f01d req-4f9d40ef-7848-4854-9a8d-b858559db218 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=22bf7558-e572-4c3e-b191-f1edcd47c9f2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0374873 Sep 18 08:54:29.221659 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ad7aca71-c1d5-40bb-9d10-71171037f01d req-f7855715-0a68-4319-a333-a671764ca445 service neutron] 10.222.0.13 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0808496 Sep 18 08:54:29.306969 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-ad7aca71-c1d5-40bb-9d10-71171037f01d req-90f36697-4af2-42c5-84ed-7d810b1e2a33 service neutron] 10.222.0.13 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0779388 Sep 18 08:54:44.691086 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:54:49.632279 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-89f6eae9-59d5-48cb-b25a-313ca3b74741 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:54:50.184266 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:54:52.414673 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-e02fc7b4-56f4-4dec-8285-eff474ef0cac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:54:53.234918 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:54:53.403545 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:54:54.920240 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:19.630988 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-e3e55ba6-d56b-48a8-86c4-0da8d8db9f77 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:20.193067 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:21.688815 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:55:22.415526 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-b0a08bc7-e20c-444c-9615-89dc9d9935e2 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:23.235305 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:23.407620 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:24.924560 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:28.725017 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3d223259-5363-4665-a798-cd17dc6d0a73 req-9bcaada6-fa94-4b70-8a50-12a60df1101a service neutron] 10.222.0.13 "GET /v2.0/ports?device_id=f7780dcf-bbd6-433c-ac50-1d45ed33ef5b&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0418215 Sep 18 08:55:28.819222 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d223259-5363-4665-a798-cd17dc6d0a73 req-6070f1af-b5fb-4cc7-998f-9d3eb636c8bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:55:28.820671 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3d223259-5363-4665-a798-cd17dc6d0a73 req-6070f1af-b5fb-4cc7-998f-9d3eb636c8bc service neutron] 10.222.0.13 "GET /v2.0/ports?tenant_id=334211ea09044272868662e38cb1a4ad&device_id=f7780dcf-bbd6-433c-ac50-1d45ed33ef5b HTTP/1.1" status: 200 len: 1098 time: 0.0386248 Sep 18 08:55:28.917965 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d223259-5363-4665-a798-cd17dc6d0a73 req-ad90b12d-db01-495a-ad0f-055c3c7a3bc5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:55:28.919384 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3d223259-5363-4665-a798-cd17dc6d0a73 req-ad90b12d-db01-495a-ad0f-055c3c7a3bc5 service neutron] 10.222.0.13 "GET /v2.0/networks?id=22bf7558-e572-4c3e-b191-f1edcd47c9f2 HTTP/1.1" status: 200 len: 911 time: 0.0799603 Sep 18 08:55:28.985241 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3d223259-5363-4665-a798-cd17dc6d0a73 req-ee349476-b159-4ff4-b8c6-c16cd89f9761 service neutron] 10.222.0.13 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=241277d8-1c0c-4cc6-b9e5-e32064abe8d0 HTTP/1.1" status: 200 len: 1000 time: 0.0586200 Sep 18 08:55:29.032692 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d223259-5363-4665-a798-cd17dc6d0a73 req-841b3860-d854-4297-be63-53caa2487f23 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:55:29.034117 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3d223259-5363-4665-a798-cd17dc6d0a73 req-841b3860-d854-4297-be63-53caa2487f23 service neutron] 10.222.0.13 "GET /v2.0/subnets?id=e900aa03-4504-4ae5-a8a2-0da036634ce2 HTTP/1.1" status: 200 len: 849 time: 0.0422218 Sep 18 08:55:29.079536 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d223259-5363-4665-a798-cd17dc6d0a73 req-ad70fe93-3a83-4369-8e30-901aa87718a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:55:29.081076 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3d223259-5363-4665-a798-cd17dc6d0a73 req-ad70fe93-3a83-4369-8e30-901aa87718a4 service neutron] 10.222.0.13 "GET /v2.0/ports?network_id=22bf7558-e572-4c3e-b191-f1edcd47c9f2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0390263 Sep 18 08:55:29.179070 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3d223259-5363-4665-a798-cd17dc6d0a73 req-ac84b9a3-3f4b-43ed-970f-8842a70d177f service neutron] 10.222.0.13 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0902376 Sep 18 08:55:29.282574 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-3d223259-5363-4665-a798-cd17dc6d0a73 req-8b2341e1-773c-44d0-879c-8b7c58e31c44 service neutron] 10.222.0.13 "GET /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0876756 Sep 18 08:55:40.166657 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5c3dbf9-1760-48fb-bf5a-84ecf6b7797f req-d311b7d0-9318-471f-9828-4465db88caee tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:55:40.168034 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d5c3dbf9-1760-48fb-bf5a-84ecf6b7797f req-d311b7d0-9318-471f-9828-4465db88caee tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=f7780dcf-bbd6-433c-ac50-1d45ed33ef5b HTTP/1.1" status: 200 len: 945 time: 0.0481479 Sep 18 08:55:40.203876 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-d5c3dbf9-1760-48fb-bf5a-84ecf6b7797f req-cd30eef7-1870-4929-a758-684aa35c23ca tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=adb64c73-3c2c-4142-9f4a-99dfbea0c233&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0299604 Sep 18 08:55:41.316612 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cab5ec4-bd4d-424d-a3be-ed28e88d44b5 req-5dd96e4a-75f4-4693-abee-d7e62f9c045e tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:55:41.318112 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8cab5ec4-bd4d-424d-a3be-ed28e88d44b5 req-5dd96e4a-75f4-4693-abee-d7e62f9c045e tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=f7780dcf-bbd6-433c-ac50-1d45ed33ef5b HTTP/1.1" status: 200 len: 945 time: 0.0470934 Sep 18 08:55:41.354357 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-8cab5ec4-bd4d-424d-a3be-ed28e88d44b5 req-69642255-94d4-4dd5-8f27-2633d728814f tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=adb64c73-3c2c-4142-9f4a-99dfbea0c233&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0305185 Sep 18 08:55:42.198938 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a14b69c-518c-45fb-880b-431f153e30a1 req-44309ed6-f51b-444f-af9e-474d13af4802 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:55:42.200279 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1a14b69c-518c-45fb-880b-431f153e30a1 req-44309ed6-f51b-444f-af9e-474d13af4802 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.13 "GET /v2.0/ports?device_id=f7780dcf-bbd6-433c-ac50-1d45ed33ef5b HTTP/1.1" status: 200 len: 945 time: 0.0498295 Sep 18 08:55:42.291631 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-1a14b69c-518c-45fb-880b-431f153e30a1 req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Deleting port 241277d8-1c0c-4cc6-b9e5-e32064abe8d0 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:55:42.291980 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-1a14b69c-518c-45fb-880b-431f153e30a1 req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:42.382521 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [req-1a14b69c-518c-45fb-880b-431f153e30a1 req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] For port 241277d8-1c0c-4cc6-b9e5-e32064abe8d0, host hv-cinder-80447, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-80447',level=0,port_id=241277d8-1c0c-4cc6-b9e5-e32064abe8d0,segment=NetworkSegment(71fc0c51-8d26-4812-8dcb-f2ed141a03d2),segment_id=71fc0c51-8d26-4812-8dcb-f2ed141a03d2)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:55:42.383040 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-1a14b69c-518c-45fb-880b-431f153e30a1 req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:42.515780 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb255d79-d4b5-44f5-ac7c-7946a07b9c48 req-3402aada-6fb8-4740-8cc8-87fcefb8affc tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=94347) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Sep 18 08:55:42.517127 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cb255d79-d4b5-44f5-ac7c-7946a07b9c48 req-3402aada-6fb8-4740-8cc8-87fcefb8affc tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/ports?device_id=f7780dcf-bbd6-433c-ac50-1d45ed33ef5b HTTP/1.1" status: 200 len: 945 time: 0.0935781 Sep 18 08:55:42.596262 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-cb255d79-d4b5-44f5-ac7c-7946a07b9c48 req-dd679f9f-b352-4143-9053-a085e6766b2f tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups?id=adb64c73-3c2c-4142-9f4a-99dfbea0c233&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0711038 Sep 18 08:55:42.608019 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-1a14b69c-518c-45fb-880b-431f153e30a1 req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for floatingip, precommit_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:42.608353 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-1a14b69c-518c-45fb-880b-431f153e30a1 req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-784908'] for floatingip, after_update {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:42.608745 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.db.l3_db [req-1a14b69c-518c-45fb-880b-431f153e30a1 req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Floating IP ef629eb5-736d-448b-8b68-89c911523862 disassociated. External IP: 172.27.1.27, port: 241277d8-1c0c-4cc6-b9e5-e32064abe8d0. Sep 18 08:55:42.609088 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [req-1a14b69c-518c-45fb-880b-431f153e30a1 req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Calling delete_port for 241277d8-1c0c-4cc6-b9e5-e32064abe8d0 owned by compute:nova {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:55:42.733950 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-1a14b69c-518c-45fb-880b-431f153e30a1 req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:42.759516 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Pushing event deleted for resources: {'Port': ['ID=241277d8-1c0c-4cc6-b9e5-e32064abe8d0,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:55:42.768966 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:55:42.769277 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:55:42.769622 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:55:42.769960 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:55:42.770295 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:55:42.770628 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:55:42.770960 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:55:42.771882 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:55:42.771882 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:55:42.772085 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:55:42.772305 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:55:42.772538 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94347) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:55:42.881457 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.scheduler.l3_agent_scheduler [req-1a14b69c-518c-45fb-880b-431f153e30a1 req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Router 7ffeaad5-a677-409b-ba64-09886084c459 has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94347) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:55:42.984429 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-1a14b69c-518c-45fb-880b-431f153e30a1 req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94347) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:55:42.994087 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6f5790e-843c-49b3-911d-7027bb814816 None None] Sync routers for ids ['7ffeaad5-a677-409b-ba64-09886084c459'] in dv-cinder-804470-6-iscsi {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:55:43.003634 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6f5790e-843c-49b3-911d-7027bb814816 None None] Routers {'7ffeaad5-a677-409b-ba64-09886084c459'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:55:43.004240 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-b6f5790e-843c-49b3-911d-7027bb814816 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:55:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['7ffeaad5-a677-409b-ba64-09886084c459'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:55:43.020360 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [req-1a14b69c-518c-45fb-880b-431f153e30a1 req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] No DVR routers for this DVR port 241277d8-1c0c-4cc6-b9e5-e32064abe8d0 on host hv-cinder-80447 {{(pid=94347) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:55:43.023369 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [req-1a14b69c-518c-45fb-880b-431f153e30a1 req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for port, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:43.025420 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [req-1a14b69c-518c-45fb-880b-431f153e30a1 req-7a1f2afc-27c3-4136-9f15-1640c6668587 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.13 "DELETE /v2.0/ports/241277d8-1c0c-4cc6-b9e5-e32064abe8d0 HTTP/1.1" status: 204 len: 173 time: 0.8184159 Sep 18 08:55:43.025858 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'f7780dcf-bbd6-433c-ac50-1d45ed33ef5b', 'name': 'network-vif-deleted', 'tag': '241277d8-1c0c-4cc6-b9e5-e32064abe8d0'}] {{(pid=94347) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Sep 18 08:55:43.028158 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.35/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}16f141c08a31e967b78d010485c3045be620a08f582e1ab7b443becb82d68f2e" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ec34df5d-e0e5-4fe0-9941-5aefeaf3bad6" -d '{"events": [{"server_uuid": "f7780dcf-bbd6-433c-ac50-1d45ed33ef5b", "name": "network-vif-deleted", "tag": "241277d8-1c0c-4cc6-b9e5-e32064abe8d0"}]}' {{(pid=94347) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Sep 18 08:55:43.115294 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-b6f5790e-843c-49b3-911d-7027bb814816 None None] Set router 7ffeaad5-a677-409b-ba64-09886084c459 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:55:43.127632 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Sat, 18 Sep 2021 08:55:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5013dcd5-962c-4972-ac78-adaf8fad8186 x-openstack-request-id: req-5013dcd5-962c-4972-ac78-adaf8fad8186 {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Sep 18 08:55:43.128373 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "f7780dcf-bbd6-433c-ac50-1d45ed33ef5b", "name": "network-vif-deleted", "tag": "241277d8-1c0c-4cc6-b9e5-e32064abe8d0", "status": "completed", "code": 200}]} {{(pid=94347) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Sep 18 08:55:43.128695 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.35/compute/v2.1/os-server-external-events used request id req-5013dcd5-962c-4972-ac78-adaf8fad8186 {{(pid=94347) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Sep 18 08:55:43.129091 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'f7780dcf-bbd6-433c-ac50-1d45ed33ef5b', 'name': 'network-vif-deleted', 'tag': '241277d8-1c0c-4cc6-b9e5-e32064abe8d0', 'status': 'completed', 'code': 200} Sep 18 08:55:43.321959 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-b6f5790e-843c-49b3-911d-7027bb814816 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ffeaad5-a677-409b-ba64-09886084c459', 'name': 'tempest-AttachVolumeTestJSON-468473020-router', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100'}], 'enable_snat': True}, 'gw_port_id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:49:47Z', 'updated_at': '2021-09-18T08:49:50Z', 'revision_number': 4, 'project_id': '334211ea09044272868662e38cb1a4ad', 'gw_port': {'id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:06:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:48Z', 'updated_at': '2021-09-18T08:49:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': 'e79b2742-d588-4bec-bf32-881880841c60', 'name': '', 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'mac_address': 'fa:16:3e:cc:93:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_interface', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:49Z', 'updated_at': '2021-09-18T08:49:53Z', 'revision_number': 5, 'project_id': '334211ea09044272868662e38cb1a4ad', 'subnets': [{'id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:55:43.347545 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6f5790e-843c-49b3-911d-7027bb814816 None None] Checking router: 7ffeaad5-a677-409b-ba64-09886084c459 for host: dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:55:43.355734 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b6f5790e-843c-49b3-911d-7027bb814816 None None] Routers {'7ffeaad5-a677-409b-ba64-09886084c459'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:55:43.356341 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-b6f5790e-843c-49b3-911d-7027bb814816 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:55:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['7ffeaad5-a677-409b-ba64-09886084c459'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:55:43.458413 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-b6f5790e-843c-49b3-911d-7027bb814816 None None] Set router 7ffeaad5-a677-409b-ba64-09886084c459 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:55:43.656602 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-b6f5790e-843c-49b3-911d-7027bb814816 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ffeaad5-a677-409b-ba64-09886084c459', 'name': 'tempest-AttachVolumeTestJSON-468473020-router', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100'}], 'enable_snat': True}, 'gw_port_id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:49:47Z', 'updated_at': '2021-09-18T08:49:50Z', 'revision_number': 4, 'project_id': '334211ea09044272868662e38cb1a4ad', 'gw_port': {'id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:06:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:48Z', 'updated_at': '2021-09-18T08:49:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': 'e79b2742-d588-4bec-bf32-881880841c60', 'name': '', 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'mac_address': 'fa:16:3e:cc:93:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_interface', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:49Z', 'updated_at': '2021-09-18T08:49:53Z', 'revision_number': 5, 'project_id': '334211ea09044272868662e38cb1a4ad', 'subnets': [{'id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:55:43.678901 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 38526) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:55:43.686369 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b6f5790e-843c-49b3-911d-7027bb814816 None None] The sync data for ids ['7ffeaad5-a677-409b-ba64-09886084c459'] in dv-cinder-804470-6-iscsi is: [{'id': '7ffeaad5-a677-409b-ba64-09886084c459', 'name': 'tempest-AttachVolumeTestJSON-468473020-router', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100'}], 'enable_snat': True}, 'gw_port_id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:49:47Z', 'updated_at': '2021-09-18T08:49:50Z', 'revision_number': 4, 'project_id': '334211ea09044272868662e38cb1a4ad', 'gw_port': {'id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:06:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:48Z', 'updated_at': '2021-09-18T08:49:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi', '_interfaces': [{'id': 'e79b2742-d588-4bec-bf32-881880841c60', 'name': '', 'network_id': '22bf7558-e572-4c3e-b191-f1edcd47c9f2', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'mac_address': 'fa:16:3e:cc:93:14', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_interface', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:49Z', 'updated_at': '2021-09-18T08:49:53Z', 'revision_number': 5, 'project_id': '334211ea09044272868662e38cb1a4ad', 'subnets': [{'id': 'e900aa03-4504-4ae5-a8a2-0da036634ce2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:55:43.737720 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-cf9822fc-3228-4dd0-be40-6e1e7fa64704 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:43.761505 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-cf9822fc-3228-4dd0-be40-6e1e7fa64704 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:43.808450 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-cf9822fc-3228-4dd0-be40-6e1e7fa64704 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:43.811010 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-cf9822fc-3228-4dd0-be40-6e1e7fa64704 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:43.812283 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-cf9822fc-3228-4dd0-be40-6e1e7fa64704 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "DELETE /v2.0/security-groups/adb64c73-3c2c-4142-9f4a-99dfbea0c233 HTTP/1.1" status: 204 len: 168 time: 0.1323090 Sep 18 08:55:43.815007 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 38528) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:55:43.824075 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf9822fc-3228-4dd0-be40-6e1e7fa64704 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=adb64c73-3c2c-4142-9f4a-99dfbea0c233,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:55:43.830505 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.api.v2.resource [None req-0435f66d-d9f5-45fa-a88d-c701fd5f4490 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] show failed (client error): The resource could not be found. Sep 18 08:55:43.834528 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-0435f66d-d9f5-45fa-a88d-c701fd5f4490 tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "GET /v2.0/security-groups/adb64c73-3c2c-4142-9f4a-99dfbea0c233 HTTP/1.1" status: 404 len: 347 time: 0.0185063 Sep 18 08:55:43.835091 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 38532) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:55:43.914063 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f8cf0dad-be25-4844-af8b-33a38c5f8050 None None] New status for floating IP ef629eb5-736d-448b-8b68-89c911523862: DOWN {{(pid=94348) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Sep 18 08:55:43.965893 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.plugin [None req-093b0f21-a3f6-4707-9c48-85822d021acd tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Deleting port 643dfc40-c4c3-40eb-a868-a0b6fd762b0a {{(pid=94346) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:55:43.966241 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-093b0f21-a3f6-4707-9c48-85822d021acd tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:44.042199 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-093b0f21-a3f6-4707-9c48-85822d021acd tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:44.042541 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-093b0f21-a3f6-4707-9c48-85822d021acd tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for floatingip, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:44.055126 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.plugin [None req-093b0f21-a3f6-4707-9c48-85822d021acd tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Calling delete_port for 643dfc40-c4c3-40eb-a868-a0b6fd762b0a owned by network:floatingip {{(pid=94346) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:55:44.181398 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-093b0f21-a3f6-4707-9c48-85822d021acd tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:44.206216 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-093b0f21-a3f6-4707-9c48-85822d021acd tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Pushing event deleted for resources: {'Port': ['ID=643dfc40-c4c3-40eb-a868-a0b6fd762b0a,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:55:44.233941 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-093b0f21-a3f6-4707-9c48-85822d021acd tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:55:44.234296 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-093b0f21-a3f6-4707-9c48-85822d021acd tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:55:44.234645 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-093b0f21-a3f6-4707-9c48-85822d021acd tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:55:44.234991 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-093b0f21-a3f6-4707-9c48-85822d021acd tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:55:44.235327 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-093b0f21-a3f6-4707-9c48-85822d021acd tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:55:44.235662 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-093b0f21-a3f6-4707-9c48-85822d021acd tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:55:44.235995 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-093b0f21-a3f6-4707-9c48-85822d021acd tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type QosPolicy changed None to 1.9 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:55:44.236328 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-093b0f21-a3f6-4707-9c48-85822d021acd tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type SecurityGroup changed None to 1.4 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:55:44.236685 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-093b0f21-a3f6-4707-9c48-85822d021acd tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:55:44.236988 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-093b0f21-a3f6-4707-9c48-85822d021acd tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:55:44.237343 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-093b0f21-a3f6-4707-9c48-85822d021acd tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:55:44.237672 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-093b0f21-a3f6-4707-9c48-85822d021acd tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-804470-6-iscsi {{(pid=94346) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Sep 18 08:55:44.274798 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-093b0f21-a3f6-4707-9c48-85822d021acd tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks [] for floatingip, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:44.277314 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-093b0f21-a3f6-4707-9c48-85822d021acd tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] Notify callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-217646'] for floatingip, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:44.278502 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-093b0f21-a3f6-4707-9c48-85822d021acd tempest-AttachVolumeTestJSON-1408255047 tempest-AttachVolumeTestJSON-1408255047-project] 10.222.0.35 "DELETE /v2.0/floatingips/ef629eb5-736d-448b-8b68-89c911523862 HTTP/1.1" status: 204 len: 168 time: 0.4424758 Sep 18 08:55:46.511997 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 241277d8-1c0c-4cc6-b9e5-e32064abe8d0 no longer exists at agent hyperv_hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:55:46.530827 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] No Port match for: 241277d8-1c0c-4cc6-b9e5-e32064abe8d0 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:55:46.531171 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Device 241277d8-1c0c-4cc6-b9e5-e32064abe8d0 not bound to the agent host hv-cinder-80447 {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:55:47.798947 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 38560) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:55:48.222222 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b0bbb2cb-c4ae-49e8-a11b-b6f37c132954 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-783372'] for router_interface, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:48.454791 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.plugin [None req-b0bbb2cb-c4ae-49e8-a11b-b6f37c132954 admin admin] Deleting port e79b2742-d588-4bec-bf32-881880841c60 {{(pid=94346) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:55:48.455123 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b0bbb2cb-c4ae-49e8-a11b-b6f37c132954 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:48.532813 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.db [None req-b0bbb2cb-c4ae-49e8-a11b-b6f37c132954 admin admin] For port e79b2742-d588-4bec-bf32-881880841c60, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=e79b2742-d588-4bec-bf32-881880841c60,segment=NetworkSegment(71fc0c51-8d26-4812-8dcb-f2ed141a03d2),segment_id=71fc0c51-8d26-4812-8dcb-f2ed141a03d2)] {{(pid=94346) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:55:48.533168 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b0bbb2cb-c4ae-49e8-a11b-b6f37c132954 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:48.544940 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.plugins.ml2.plugin [None req-b0bbb2cb-c4ae-49e8-a11b-b6f37c132954 admin admin] Calling delete_port for e79b2742-d588-4bec-bf32-881880841c60 owned by network:router_interface {{(pid=94346) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:55:48.715101 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b0bbb2cb-c4ae-49e8-a11b-b6f37c132954 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-14290162'] for port, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:48.740440 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0bbb2cb-c4ae-49e8-a11b-b6f37c132954 admin admin] Pushing event deleted for resources: {'Port': ['ID=e79b2742-d588-4bec-bf32-881880841c60,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:55:48.897996 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-b0bbb2cb-c4ae-49e8-a11b-b6f37c132954 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-580042', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-785084'] for router_interface, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:49.102832 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b0bbb2cb-c4ae-49e8-a11b-b6f37c132954 admin admin] Router 7ffeaad5-a677-409b-ba64-09886084c459 has already been hosted by L3 agent 79fb3ba4-5990-4a75-ace8-f217cd332a7a {{(pid=94346) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Sep 18 08:55:49.204368 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b0bbb2cb-c4ae-49e8-a11b-b6f37c132954 admin admin] Notify agent at l3_agent.dv-cinder-804470-6-iscsi the message routers_updated {{(pid=94346) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Sep 18 08:55:49.209992 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-b0bbb2cb-c4ae-49e8-a11b-b6f37c132954 admin admin] 10.222.0.35 "PUT /v2.0/routers/7ffeaad5-a677-409b-ba64-09886084c459/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4100287 Sep 18 08:55:49.212602 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 38564) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:55:49.213575 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84e6fc38-3979-4ebd-a35f-2180597ff100 None None] Sync routers for ids ['7ffeaad5-a677-409b-ba64-09886084c459'] in dv-cinder-804470-6-iscsi {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Sep 18 08:55:49.222927 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84e6fc38-3979-4ebd-a35f-2180597ff100 None None] Routers {'7ffeaad5-a677-409b-ba64-09886084c459'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:55:49.223539 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-84e6fc38-3979-4ebd-a35f-2180597ff100 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:55:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['7ffeaad5-a677-409b-ba64-09886084c459'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:55:49.317662 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8d2ce33d-abc6-4768-a519-968300d63b76 admin admin] Notify callbacks [] for router, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:49.409826 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-84e6fc38-3979-4ebd-a35f-2180597ff100 None None] Set router 7ffeaad5-a677-409b-ba64-09886084c459 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:55:49.599256 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-84e6fc38-3979-4ebd-a35f-2180597ff100 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ffeaad5-a677-409b-ba64-09886084c459', 'name': 'tempest-AttachVolumeTestJSON-468473020-router', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100'}], 'enable_snat': True}, 'gw_port_id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:49:47Z', 'updated_at': '2021-09-18T08:55:48Z', 'revision_number': 5, 'project_id': '334211ea09044272868662e38cb1a4ad', 'gw_port': {'id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:06:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:48Z', 'updated_at': '2021-09-18T08:49:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:55:49.625835 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84e6fc38-3979-4ebd-a35f-2180597ff100 None None] Checking router: 7ffeaad5-a677-409b-ba64-09886084c459 for host: dv-cinder-804470-6-iscsi {{(pid=94349) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Sep 18 08:55:49.632305 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-c1d8ed02-dda2-4014-9b58-451ce3fd9aa5 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:49.635203 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvrscheduler_db [None req-84e6fc38-3979-4ebd-a35f-2180597ff100 None None] Routers {'7ffeaad5-a677-409b-ba64-09886084c459'} bound to L3 agent in host dv-cinder-804470-6-iscsi {{(pid=94349) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Sep 18 08:55:49.635821 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-84e6fc38-3979-4ebd-a35f-2180597ff100 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-804470-6-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-09-18T08:30:22Z,description=,heartbeat_timestamp=2021-09-18T08:55:22Z,host='dv-cinder-804470-6-iscsi',id=79fb3ba4-5990-4a75-ace8-f217cd332a7a,load=0,resource_versions=,resources_synced=,started_at=2021-09-18T08:30:22Z,topic='l3_agent')) {'router_ids': ['7ffeaad5-a677-409b-ba64-09886084c459'], 'active': True} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:55:49.684757 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8d2ce33d-abc6-4768-a519-968300d63b76 admin admin] Notify callbacks [] for router_gateway, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:49.735398 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-8d2ce33d-abc6-4768-a519-968300d63b76 admin admin] Deleting port 9456ac74-11c9-4299-be6b-0fdce79ecd45 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:55:49.735739 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8d2ce33d-abc6-4768-a519-968300d63b76 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:49.739110 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_dvr_db [None req-84e6fc38-3979-4ebd-a35f-2180597ff100 None None] Set router 7ffeaad5-a677-409b-ba64-09886084c459 gateway port host: dv-cinder-804470-6-iscsi {{(pid=94349) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Sep 18 08:55:49.810646 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [None req-8d2ce33d-abc6-4768-a519-968300d63b76 admin admin] For port 9456ac74-11c9-4299-be6b-0fdce79ecd45, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=9456ac74-11c9-4299-be6b-0fdce79ecd45,segment=NetworkSegment(0878b5b4-f4d3-4abd-a0e1-57da5a8e486c),segment_id=0878b5b4-f4d3-4abd-a0e1-57da5a8e486c)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:55:49.811007 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8d2ce33d-abc6-4768-a519-968300d63b76 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:49.822919 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-8d2ce33d-abc6-4768-a519-968300d63b76 admin admin] Calling delete_port for 9456ac74-11c9-4299-be6b-0fdce79ecd45 owned by network:router_gateway {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:55:49.917466 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.l3_hamode_db [None req-84e6fc38-3979-4ebd-a35f-2180597ff100 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ffeaad5-a677-409b-ba64-09886084c459', 'name': 'tempest-AttachVolumeTestJSON-468473020-router', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100'}], 'enable_snat': True}, 'gw_port_id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:49:47Z', 'updated_at': '2021-09-18T08:55:48Z', 'revision_number': 5, 'project_id': '334211ea09044272868662e38cb1a4ad', 'gw_port': {'id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:06:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:48Z', 'updated_at': '2021-09-18T08:49:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}], 'dv-cinder-804470-6-iscsi', False) {} {{(pid=94349) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:55:49.944330 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-84e6fc38-3979-4ebd-a35f-2180597ff100 None None] The sync data for ids ['7ffeaad5-a677-409b-ba64-09886084c459'] in dv-cinder-804470-6-iscsi is: [{'id': '7ffeaad5-a677-409b-ba64-09886084c459', 'name': 'tempest-AttachVolumeTestJSON-468473020-router', 'tenant_id': '334211ea09044272868662e38cb1a4ad', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'external_fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100'}], 'enable_snat': True}, 'gw_port_id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-09-18T08:49:47Z', 'updated_at': '2021-09-18T08:55:48Z', 'revision_number': 5, 'project_id': '334211ea09044272868662e38cb1a4ad', 'gw_port': {'id': '9456ac74-11c9-4299-be6b-0fdce79ecd45', 'name': '', 'network_id': '2e3b3f85-63e4-4380-917a-8c90c80b3e38', 'tenant_id': '', 'mac_address': 'fa:16:3e:4b:06:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ffeaad5-a677-409b-ba64-09886084c459', 'device_owner': 'network:router_gateway', 'standard_attr_id': 645, 'fixed_ips': [{'subnet_id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'ip_address': '172.27.1.100', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-804470-6-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-09-18T08:49:48Z', 'updated_at': '2021-09-18T08:49:52Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'cd525bb9-7f93-490c-a5d6-a08911817e54', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-804470-6-iscsi'}] {{(pid=94349) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Sep 18 08:55:49.990736 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8d2ce33d-abc6-4768-a519-968300d63b76 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:50.020738 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d2ce33d-abc6-4768-a519-968300d63b76 admin admin] Pushing event deleted for resources: {'Port': ['ID=9456ac74-11c9-4299-be6b-0fdce79ecd45,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:55:50.076034 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8d2ce33d-abc6-4768-a519-968300d63b76 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-785018'] for router_gateway, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:50.161364 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8d2ce33d-abc6-4768-a519-968300d63b76 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-782379', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-2977'] for router, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:50.163374 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8d2ce33d-abc6-4768-a519-968300d63b76 admin admin] Notify callbacks [] for router_controller, precommit_delete_associations {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:50.196132 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:50.207561 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8d2ce33d-abc6-4768-a519-968300d63b76 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-782544'] for router, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:50.208129 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8d2ce33d-abc6-4768-a519-968300d63b76 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 7ffeaad5-a677-409b-ba64-09886084c459 {{(pid=94347) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Sep 18 08:55:50.213474 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-8d2ce33d-abc6-4768-a519-968300d63b76 admin admin] Notify callbacks [] for router, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:50.214422 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-8d2ce33d-abc6-4768-a519-968300d63b76 admin admin] 10.222.0.35 "DELETE /v2.0/routers/7ffeaad5-a677-409b-ba64-09886084c459 HTTP/1.1" status: 204 len: 168 time: 1.0007114 Sep 18 08:55:50.216901 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 38566) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:55:50.263252 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.db_base_plugin_v2 [None req-fe15d13e-cde1-46ec-aa5f-c6378ac6b319 admin admin] Deleting subnet e900aa03-4504-4ae5-a8a2-0da036634ce2 {{(pid=94347) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1056}} Sep 18 08:55:50.266097 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-fe15d13e-cde1-46ec-aa5f-c6378ac6b319 admin admin] Notify callbacks [] for subnet, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:50.300189 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-fe15d13e-cde1-46ec-aa5f-c6378ac6b319 admin admin] Notify callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-13659316'] for subnet, precommit_delete_associations {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:50.379656 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-fe15d13e-cde1-46ec-aa5f-c6378ac6b319 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1821528'] for subnet, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:50.432206 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-fe15d13e-cde1-46ec-aa5f-c6378ac6b319 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1821519', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580218', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-15069100', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-13996283'] for subnet, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:50.460514 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe15d13e-cde1-46ec-aa5f-c6378ac6b319 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e900aa03-4504-4ae5-a8a2-0da036634ce2,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:55:50.464154 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-fe15d13e-cde1-46ec-aa5f-c6378ac6b319 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for subnet, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:50.466058 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-fe15d13e-cde1-46ec-aa5f-c6378ac6b319 admin admin] 10.222.0.35 "DELETE /v2.0/subnets/e900aa03-4504-4ae5-a8a2-0da036634ce2 HTTP/1.1" status: 204 len: 168 time: 0.2482018 Sep 18 08:55:50.468481 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 38568) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:55:50.472686 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-11f608c3-33e6-4c60-9ef2-af7e2aec058a None None] Network 22bf7558-e572-4c3e-b191-f1edcd47c9f2 requested from dv-cinder-804470-6-iscsi {{(pid=94348) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Sep 18 08:55:50.540923 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a6b13f3a-f1b2-4fd8-b1c5-687ab6d8bee9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1861545'] for network, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:50.603470 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-a6b13f3a-f1b2-4fd8-b1c5-687ab6d8bee9 admin admin] Deleting port 9da4beeb-9bbe-49ad-adc9-a7799514dc47 {{(pid=94347) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1931}} Sep 18 08:55:50.603987 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a6b13f3a-f1b2-4fd8-b1c5-687ab6d8bee9 admin admin] Notify callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8732885768241'] for port, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:50.679657 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.db [None req-a6b13f3a-f1b2-4fd8-b1c5-687ab6d8bee9 admin admin] For port 9da4beeb-9bbe-49ad-adc9-a7799514dc47, host dv-cinder-804470-6-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-804470-6-iscsi',level=0,port_id=9da4beeb-9bbe-49ad-adc9-a7799514dc47,segment=NetworkSegment(71fc0c51-8d26-4812-8dcb-f2ed141a03d2),segment_id=71fc0c51-8d26-4812-8dcb-f2ed141a03d2)] {{(pid=94347) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Sep 18 08:55:50.680020 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a6b13f3a-f1b2-4fd8-b1c5-687ab6d8bee9 admin admin] Notify callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-780356'] for port, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:50.692879 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.plugin [None req-a6b13f3a-f1b2-4fd8-b1c5-687ab6d8bee9 admin admin] Calling delete_port for 9da4beeb-9bbe-49ad-adc9-a7799514dc47 owned by network:dhcp {{(pid=94347) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2009}} Sep 18 08:55:50.770859 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a6b13f3a-f1b2-4fd8-b1c5-687ab6d8bee9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1718441', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-197477', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8732885775095', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8732885273537', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-15069059'] for port, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:50.799008 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6b13f3a-f1b2-4fd8-b1c5-687ab6d8bee9 admin admin] Pushing event deleted for resources: {'Port': ['ID=9da4beeb-9bbe-49ad-adc9-a7799514dc47,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:55:50.802593 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6b13f3a-f1b2-4fd8-b1c5-687ab6d8bee9 admin admin] No DVR routers for this DVR port 9da4beeb-9bbe-49ad-adc9-a7799514dc47 on host dv-cinder-804470-6-iscsi {{(pid=94347) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Sep 18 08:55:50.870585 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a6b13f3a-f1b2-4fd8-b1c5-687ab6d8bee9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1806559', 'neutron.services.segments.db._delete_segments_for_network-8732885752733'] for network, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:50.889151 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.services.segments.db [None req-a6b13f3a-f1b2-4fd8-b1c5-687ab6d8bee9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['22bf7558-e572-4c3e-b191-f1edcd47c9f2']}} {{(pid=94347) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:55:50.898041 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.services.segments.db [None req-a6b13f3a-f1b2-4fd8-b1c5-687ab6d8bee9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '71fc0c51-8d26-4812-8dcb-f2ed141a03d2') {'for_net_delete': True} {{(pid=94347) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:55:50.898340 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.services.segments.db [None req-a6b13f3a-f1b2-4fd8-b1c5-687ab6d8bee9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '71fc0c51-8d26-4812-8dcb-f2ed141a03d2') {} {{(pid=94347) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Sep 18 08:55:50.908135 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a6b13f3a-f1b2-4fd8-b1c5-687ab6d8bee9 admin admin] Notify callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8732885753254', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-13659327'] for segment, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:50.921849 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a6b13f3a-f1b2-4fd8-b1c5-687ab6d8bee9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429'] for segment, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:50.929093 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a6b13f3a-f1b2-4fd8-b1c5-687ab6d8bee9 admin admin] Releasing vlan 230 on physical network physnet1 to pool {{(pid=94347) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Sep 18 08:55:50.929546 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a6b13f3a-f1b2-4fd8-b1c5-687ab6d8bee9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1812429', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-15067250'] for segment, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: Traceback (most recent call last): Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: timer() Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: cb(*args, **kw) Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/common/utils.py", line 906, in wrapper Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: return func(*args, **kwargs) Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: self._notify() Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: self.callback(batched_events) Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: event.method(event) Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: aggregate_id = self._get_aggregate_id(event.segment_id) Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: aggregate_uuid = self.p_client.list_aggregates( Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: return f(self, *a, **k) Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: return self._get(url).json() Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: return self._client.get(url, endpoint_filter=self._ks_filter, Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: return self.request(url, 'GET', **kwargs) Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: base_url = self.get_endpoint(auth, allow=allow, Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: auth = self._auth_required(auth, 'determine endpoint URL') Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Sep 18 08:55:50.931510 dv-cinder-804470-6-iscsi neutron-server[94347]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Sep 18 08:55:50.945092 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8f97a437-ff8d-4f37-a232-0486b1f6e63d None None] DHCP port deletion for 22bf7558-e572-4c3e-b191-f1edcd47c9f2 request from dv-cinder-804470-6-iscsi {{(pid=94348) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Sep 18 08:55:50.991504 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a6b13f3a-f1b2-4fd8-b1c5-687ab6d8bee9 admin admin] Notify callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1806534', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-580102', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-579385', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-784926'] for network, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:50.997887 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-a6b13f3a-f1b2-4fd8-b1c5-687ab6d8bee9 admin admin] Notify callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-579371'] for network, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:50.999632 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-a6b13f3a-f1b2-4fd8-b1c5-687ab6d8bee9 admin admin] 10.222.0.35 "DELETE /v2.0/networks/22bf7558-e572-4c3e-b191-f1edcd47c9f2 HTTP/1.1" status: 204 len: 168 time: 0.5300033 Sep 18 08:55:51.008821 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6b13f3a-f1b2-4fd8-b1c5-687ab6d8bee9 admin admin] Pushing event deleted for resources: {'Network': ['ID=22bf7558-e572-4c3e-b191-f1edcd47c9f2,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:55:51.109857 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 38572) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:55:51.148624 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-89ce2da3-0553-47a5-82e8-1b020df38bde admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=334211ea09044272868662e38cb1a4ad&name=default HTTP/1.1" status: 200 len: 2979 time: 0.0375769 Sep 18 08:55:51.151037 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 38574) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:55:51.197290 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dfa28198-d51a-4857-902c-24c1e55f55b8 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:51.219218 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dfa28198-d51a-4857-902c-24c1e55f55b8 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:51.276901 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dfa28198-d51a-4857-902c-24c1e55f55b8 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:51.279525 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dfa28198-d51a-4857-902c-24c1e55f55b8 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:51.280694 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-dfa28198-d51a-4857-902c-24c1e55f55b8 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/8370a86f-c71c-4df6-92f2-cce70abb1a4f HTTP/1.1" status: 204 len: 168 time: 0.1287522 Sep 18 08:55:51.288763 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfa28198-d51a-4857-902c-24c1e55f55b8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8370a86f-c71c-4df6-92f2-cce70abb1a4f,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:55:51.887807 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 9da4beeb-9bbe-49ad-adc9-a7799514dc47 no longer exists at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:55:51.906617 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-536c997d-2873-442a-81bf-9fe918803742 None None] No Port match for: 9da4beeb-9bbe-49ad-adc9-a7799514dc47 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:55:51.906961 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 9da4beeb-9bbe-49ad-adc9-a7799514dc47 not bound to the agent host dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:55:51.907371 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device e79b2742-d588-4bec-bf32-881880841c60 no longer exists at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:55:51.925093 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-536c997d-2873-442a-81bf-9fe918803742 None None] No Port match for: e79b2742-d588-4bec-bf32-881880841c60 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:55:51.925464 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device e79b2742-d588-4bec-bf32-881880841c60 not bound to the agent host dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:55:51.925869 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 9456ac74-11c9-4299-be6b-0fdce79ecd45 no longer exists at agent ovs-agent-dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Sep 18 08:55:51.949784 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.plugin [None req-536c997d-2873-442a-81bf-9fe918803742 None None] No Port match for: 9456ac74-11c9-4299-be6b-0fdce79ecd45 {{(pid=94348) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2267}} Sep 18 08:55:51.950566 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron.plugins.ml2.rpc [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Device 9456ac74-11c9-4299-be6b-0fdce79ecd45 not bound to the agent host dv-cinder-804470-6-iscsi {{(pid=94348) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Sep 18 08:55:52.417655 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-8f748f48-6f7d-4e2c-9ab5-81b36c88e989 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:53.237802 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:53.409032 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:54.926654 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:55.562261 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 38658) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:55:55.663270 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-53140dbf-03b4-4a1f-9aaf-fa134b48020c admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:55.747960 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-53140dbf-03b4-4a1f-9aaf-fa134b48020c admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:55.751461 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-53140dbf-03b4-4a1f-9aaf-fa134b48020c admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:55.788854 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-53140dbf-03b4-4a1f-9aaf-fa134b48020c admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=50804490b96b442e9d5d8ad261e74e60&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2254035 Sep 18 08:55:55.789980 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53140dbf-03b4-4a1f-9aaf-fa134b48020c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6cfa53f4-5bff-4e73-abe4-cb530f901588,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:55:55.791494 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 38662) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:55:55.838516 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-08ffab64-6704-41da-8d3e-710a9e2c9529 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:55.859159 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-08ffab64-6704-41da-8d3e-710a9e2c9529 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:55.903745 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-08ffab64-6704-41da-8d3e-710a9e2c9529 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:55.906307 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-08ffab64-6704-41da-8d3e-710a9e2c9529 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:55.907436 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-08ffab64-6704-41da-8d3e-710a9e2c9529 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/6cfa53f4-5bff-4e73-abe4-cb530f901588 HTTP/1.1" status: 204 len: 168 time: 0.1149118 Sep 18 08:55:55.915756 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08ffab64-6704-41da-8d3e-710a9e2c9529 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6cfa53f4-5bff-4e73-abe4-cb530f901588,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:55:56.153499 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 38668) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:55:56.166288 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-04a708c9-e1b6-4f3a-abe6-2dd7a4a59091 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:56.252448 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-04a708c9-e1b6-4f3a-abe6-2dd7a4a59091 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:56.255801 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-04a708c9-e1b6-4f3a-abe6-2dd7a4a59091 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:56.291489 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-04a708c9-e1b6-4f3a-abe6-2dd7a4a59091 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=afcbe81c-898f-46f2-b973-cc7e3d98545b,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:55:56.295734 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-04a708c9-e1b6-4f3a-abe6-2dd7a4a59091 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=59c2abc858d64bfa90ec829ab1f4c035&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1411815 Sep 18 08:55:56.298369 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 38670) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:55:56.347398 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c6542781-b1ab-4c1e-839f-66d5b9ce4b43 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:56.368019 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c6542781-b1ab-4c1e-839f-66d5b9ce4b43 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:56.411253 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c6542781-b1ab-4c1e-839f-66d5b9ce4b43 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:56.413904 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-c6542781-b1ab-4c1e-839f-66d5b9ce4b43 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:55:56.415031 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-c6542781-b1ab-4c1e-839f-66d5b9ce4b43 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/afcbe81c-898f-46f2-b973-cc7e3d98545b HTTP/1.1" status: 204 len: 168 time: 0.1157734 Sep 18 08:55:56.422118 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6542781-b1ab-4c1e-839f-66d5b9ce4b43 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=afcbe81c-898f-46f2-b973-cc7e3d98545b,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:55:58.687435 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:56:01.121024 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 38744) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:56:01.225587 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3b0d5073-0fc2-4fc5-9d27-2993410ffbe5 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:01.312254 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3b0d5073-0fc2-4fc5-9d27-2993410ffbe5 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:01.315756 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-3b0d5073-0fc2-4fc5-9d27-2993410ffbe5 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:01.352174 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-3b0d5073-0fc2-4fc5-9d27-2993410ffbe5 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=097080e798e34ba3865b88bac1a3fe7b&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2300529 Sep 18 08:56:01.354070 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3b0d5073-0fc2-4fc5-9d27-2993410ffbe5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a0c3abc8-200a-435b-ae56-52976745f1b7,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:56:01.355045 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 38748) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:56:01.404381 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-4613a476-556a-44ec-a2e2-fef8b32fe1eb admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:01.424130 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-4613a476-556a-44ec-a2e2-fef8b32fe1eb admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:01.468808 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-4613a476-556a-44ec-a2e2-fef8b32fe1eb admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:01.471254 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-4613a476-556a-44ec-a2e2-fef8b32fe1eb admin admin] Notify callbacks [] for security_group, before_response {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:01.472369 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-4613a476-556a-44ec-a2e2-fef8b32fe1eb admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/a0c3abc8-200a-435b-ae56-52976745f1b7 HTTP/1.1" status: 204 len: 168 time: 0.1162889 Sep 18 08:56:01.479898 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4613a476-556a-44ec-a2e2-fef8b32fe1eb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a0c3abc8-200a-435b-ae56-52976745f1b7,revision_number=None']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:56:01.721080 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 38754) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:56:01.734114 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ad5c1fc2-15b5-4543-9030-b2f62872af3d admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:01.818456 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ad5c1fc2-15b5-4543-9030-b2f62872af3d admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:01.822462 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-ad5c1fc2-15b5-4543-9030-b2f62872af3d admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:01.861226 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-ad5c1fc2-15b5-4543-9030-b2f62872af3d admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=ee6824500b2a4407b1e54098af65fd13&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1391127 Sep 18 08:56:01.862366 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad5c1fc2-15b5-4543-9030-b2f62872af3d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=06030d78-4795-408f-bf39-4c378ac8bfb6,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:56:01.863870 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 38756) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:56:01.911538 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c14f4ed7-21cc-47a5-b4d2-4073b26bd9df admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:01.932043 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c14f4ed7-21cc-47a5-b4d2-4073b26bd9df admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:01.978023 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c14f4ed7-21cc-47a5-b4d2-4073b26bd9df admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:01.980435 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-c14f4ed7-21cc-47a5-b4d2-4073b26bd9df admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:01.981620 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-c14f4ed7-21cc-47a5-b4d2-4073b26bd9df admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/06030d78-4795-408f-bf39-4c378ac8bfb6 HTTP/1.1" status: 204 len: 168 time: 0.1167424 Sep 18 08:56:01.988858 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c14f4ed7-21cc-47a5-b4d2-4073b26bd9df admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=06030d78-4795-408f-bf39-4c378ac8bfb6,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:56:07.562782 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 38838) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:56:07.664644 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dfcee367-276e-46e3-a591-b6f19bfa42af admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:07.750773 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dfcee367-276e-46e3-a591-b6f19bfa42af admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:07.754445 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-dfcee367-276e-46e3-a591-b6f19bfa42af admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:07.791664 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-dfcee367-276e-46e3-a591-b6f19bfa42af admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=fc2a32ca31974980847d30b0a49bf0be&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2277856 Sep 18 08:56:07.792512 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfcee367-276e-46e3-a591-b6f19bfa42af admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c9762a8b-df6e-47bd-967f-f0670f5d37f7,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:56:07.794401 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 38842) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:56:07.841975 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7595bde9-1668-4852-8e23-a7b059a78f42 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:07.866646 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7595bde9-1668-4852-8e23-a7b059a78f42 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:07.911832 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7595bde9-1668-4852-8e23-a7b059a78f42 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:07.915005 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-7595bde9-1668-4852-8e23-a7b059a78f42 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:07.916162 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-7595bde9-1668-4852-8e23-a7b059a78f42 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/c9762a8b-df6e-47bd-967f-f0670f5d37f7 HTTP/1.1" status: 204 len: 168 time: 0.1207690 Sep 18 08:56:07.923485 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7595bde9-1668-4852-8e23-a7b059a78f42 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c9762a8b-df6e-47bd-967f-f0670f5d37f7,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:56:08.165232 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 38848) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:56:08.178026 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-766ee003-246c-4f4c-8afb-594a0ce48e25 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:08.273903 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-766ee003-246c-4f4c-8afb-594a0ce48e25 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:08.277264 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-766ee003-246c-4f4c-8afb-594a0ce48e25 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:08.312014 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-766ee003-246c-4f4c-8afb-594a0ce48e25 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=097c524d-2996-472d-a5de-2838323ef577,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:56:08.316293 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-766ee003-246c-4f4c-8afb-594a0ce48e25 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=865f434e81984ea8883e5d3c79d82df8&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1500185 Sep 18 08:56:08.318811 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 38850) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:56:08.364609 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-5134a6e3-4a52-4c70-88bf-65e4440c111f admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:08.385194 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-5134a6e3-4a52-4c70-88bf-65e4440c111f admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:08.434003 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-5134a6e3-4a52-4c70-88bf-65e4440c111f admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:08.436544 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-5134a6e3-4a52-4c70-88bf-65e4440c111f admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:08.437702 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-5134a6e3-4a52-4c70-88bf-65e4440c111f admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/097c524d-2996-472d-a5de-2838323ef577 HTTP/1.1" status: 204 len: 168 time: 0.1180344 Sep 18 08:56:08.445631 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5134a6e3-4a52-4c70-88bf-65e4440c111f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=097c524d-2996-472d-a5de-2838323ef577,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:56:10.226888 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.wsgi [-] (94346) accepted ('10.222.0.35', 38922) {{(pid=94346) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:56:10.327061 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-7add0dac-25ef-4193-a070-6fb673931c19 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:10.412899 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-7add0dac-25ef-4193-a070-6fb673931c19 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:10.416816 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron_lib.callbacks.manager [None req-7add0dac-25ef-4193-a070-6fb673931c19 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94346) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:10.455425 dv-cinder-804470-6-iscsi neutron-server[94346]: INFO neutron.wsgi [None req-7add0dac-25ef-4193-a070-6fb673931c19 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=3f6890c5961b4be882f71435e02720cb&name=default HTTP/1.1" status: 200 len: 2979 time: 0.2275124 Sep 18 08:56:10.457378 dv-cinder-804470-6-iscsi neutron-server[94346]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7add0dac-25ef-4193-a070-6fb673931c19 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f6939cbe-aed5-45b1-9bb9-ac5416ae1627,revision_number=1']} {{(pid=94346) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:56:10.458098 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 38926) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:56:10.506394 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-1d12b736-9bde-4228-b459-bd9e9fa2ae11 admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:10.526431 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-1d12b736-9bde-4228-b459-bd9e9fa2ae11 admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:10.570815 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-1d12b736-9bde-4228-b459-bd9e9fa2ae11 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:10.573345 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-1d12b736-9bde-4228-b459-bd9e9fa2ae11 admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:10.574471 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-1d12b736-9bde-4228-b459-bd9e9fa2ae11 admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/f6939cbe-aed5-45b1-9bb9-ac5416ae1627 HTTP/1.1" status: 204 len: 168 time: 0.1153827 Sep 18 08:56:10.583657 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d12b736-9bde-4228-b459-bd9e9fa2ae11 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f6939cbe-aed5-45b1-9bb9-ac5416ae1627,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:56:10.821571 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 38932) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:56:10.834356 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0968278c-6d38-4d8e-9ee7-c4f27dde7870 admin admin] Notify callbacks [] for security_group, before_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:10.921727 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0968278c-6d38-4d8e-9ee7-c4f27dde7870 admin admin] Notify callbacks [] for security_group, precommit_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:10.925465 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-0968278c-6d38-4d8e-9ee7-c4f27dde7870 admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_create {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:10.961685 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0968278c-6d38-4d8e-9ee7-c4f27dde7870 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eb346bd4-958f-4bd0-8f7a-3a6240f13655,revision_number=1']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:56:10.966493 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-0968278c-6d38-4d8e-9ee7-c4f27dde7870 admin admin] 10.222.0.35 "GET /v2.0/security-groups?tenant_id=af7d581c873c4a608ba7890c2655e45e&name=default HTTP/1.1" status: 200 len: 2979 time: 0.1438766 Sep 18 08:56:10.969162 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [-] (94347) accepted ('10.222.0.35', 38934) {{(pid=94347) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Sep 18 08:56:11.018577 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-bb0c7df6-4668-4998-8c32-43d8200daf5a admin admin] Notify callbacks [] for security_group, before_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:11.039127 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-bb0c7df6-4668-4998-8c32-43d8200daf5a admin admin] Notify callbacks [] for security_group, precommit_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:11.084155 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-bb0c7df6-4668-4998-8c32-43d8200daf5a admin admin] Notify callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-565977'] for security_group, after_delete {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:11.087205 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron_lib.callbacks.manager [None req-bb0c7df6-4668-4998-8c32-43d8200daf5a admin admin] Notify callbacks [] for security_group, before_response {{(pid=94347) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:11.088340 dv-cinder-804470-6-iscsi neutron-server[94347]: INFO neutron.wsgi [None req-bb0c7df6-4668-4998-8c32-43d8200daf5a admin admin] 10.222.0.35 "DELETE /v2.0/security-groups/eb346bd4-958f-4bd0-8f7a-3a6240f13655 HTTP/1.1" status: 204 len: 168 time: 0.1184015 Sep 18 08:56:11.095486 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb0c7df6-4668-4998-8c32-43d8200daf5a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eb346bd4-958f-4bd0-8f7a-3a6240f13655,revision_number=None']} {{(pid=94347) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Sep 18 08:56:19.633350 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-cfbf44e0-d2bd-4507-b9a8-b433a43bf826 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:20.204594 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:22.418283 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-0d25886c-4e58-4615-9d27-f1b50658dfd4 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:23.238494 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:23.411254 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:24.930448 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:35.686008 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:56:49.635236 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-9ffc8bc3-98b8-427c-ae53-09bc112debe1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:50.210926 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:52.418859 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-593fd70d-a822-4e92-819b-ba79b1488bcb None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:53.239013 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:53.414443 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:56:54.932209 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:57:12.685274 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:57:19.636883 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-573d898f-4831-4903-8eeb-88a718c63a7f None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:57:20.213501 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:57:22.419044 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-ee9f4010-ae8e-4db8-8ec0-26965f6c7fd1 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:57:23.240004 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:57:23.416719 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:57:24.934673 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:57:49.637587 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-26db4b88-0d00-487c-936c-1d24ad8ecf3c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:57:49.684854 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:57:50.217802 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:57:52.419098 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-9334302c-5828-4939-b020-e71da5840963 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:57:53.241018 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:57:53.418893 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:57:54.936945 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:58:19.639301 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-67a5d041-e221-495e-8cc8-409b3629588c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:58:20.216977 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:58:22.420135 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-77e76213-5e03-47c5-80e5-bebaffdd45ed None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:58:23.242244 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:58:23.421285 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:58:24.939214 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:58:26.683505 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:58:49.640129 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-1ce246e5-3c1f-4aba-8db0-56c9db6db865 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:58:50.233371 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:58:52.419877 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-8ac38fc6-8acf-4a72-bdfa-2f9d7829af27 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:58:53.243462 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:58:53.423046 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:58:54.941098 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:59:03.682269 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:59:19.641118 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-f846acb0-8d9c-48ad-acbe-c8d15a61eb24 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:59:20.226401 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:59:22.419703 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-98a511ae-3c0b-4a6b-83a6-a49d075fc4ac None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:59:23.243753 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:59:23.424896 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:59:24.947178 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:59:40.680883 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 08:59:49.643605 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-dfd8b45f-71e5-450a-9416-2cadccbb19ce None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:59:50.225757 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:59:52.420033 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-c2e2d537-07d1-4ce9-b93f-5f52b2230631 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:59:53.244748 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:59:53.427969 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 08:59:54.946769 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 09:00:17.680317 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 09:00:19.643598 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-711353ef-6191-4d4b-ac51-2249d3d41364 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 09:00:20.232170 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 09:00:22.419982 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-5f16d812-10de-40bd-97a5-4dea693da10c None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 09:00:23.253960 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 09:00:23.431045 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 09:00:24.950156 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 09:00:49.644333 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-5f407f0b-5c6e-4e77-82c3-1f280f164929 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 09:00:50.239662 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 09:00:52.419198 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-bd3ddd51-bc83-429f-969c-39219fcfef0d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 09:00:53.245715 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 09:00:53.433450 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 09:00:54.679465 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 09:00:54.952507 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 09:01:19.644268 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-e283d828-f9ce-4f9a-8add-41b8422a9fa7 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 09:01:20.238588 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 09:01:22.418282 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-3553debb-de1e-440c-8a63-007f4ecf980d None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 09:01:23.246657 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-536c997d-2873-442a-81bf-9fe918803742 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 09:01:23.435175 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-974535ee-db6d-4224-853e-5816acbaf2d9 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 09:01:24.954197 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-96eee021-9850-4bc8-9d53-884c1cf5afd6 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 09:01:31.678301 dv-cinder-804470-6-iscsi neutron-server[94349]: DEBUG neutron.db.agents_db [None req-981de37c-a67f-455d-af87-9e736033d4fe None None] Agent healthcheck: found 6 active agents {{(pid=94349) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Sep 18 09:01:32.359110 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [req-c1623fa9-0f25-4ba2-8cc6-89279606d904 req-ea3e09c8-9f48-4340-b1ec-4e16e751cba1 tempest-VolumesSnapshotTestJSON-141199580 tempest-VolumesSnapshotTestJSON-141199580-project] (94347) timed out ('10.222.0.13', 59088) {{(pid=94347) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Sep 18 09:01:33.498325 dv-cinder-804470-6-iscsi neutron-server[94347]: DEBUG neutron.wsgi [req-5f394e6b-a1ab-4fca-aea4-8c7a7d4fe632 req-d61b178f-6679-45dd-8fad-bf5e51d241ab tempest-TestMinimumBasicScenario-88440651 tempest-TestMinimumBasicScenario-88440651-project] (94347) timed out ('10.222.0.13', 59084) {{(pid=94347) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Sep 18 09:01:49.644807 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-baba15c7-c51f-4e63-a902-6d9fc2958a98 None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}} Sep 18 09:01:50.257750 dv-cinder-804470-6-iscsi neutron-server[94348]: DEBUG neutron_lib.callbacks.manager [None req-fdde9223-b321-45de-b5b3-a5ef6cf7092b None None] Notify callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8732885752715', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1809119'] for agent, after_update {{(pid=94348) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:192}}